Sep 23 00:03:43 devstack cinder-volume[75357]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 23 00:03:43 devstack cinder-volume[75357]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 23 00:03:43 devstack cinder-volume[75357]: we strongly recommend against using it for new projects. Sep 23 00:03:43 devstack cinder-volume[75357]: If you are already using Eventlet, we recommend migrating to a different Sep 23 00:03:43 devstack cinder-volume[75357]: framework. For more detail see Sep 23 00:03:43 devstack cinder-volume[75357]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 23 00:03:43 devstack cinder-volume[75357]: import eventlet # noqa Sep 23 00:03:45 devstack cinder-volume[75357]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75357) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 23 00:03:45 devstack cinder-volume[75357]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75357) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 23 00:03:45 devstack cinder-volume[75357]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75357) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 23 00:03:46 devstack cinder-volume[75357]: INFO dbcounter [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] Registered counter for database cinder Sep 23 00:03:47 devstack cinder-volume[75357]: DEBUG oslo_db.sqlalchemy.engines [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75357) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:03:47 devstack cinder-volume[75357]: DEBUG dbcounter [-] [75357] Writer thread running {{(pid=75357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 23 00:03:47 devstack cinder-volume[75357]: INFO cinder.rpc [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 23 00:03:47 devstack cinder-volume[75357]: INFO cinder.rpc [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 23 00:03:47 devstack cinder-volume[75357]: DEBUG oslo_db.sqlalchemy.engines [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75357) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:03:47 devstack cinder-volume[75357]: INFO cinder.volume.manager [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] Determined volume DB was empty at startup. Sep 23 00:03:47 devstack cinder-volume[75357]: DEBUG cinder.volume.manager [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75357) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 23 00:03:47 devstack cinder-volume[75357]: INFO cinder.volume.manager [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 23 00:03:47 devstack cinder-volume[75357]: WARNING stevedore.named [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 23 00:03:47 devstack cinder-volume[75357]: WARNING castellan.key_manager [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 23 00:03:47 devstack cinder-volume[75357]: WARNING cinder.keymgr.conf_key_mgr [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 23 00:03:47 devstack cinder-volume[75357]: DEBUG cinder.volume.drivers.lvm [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75357) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 23 00:03:47 devstack cinder-volume[75357]: DEBUG oslo_concurrency.processutils [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_concurrency.processutils [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] CMD "cinder-rtstool verify" returned: 0 in 0.493s {{(pid=75357) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_db.sqlalchemy.engines [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75357) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:03:48 devstack cinder-volume[75357]: INFO cinder.rpc [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 23 00:03:48 devstack cinder-volume[75357]: INFO cinder.rpc [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 23 00:03:48 devstack cinder-volume[75357]: WARNING stevedore.named [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 23 00:03:48 devstack cinder-volume[75357]: WARNING castellan.key_manager [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 23 00:03:48 devstack cinder-volume[75357]: INFO cinder.volume.manager [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_db.sqlalchemy.engines [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75357) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:03:48 devstack cinder-volume[75357]: INFO oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] Starting 1 workers Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] Started child 75518 {{(pid=75357) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] Full set of CONF: {{(pid=75357) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] ******************************************************************************** {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] Configuration options gathered from: {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] ================================================================================ {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] allow_availability_zone_fallback = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] allow_compression_on_image_upload = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] allowed_direct_url_schemes = [] {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] api_rate_limit = True {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75518]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] auth_strategy = keystone {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] az_cache_duration = 3600 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_availability_zone = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_host = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_name = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_stats_polling_interval = 60 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backup_api_class = cinder.backup.api.API {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backup_name_template = backup-%s {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backup_use_same_host = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backup_use_temp_snapshot = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] chap_password = **** {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] chap_username = {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] cinder_internal_tenant_project_id = a72d187c2a984c1babeaae38bb5ad275 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] cinder_internal_tenant_user_id = b10d8019a19e46299f68101cef3e3ce4 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] cloned_volume_same_az = True {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] cluster = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] compression_format = gzip {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] compute_api_class = cinder.compute.nova.API {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] config_dir = [] {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] config_source = [] {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] control_exchange = openstack {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] debug = True {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] default_availability_zone = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] default_group_type = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] default_volume_type = lvmdriver-1 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] deployment_max_gigabytes = -1 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] disk_geometry = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] driver_client_cert = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] driver_client_cert_key = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] driver_data_namespace = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] driver_ssl_cert_path = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] driver_ssl_cert_verify = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] driver_use_ssl = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] enable_force_upload = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] enable_new_services = True {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] enable_unsupported_driver = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] enforce_multipath_for_image_xfer = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] filter_function = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] glance_api_insecure = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] glance_api_servers = ['http://192.168.122.21/image'] {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] glance_api_ssl_compression = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] glance_ca_certificates_file = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] glance_catalog_info = image:glance:publicURL {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] glance_certfile = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] glance_keyfile = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] glance_num_retries = 3 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] glance_request_timeout = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] goodness_function = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] graceful_shutdown_timeout = 5 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] group_api_class = cinder.group.api.API {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] host = devstack {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] image_compress_on_upload = True {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] image_conversion_address_space_limit = 1 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] image_conversion_cpu_limit = 60 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] image_conversion_disable = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] image_introspection_address_space_limit = 1 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] image_introspection_cpu_limit = 60 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] image_upload_use_cinder_backend = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] image_upload_use_internal_tenant = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] image_volume_cache_enabled = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] image_volume_cache_max_count = 0 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] image_volume_cache_max_size_gb = 0 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] init_host_max_objects_retrieval = 0 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] instance_format = [instance: %(uuid)s] {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] iscsi_target_flags = {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] iscsi_write_cache = on {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] iser_helper = tgtadm {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] iser_ip_address = 192.168.122.21 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] iser_port = 3260 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] log_color = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] log_config_append = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] log_dir = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] log_file = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] log_options = True {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] log_rotate_interval = 1 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] log_rotate_interval_type = days {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] log_rotation_type = none {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75518]: INFO cinder.volume.manager [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] max_age = 0 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] max_logfile_count = 30 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] max_logfile_size_mb = 200 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] max_over_subscription_ratio = 20.0 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] message_reap_interval = 86400 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] message_ttl = 2592000 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] migration_create_volume_timeout_secs = 300 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] monkey_patch = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] monkey_patch_modules = [] {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] my_ip = 192.168.122.21 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] no_snapshot_gb_quota = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] num_iser_scan_tries = 3 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] num_shell_tries = 3 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] num_volume_device_scan_tries = 3 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] nvmeof_conn_info_version = 1 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] nvmet_ns_id = 10 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] nvmet_port_id = 1 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] osapi_max_limit = 1000 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] osapi_volume_ext_list = [] {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] osapi_volume_listen_port = 8776 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] osapi_volume_use_ssl = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] osapi_volume_workers = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] per_volume_size_limit = -1 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] periodic_fuzzy_delay = 60 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] periodic_interval = 60 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] public_endpoint = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] publish_errors = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] quota_backup_gigabytes = 1000 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] quota_backups = 10 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] quota_gigabytes = 1000 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] quota_groups = 10 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] quota_snapshots = 10 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] quota_volumes = 10 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] rate_limit_burst = 0 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] rate_limit_except_level = CRITICAL {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] rate_limit_interval = 0 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] reinit_driver_count = 3 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] replication_device = **** {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] report_discard_supported = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] report_interval = 120 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] reservation_clean_interval = 86400 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] reservation_expire = 86400 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] reserved_image_namespaces = [] {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] reserved_percentage = 0 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] rpc_response_timeout = 120 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] run_external_periodic_tasks = True {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] scst_target_driver = iscsi {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] scst_target_iqn_name = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] service_down_time = 720 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] shell_completion = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] snapshot_name_template = snapshot-%s {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] snapshot_same_host = True {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] split_loggers = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] state_path = /opt/stack/data/cinder {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] storage_availability_zone = nova {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] storage_protocol = iSCSI {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] syslog_log_facility = LOG_USER {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] target_helper = lioadm {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] target_ip_address = 192.168.122.21 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] target_port = 3260 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] target_protocol = iscsi {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] target_secondary_ip_addresses = [] {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] trace_flags = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] transport_url = **** {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] until_refresh = 0 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] use_chap_auth = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] use_default_quota_class = True {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] use_journal = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] use_json = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] use_multipath_for_image_xfer = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] use_stderr = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] use_syslog = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] verify_glance_signatures = enabled {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] volume_api_class = cinder.volume.api.API {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] volume_backend_name = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] volume_clear = zero {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] volume_clear_ionice = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] volume_clear_size = 0 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] volume_copy_bps_limit = 0 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] volume_dd_blocksize = 1M {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] volume_name_template = volume-%s {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] volume_service_inithost_offload = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] volume_usage_audit_period = month {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] zoning_mode = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] oslo_concurrency.disable_process_locking = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] keystone_authtoken.auth_section = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] keystone_authtoken.auth_type = password {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] keystone_authtoken.auth_version = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] keystone_authtoken.cache = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] keystone_authtoken.certfile = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] keystone_authtoken.include_service_catalog = True {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] keystone_authtoken.insecure = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] keystone_authtoken.interface = public {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] keystone_authtoken.keyfile = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] keystone_authtoken.memcache_password = **** {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] keystone_authtoken.memcache_username = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] keystone_authtoken.region_name = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] keystone_authtoken.service_type = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.21/identity {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] cache.backend = dogpile.cache.null {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] cache.backend_argument = **** {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] cache.backend_expiration_time = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] cache.config_prefix = cache.oslo {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] cache.debug_cache_backend = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] cache.enable_retry_client = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] cache.enable_socket_keepalive = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] cache.enabled = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] cache.expiration_time = 600 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] cache.hashclient_retry_attempts = 2 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] cache.memcache_dead_retry = 300 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] cache.memcache_pool_maxsize = 10 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] cache.memcache_sasl_enabled = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] cache.password = **** {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] cache.proxies = [] {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] cache.redis_db = 0 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack sudo[75522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 23 00:03:48 devstack sudo[75522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] cache.redis_server = localhost:6379 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] cache.retry_attempts = 2 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] cache.retry_delay = 0.0 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] cache.socket_keepalive_count = 1 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] cache.socket_keepalive_idle = 1 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] cache.socket_keepalive_interval = 1 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] cache.socket_timeout = 1.0 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] cache.tls_allowed_ciphers = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] cache.tls_cafile = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] cache.tls_certfile = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] cache.tls_enabled = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] cache.tls_keyfile = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] cache.username = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] coordination.backend_url = **** {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] database.asyncio_connection = **** {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] database.asyncio_slave_connection = **** {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] database.backend = sqlalchemy {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] database.connection = **** {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] database.connection_debug = 0 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] database.connection_parameters = {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] database.connection_recycle_time = 3600 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] database.connection_trace = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] database.db_inc_retry_interval = True {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] database.db_max_retries = 20 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] database.db_max_retry_interval = 10 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] database.db_retry_interval = 1 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] database.max_overflow = 50 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] database.max_pool_size = 5 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] database.max_retries = 10 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] database.mysql_wsrep_sync_wait = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] database.pool_timeout = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] database.retry_interval = 10 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] database.slave_connection = **** {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] database.sqlite_synchronous = True {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] database.synchronous_reader = True {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] database.use_db_reconnect = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] oslo_messaging_tracing.insecure = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] profiler.connection_string = messaging:// {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] profiler.enabled = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] profiler.es_doc_type = notification {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] profiler.es_scroll_size = 10000 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] profiler.es_scroll_time = 2m {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] profiler.filter_error_trace = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] profiler.hmac_keys = **** {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] profiler.sentinel_service_name = mymaster {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] profiler.socket_timeout = 0.1 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] profiler.trace_requests = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] profiler.trace_sqlalchemy = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] profiler_jaeger.process_tags = {} {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] profiler_jaeger.service_name_prefix = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] profiler_otlp.service_name_prefix = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] oslo_policy.enforce_new_defaults = True {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] oslo_policy.policy_default_rule = default {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] oslo_policy.policy_file = policy.yaml {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] privsep_osbrick.group = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] privsep_osbrick.helper_command = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] privsep_osbrick.user = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] cinder_sys_admin.group = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] cinder_sys_admin.helper_command = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] cinder_sys_admin.user = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] service_user.auth_section = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] service_user.auth_type = password {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] service_user.cafile = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] service_user.certfile = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] service_user.collect_timing = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] service_user.insecure = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] service_user.keyfile = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] service_user.send_service_user_token = True {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] service_user.split_loggers = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] service_user.timeout = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] service_user.tls_ciphers = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] service_user.tls_min_version = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] glance.auth_section = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] glance.auth_type = password {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] glance.certfile = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] glance.collect_timing = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] glance.insecure = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] glance.keyfile = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] glance.region_name = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] glance.split_loggers = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] glance.timeout = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] glance.tls_ciphers = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] glance.tls_min_version = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_defaults.backend_availability_zone = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_defaults.chap_password = **** {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_defaults.chap_username = {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_defaults.disk_geometry = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_defaults.driver_client_cert = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_defaults.driver_client_cert_key = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_defaults.driver_data_namespace = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_defaults.driver_use_ssl = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_defaults.extra_capabilities = {} {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_defaults.filter_function = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_defaults.goodness_function = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_defaults.iscsi_target_flags = {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_defaults.iscsi_write_cache = on {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_defaults.iser_helper = tgtadm {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_defaults.iser_ip_address = 192.168.122.21 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_defaults.iser_port = 3260 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_defaults.lvm_share_target = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_defaults.lvm_type = auto {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_defaults.num_shell_tries = 3 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_defaults.replication_device = **** {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_defaults.report_discard_supported = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_defaults.reserved_percentage = 0 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_defaults.target_helper = tgtadm {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_defaults.target_ip_address = 192.168.122.21 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_defaults.target_port = 3260 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_defaults.target_protocol = iscsi {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_defaults.trace_flags = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_defaults.unique_fqdn_network = True {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_defaults.use_chap_auth = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_defaults.volume_backend_name = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_defaults.volume_clear = zero {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_defaults.volume_clear_ionice = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_defaults.volume_clear_size = 0 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] oslo_reports.file_event_handler = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] oslo_reports.log_dir = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] lvmdriver-1.backend_host = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] lvmdriver-1.chap_password = **** {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] lvmdriver-1.chap_username = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] lvmdriver-1.disk_geometry = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] lvmdriver-1.driver_client_cert = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] lvmdriver-1.extra_capabilities = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] lvmdriver-1.filter_function = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] lvmdriver-1.goodness_function = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] lvmdriver-1.iser_helper = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] lvmdriver-1.iser_ip_address = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] lvmdriver-1.iser_port = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] lvmdriver-1.lvm_share_target = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] lvmdriver-1.lvm_type = auto {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] lvmdriver-1.num_shell_tries = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] lvmdriver-1.replication_device = **** {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] lvmdriver-1.report_discard_supported = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] lvmdriver-1.reserved_percentage = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] lvmdriver-1.scst_target_driver = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] lvmdriver-1.storage_protocol = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] lvmdriver-1.target_helper = lioadm {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] lvmdriver-1.target_ip_address = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] lvmdriver-1.target_port = 3260 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] lvmdriver-1.trace_flags = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] lvmdriver-1.use_chap_auth = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] lvmdriver-1.volume_clear = zero {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] lvmdriver-1.volume_clear_size = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] lvmdriver-1.volumes_dir = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] oslo_messaging_rabbit.ssl = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] oslo_messaging_notifications.driver = [] {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] oslo_messaging_notifications.retry = -1 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] key_manager.fixed_key = **** {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] barbican.barbican_api_version = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] barbican.barbican_endpoint = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] barbican.barbican_endpoint_type = public {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] barbican.barbican_region_name = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] barbican.cafile = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] barbican.certfile = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] barbican.collect_timing = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] barbican.insecure = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] barbican.keyfile = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] barbican.number_of_retries = 60 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] barbican.retry_delay = 1 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] barbican.send_service_user_token = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] barbican.split_loggers = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] barbican.timeout = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] barbican.tls_ciphers = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] barbican.tls_min_version = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] barbican.verify_ssl = True {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] barbican.verify_ssl_path = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] barbican_service_user.auth_section = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] barbican_service_user.auth_type = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] barbican_service_user.cafile = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] barbican_service_user.certfile = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] barbican_service_user.collect_timing = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] barbican_service_user.insecure = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] barbican_service_user.keyfile = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] barbican_service_user.split_loggers = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] barbican_service_user.timeout = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] barbican_service_user.tls_ciphers = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] barbican_service_user.tls_min_version = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] vault.approle_role_id = **** {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] vault.approle_secret_id = **** {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] vault.auth_method = approle {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] vault.auth_path = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] vault.kv_mountpoint = secret {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] vault.kv_path = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] vault.kv_version = 2 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] vault.namespace = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] vault.root_token_id = **** {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] vault.ssl_ca_crt_file = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] vault.timeout = 60.0 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] vault.token_file = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] vault.token_role = None {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] vault.use_ssl = False {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:03:48 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] ******************************************************************************** {{(pid=75357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 23 00:03:48 devstack sudo[75522]: pam_unix(sudo:session): session closed for user root Sep 23 00:03:48 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.308s {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:03:48 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:03:48 devstack sudo[75685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:03:48 devstack sudo[75685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:03:49 devstack sudo[75685]: pam_unix(sudo:session): session closed for user root Sep 23 00:03:49 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.266s {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:03:49 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:03:49 devstack cinder-volume[75518]: INFO cinder.brick.local_dev.lvm [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 23 00:03:49 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:03:49 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:03:49 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:03:49 devstack sudo[75793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 00:03:49 devstack sudo[75793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:03:49 devstack sudo[75793]: pam_unix(sudo:session): session closed for user root Sep 23 00:03:49 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:03:49 devstack cinder-volume[75518]: DEBUG cinder.brick.local_dev.lvm [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75518) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 23 00:03:49 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:03:49 devstack sudo[75889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:03:49 devstack sudo[75889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:03:49 devstack sudo[75889]: pam_unix(sudo:session): session closed for user root Sep 23 00:03:49 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.579s {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:03:49 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:03:49 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:03:49 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:03:49 devstack sudo[76122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:03:49 devstack sudo[76122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:03:50 devstack sudo[76122]: pam_unix(sudo:session): session closed for user root Sep 23 00:03:50 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.271s {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:03:50 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:03:50 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:03:50 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:03:50 devstack sudo[76126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 23 00:03:50 devstack sudo[76126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:03:50 devstack sudo[76126]: pam_unix(sudo:session): session closed for user root Sep 23 00:03:50 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.291s {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:03:50 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:03:50 devstack sudo[76209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 00:03:50 devstack sudo[76209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:03:50 devstack sudo[76209]: pam_unix(sudo:session): session closed for user root Sep 23 00:03:50 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:03:50 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:03:50 devstack sudo[76212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 00:03:50 devstack sudo[76212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:03:51 devstack sudo[76212]: pam_unix(sudo:session): session closed for user root Sep 23 00:03:51 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.297s {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:03:51 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:03:51 devstack sudo[76244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:03:51 devstack sudo[76244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:03:51 devstack sudo[76244]: pam_unix(sudo:session): session closed for user root Sep 23 00:03:51 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.316s {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:03:51 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:03:51 devstack sudo[76304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:03:51 devstack sudo[76304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:03:51 devstack sudo[76304]: pam_unix(sudo:session): session closed for user root Sep 23 00:03:51 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:03:51 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:03:51 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:03:51 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:03:51 devstack sudo[76308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:03:51 devstack sudo[76308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:03:51 devstack sudo[76308]: pam_unix(sudo:session): session closed for user root Sep 23 00:03:51 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:03:51 devstack cinder-volume[75518]: INFO cinder.volume.drivers.lvm [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 23 00:03:51 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:03:51 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:03:51 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:03:52 devstack sudo[76312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:03:52 devstack sudo[76312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:03:52 devstack sudo[76312]: pam_unix(sudo:session): session closed for user root Sep 23 00:03:52 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.332s {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:03:52 devstack cinder-volume[75518]: DEBUG cinder.volume.drivers.lvm [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] Updating volume stats {{(pid=75518) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 23 00:03:52 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:03:52 devstack sudo[76315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 00:03:52 devstack sudo[76315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:03:52 devstack sudo[76315]: pam_unix(sudo:session): session closed for user root Sep 23 00:03:52 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:03:52 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:03:52 devstack sudo[76324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:03:52 devstack sudo[76324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:03:52 devstack sudo[76324]: pam_unix(sudo:session): session closed for user root Sep 23 00:03:52 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.355s {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:03:52 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:03:52 devstack sudo[76361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:03:52 devstack sudo[76361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:03:53 devstack sudo[76361]: pam_unix(sudo:session): session closed for user root Sep 23 00:03:53 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.319s {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:03:53 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:03:53 devstack sudo[76364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:03:53 devstack sudo[76364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:03:53 devstack sudo[76364]: pam_unix(sudo:session): session closed for user root Sep 23 00:03:53 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.339s {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:03:53 devstack cinder-volume[75518]: INFO cinder.volume.driver [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] Driver hasn't implemented _init_vendor_properties() Sep 23 00:03:53 devstack cinder-volume[75518]: DEBUG cinder.volume.driver [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75518) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 23 00:03:53 devstack cinder-volume[75518]: DEBUG oslo_db.sqlalchemy.engines [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75518) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:03:53 devstack cinder-volume[75518]: DEBUG dbcounter [-] [75518] Writer thread running {{(pid=75518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 23 00:03:53 devstack cinder-volume[75518]: DEBUG cinder.db.api [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] Building query based on filter {{(pid=75518) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 23 00:03:53 devstack cinder-volume[75518]: DEBUG cinder.image.image_utils [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75518) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 23 00:03:53 devstack cinder-volume[75518]: INFO cinder.keymgr.migration [None req-d53d90f5-fe91-4673-8f83-5eaa41f402c2 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 23 00:03:53 devstack cinder-volume[75518]: DEBUG cinder.volume.drivers.lvm [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] Updating volume stats {{(pid=75518) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 23 00:03:53 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:03:53 devstack sudo[76372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 00:03:53 devstack sudo[76372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:03:54 devstack sudo[76372]: pam_unix(sudo:session): session closed for user root Sep 23 00:03:54 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:03:54 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:03:54 devstack sudo[76375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:03:54 devstack sudo[76375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:03:54 devstack sudo[76375]: pam_unix(sudo:session): session closed for user root Sep 23 00:03:54 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.357s {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:03:54 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:03:54 devstack sudo[76378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:03:54 devstack sudo[76378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:03:54 devstack sudo[76378]: pam_unix(sudo:session): session closed for user root Sep 23 00:03:54 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.371s {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:03:54 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:03:54 devstack sudo[76381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:03:54 devstack sudo[76381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:03:55 devstack sudo[76381]: pam_unix(sudo:session): session closed for user root Sep 23 00:03:55 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.287s {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:03:55 devstack cinder-volume[75518]: DEBUG cinder.manager [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] Notifying Schedulers of capabilities ... {{(pid=75518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:03:55 devstack cinder-volume[75518]: INFO cinder.volume.manager [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] Driver initialization completed successfully. Sep 23 00:03:55 devstack cinder-volume[75518]: INFO cinder.manager [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] Initiating service 2 cleanup Sep 23 00:03:55 devstack cinder-volume[75518]: INFO cinder.manager [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] Service 2 cleanup completed. Sep 23 00:03:55 devstack cinder-volume[75518]: DEBUG cinder.service [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] Creating RPC server for service cinder-volume {{(pid=75518) start /opt/stack/cinder/cinder/service.py:231}} Sep 23 00:03:55 devstack cinder-volume[75518]: DEBUG cinder.service [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75518) start /opt/stack/cinder/cinder/service.py:237}} Sep 23 00:03:55 devstack cinder-volume[75518]: INFO cinder.volume.manager [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 23 00:03:55 devstack cinder-volume[75518]: DEBUG cinder.volume.drivers.lvm [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] Updating volume stats {{(pid=75518) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 23 00:03:55 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:03:55 devstack sudo[76386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 00:03:55 devstack sudo[76386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:03:55 devstack sudo[76386]: pam_unix(sudo:session): session closed for user root Sep 23 00:03:55 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:03:55 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:03:55 devstack sudo[76389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:03:55 devstack sudo[76389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:03:55 devstack sudo[76389]: pam_unix(sudo:session): session closed for user root Sep 23 00:03:55 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:03:55 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:03:55 devstack sudo[76393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:03:55 devstack sudo[76393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:03:56 devstack sudo[76393]: pam_unix(sudo:session): session closed for user root Sep 23 00:03:56 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.268s {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:03:56 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:03:56 devstack sudo[76399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:03:56 devstack sudo[76399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:03:56 devstack sudo[76399]: pam_unix(sudo:session): session closed for user root Sep 23 00:03:56 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:03:56 devstack cinder-volume[75518]: INFO cinder.volume.manager [None req-49d474bf-c702-4bee-ac54-ebf0f1403d68 None None] Driver post RPC initialization completed successfully. Sep 23 00:03:58 devstack cinder-volume[75357]: DEBUG dbcounter [-] [75357] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:04:06 devstack cinder-volume[75518]: DEBUG dbcounter [-] [75518] Writing DB stats cinder:SELECT=3 {{(pid=75518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:04:06 devstack cinder-volume[75518]: DEBUG dbcounter [-] [75518] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:04:19 devstack cinder-volume[75518]: DEBUG oslo_service.periodic_task [None req-bf75c472-73f5-4daa-9751-295614f06398 None None] Running periodic task VolumeManager._thread_info {{(pid=75518) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:04:19 devstack cinder-volume[75518]: DEBUG cinder.volume.manager [None req-bf75c472-73f5-4daa-9751-295614f06398 None None] thread count: 6 {{(pid=75518) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:04:19 devstack cinder-volume[75518]: DEBUG cinder.volume.manager [None req-bf75c472-73f5-4daa-9751-295614f06398 None None] thread info: [<_MainThread(MainThread, started 133689061212288)>, , , , , ] {{(pid=75518) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:05:19 devstack cinder-volume[75518]: DEBUG oslo_service.periodic_task [None req-bf75c472-73f5-4daa-9751-295614f06398 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75518) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:05:19 devstack cinder-volume[75518]: DEBUG cinder.volume.drivers.lvm [None req-bf75c472-73f5-4daa-9751-295614f06398 None None] Updating volume stats {{(pid=75518) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 23 00:05:19 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-bf75c472-73f5-4daa-9751-295614f06398 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:19 devstack sudo[79033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 00:05:19 devstack sudo[79033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:19 devstack sudo[79033]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:19 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-bf75c472-73f5-4daa-9751-295614f06398 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.293s {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:19 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-bf75c472-73f5-4daa-9751-295614f06398 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:19 devstack sudo[79036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:05:19 devstack sudo[79036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:19 devstack sudo[79036]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:19 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-bf75c472-73f5-4daa-9751-295614f06398 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.299s {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:19 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-bf75c472-73f5-4daa-9751-295614f06398 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:19 devstack sudo[79039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:05:19 devstack sudo[79039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:20 devstack sudo[79039]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:20 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-bf75c472-73f5-4daa-9751-295614f06398 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.273s {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:20 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-bf75c472-73f5-4daa-9751-295614f06398 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:20 devstack sudo[79042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:05:20 devstack sudo[79042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:20 devstack sudo[79042]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:20 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-bf75c472-73f5-4daa-9751-295614f06398 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:20 devstack cinder-volume[75518]: DEBUG cinder.manager [None req-bf75c472-73f5-4daa-9751-295614f06398 None None] Notifying Schedulers of capabilities ... {{(pid=75518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:05:20 devstack cinder-volume[75518]: DEBUG oslo_service.periodic_task [None req-bf75c472-73f5-4daa-9751-295614f06398 None None] Running periodic task VolumeManager._thread_info {{(pid=75518) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:05:20 devstack cinder-volume[75518]: DEBUG cinder.volume.manager [None req-bf75c472-73f5-4daa-9751-295614f06398 None None] thread count: 6 {{(pid=75518) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:05:20 devstack cinder-volume[75518]: DEBUG cinder.volume.manager [None req-bf75c472-73f5-4daa-9751-295614f06398 None None] thread info: [<_MainThread(MainThread, started 133689061212288)>, , , , , ] {{(pid=75518) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:06:06 devstack cinder-volume[75518]: DEBUG dbcounter [-] [75518] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:06:19 devstack cinder-volume[75518]: DEBUG oslo_service.periodic_task [None req-bf75c472-73f5-4daa-9751-295614f06398 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75518) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:06:19 devstack cinder-volume[75518]: DEBUG cinder.volume.drivers.lvm [None req-bf75c472-73f5-4daa-9751-295614f06398 None None] Updating volume stats {{(pid=75518) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 23 00:06:19 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-bf75c472-73f5-4daa-9751-295614f06398 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:06:19 devstack sudo[82026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 00:06:19 devstack sudo[82026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:06:19 devstack sudo[82026]: pam_unix(sudo:session): session closed for user root Sep 23 00:06:19 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-bf75c472-73f5-4daa-9751-295614f06398 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:06:19 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-bf75c472-73f5-4daa-9751-295614f06398 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:06:19 devstack sudo[82029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:06:19 devstack sudo[82029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:06:19 devstack sudo[82029]: pam_unix(sudo:session): session closed for user root Sep 23 00:06:19 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-bf75c472-73f5-4daa-9751-295614f06398 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:06:19 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-bf75c472-73f5-4daa-9751-295614f06398 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:06:19 devstack sudo[82032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:06:19 devstack sudo[82032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:06:20 devstack sudo[82032]: pam_unix(sudo:session): session closed for user root Sep 23 00:06:20 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-bf75c472-73f5-4daa-9751-295614f06398 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:06:20 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-bf75c472-73f5-4daa-9751-295614f06398 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:06:20 devstack sudo[82035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:06:20 devstack sudo[82035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:06:20 devstack sudo[82035]: pam_unix(sudo:session): session closed for user root Sep 23 00:06:20 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-bf75c472-73f5-4daa-9751-295614f06398 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:06:20 devstack cinder-volume[75518]: DEBUG cinder.manager [None req-bf75c472-73f5-4daa-9751-295614f06398 None None] Notifying Schedulers of capabilities ... {{(pid=75518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:06:20 devstack cinder-volume[75518]: DEBUG oslo_service.periodic_task [None req-bf75c472-73f5-4daa-9751-295614f06398 None None] Running periodic task VolumeManager._thread_info {{(pid=75518) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:06:20 devstack cinder-volume[75518]: DEBUG cinder.volume.manager [None req-bf75c472-73f5-4daa-9751-295614f06398 None None] thread count: 6 {{(pid=75518) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:06:20 devstack cinder-volume[75518]: DEBUG cinder.volume.manager [None req-bf75c472-73f5-4daa-9751-295614f06398 None None] thread info: [<_MainThread(MainThread, started 133689061212288)>, , , , , ] {{(pid=75518) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:07:19 devstack cinder-volume[75518]: DEBUG oslo_service.periodic_task [None req-bf75c472-73f5-4daa-9751-295614f06398 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75518) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:07:19 devstack cinder-volume[75518]: DEBUG cinder.volume.drivers.lvm [None req-bf75c472-73f5-4daa-9751-295614f06398 None None] Updating volume stats {{(pid=75518) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 23 00:07:19 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-bf75c472-73f5-4daa-9751-295614f06398 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:07:19 devstack sudo[84207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 00:07:19 devstack sudo[84207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:07:19 devstack sudo[84207]: pam_unix(sudo:session): session closed for user root Sep 23 00:07:19 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-bf75c472-73f5-4daa-9751-295614f06398 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:07:19 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-bf75c472-73f5-4daa-9751-295614f06398 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:07:19 devstack sudo[84211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:07:19 devstack sudo[84211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:07:19 devstack sudo[84211]: pam_unix(sudo:session): session closed for user root Sep 23 00:07:19 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-bf75c472-73f5-4daa-9751-295614f06398 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:07:19 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-bf75c472-73f5-4daa-9751-295614f06398 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:07:19 devstack sudo[84214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:07:19 devstack sudo[84214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:07:20 devstack sudo[84214]: pam_unix(sudo:session): session closed for user root Sep 23 00:07:20 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-bf75c472-73f5-4daa-9751-295614f06398 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.270s {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:07:20 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-bf75c472-73f5-4daa-9751-295614f06398 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:07:20 devstack sudo[84221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:07:20 devstack sudo[84221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:07:20 devstack sudo[84221]: pam_unix(sudo:session): session closed for user root Sep 23 00:07:20 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-bf75c472-73f5-4daa-9751-295614f06398 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:07:20 devstack cinder-volume[75518]: DEBUG cinder.manager [None req-bf75c472-73f5-4daa-9751-295614f06398 None None] Notifying Schedulers of capabilities ... {{(pid=75518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:08:06 devstack cinder-volume[75518]: DEBUG dbcounter [-] [75518] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:08:19 devstack cinder-volume[75518]: DEBUG oslo_service.periodic_task [None req-bf75c472-73f5-4daa-9751-295614f06398 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75518) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:08:19 devstack cinder-volume[75518]: DEBUG cinder.volume.drivers.lvm [None req-bf75c472-73f5-4daa-9751-295614f06398 None None] Updating volume stats {{(pid=75518) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 23 00:08:19 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-bf75c472-73f5-4daa-9751-295614f06398 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:08:19 devstack sudo[85255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 00:08:19 devstack sudo[85255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:08:19 devstack sudo[85255]: pam_unix(sudo:session): session closed for user root Sep 23 00:08:19 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-bf75c472-73f5-4daa-9751-295614f06398 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.312s {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:08:19 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-bf75c472-73f5-4daa-9751-295614f06398 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:08:19 devstack sudo[85258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:08:19 devstack sudo[85258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:08:19 devstack sudo[85258]: pam_unix(sudo:session): session closed for user root Sep 23 00:08:19 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-bf75c472-73f5-4daa-9751-295614f06398 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:08:19 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-bf75c472-73f5-4daa-9751-295614f06398 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:08:19 devstack sudo[85272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:08:19 devstack sudo[85272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:08:20 devstack sudo[85272]: pam_unix(sudo:session): session closed for user root Sep 23 00:08:20 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-bf75c472-73f5-4daa-9751-295614f06398 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.305s {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:08:20 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-bf75c472-73f5-4daa-9751-295614f06398 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:08:20 devstack sudo[85275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:08:20 devstack sudo[85275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:08:20 devstack sudo[85275]: pam_unix(sudo:session): session closed for user root Sep 23 00:08:20 devstack cinder-volume[75518]: DEBUG oslo_concurrency.processutils [None req-bf75c472-73f5-4daa-9751-295614f06398 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=75518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:08:20 devstack cinder-volume[75518]: DEBUG cinder.manager [None req-bf75c472-73f5-4daa-9751-295614f06398 None None] Notifying Schedulers of capabilities ... {{(pid=75518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:08:20 devstack cinder-volume[75518]: DEBUG oslo_service.periodic_task [None req-bf75c472-73f5-4daa-9751-295614f06398 None None] Running periodic task VolumeManager._thread_info {{(pid=75518) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:08:20 devstack cinder-volume[75518]: DEBUG cinder.volume.manager [None req-bf75c472-73f5-4daa-9751-295614f06398 None None] thread count: 6 {{(pid=75518) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:08:20 devstack cinder-volume[75518]: DEBUG cinder.volume.manager [None req-bf75c472-73f5-4daa-9751-295614f06398 None None] thread info: [<_MainThread(MainThread, started 133689061212288)>, , , , , ] {{(pid=75518) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:08:26 devstack cinder-volume[75357]: INFO oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] Caught SIGTERM, stopping children Sep 23 00:08:26 devstack cinder-volume[75357]: DEBUG oslo_concurrency.lockutils [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] Acquiring lock "singleton_lock" {{(pid=75357) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 23 00:08:26 devstack cinder-volume[75357]: DEBUG oslo_concurrency.lockutils [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] Acquired lock "singleton_lock" {{(pid=75357) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 23 00:08:26 devstack cinder-volume[75357]: DEBUG oslo_concurrency.lockutils [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] Releasing lock "singleton_lock" {{(pid=75357) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 23 00:08:26 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] Stop services. {{(pid=75357) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 23 00:08:26 devstack cinder-volume[75357]: DEBUG oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] Killing children. {{(pid=75357) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 23 00:08:26 devstack cinder-volume[75357]: INFO oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] Waiting on 1 children to exit Sep 23 00:08:30 devstack cinder-volume[75518]: DEBUG oslo_concurrency.lockutils [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] Acquiring lock "singleton_lock" {{(pid=75518) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 23 00:08:30 devstack cinder-volume[75518]: DEBUG oslo_concurrency.lockutils [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] Acquired lock "singleton_lock" {{(pid=75518) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 23 00:08:30 devstack cinder-volume[75518]: DEBUG oslo_concurrency.lockutils [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] Releasing lock "singleton_lock" {{(pid=75518) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 23 00:08:30 devstack cinder-volume[75518]: WARNING amqp [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 23 00:08:30 devstack cinder-volume[75518]: WARNING amqp [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 23 00:08:30 devstack cinder-volume[75357]: INFO oslo_service.backend._eventlet.service [None req-c91f3e25-28c5-4358-9bc4-3f6297aedc03 None None] Child 75518 exited with status 0 Sep 23 00:08:30 devstack cinder-volume[85578]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 23 00:08:30 devstack cinder-volume[85578]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 23 00:08:30 devstack cinder-volume[85578]: we strongly recommend against using it for new projects. Sep 23 00:08:30 devstack cinder-volume[85578]: If you are already using Eventlet, we recommend migrating to a different Sep 23 00:08:30 devstack cinder-volume[85578]: framework. For more detail see Sep 23 00:08:30 devstack cinder-volume[85578]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 23 00:08:30 devstack cinder-volume[85578]: import eventlet # noqa Sep 23 00:08:32 devstack cinder-volume[85578]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85578) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 23 00:08:32 devstack cinder-volume[85578]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85578) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 23 00:08:32 devstack cinder-volume[85578]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85578) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 23 00:08:33 devstack cinder-volume[85578]: INFO dbcounter [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] Registered counter for database cinder Sep 23 00:08:33 devstack cinder-volume[85578]: DEBUG oslo_db.sqlalchemy.engines [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85578) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG dbcounter [-] [85578] Writer thread running {{(pid=85578) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 23 00:08:34 devstack cinder-volume[85578]: INFO cinder.rpc [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 23 00:08:34 devstack cinder-volume[85578]: INFO cinder.rpc [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_db.sqlalchemy.engines [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85578) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:08:34 devstack cinder-volume[85578]: INFO cinder.volume.manager [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] Determined volume DB was empty at startup. Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG cinder.volume.manager [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85578) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 23 00:08:34 devstack cinder-volume[85578]: INFO cinder.volume.manager [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 23 00:08:34 devstack cinder-volume[85578]: WARNING stevedore.named [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 23 00:08:34 devstack cinder-volume[85578]: WARNING castellan.key_manager [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 23 00:08:34 devstack cinder-volume[85578]: WARNING cinder.keymgr.conf_key_mgr [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 23 00:08:34 devstack cinder-volume[85578]: INFO cinder.volume.manager [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_db.sqlalchemy.engines [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85578) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:08:34 devstack cinder-volume[85578]: INFO oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] Starting 1 workers Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] Started child 85800 {{(pid=85578) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] Full set of CONF: {{(pid=85578) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] ******************************************************************************** {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] Configuration options gathered from: {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 23 00:08:34 devstack cinder-volume[85800]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] ================================================================================ {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] allow_availability_zone_fallback = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] allow_compression_on_image_upload = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] allowed_direct_url_schemes = [] {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] api_rate_limit = True {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] auth_strategy = keystone {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_availability_zone = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_host = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_name = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_stats_polling_interval = 60 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backup_api_class = cinder.backup.api.API {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backup_name_template = backup-%s {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backup_use_same_host = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backup_use_temp_snapshot = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] chap_password = **** {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] chap_username = {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] cinder_internal_tenant_project_id = a72d187c2a984c1babeaae38bb5ad275 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] cinder_internal_tenant_user_id = b10d8019a19e46299f68101cef3e3ce4 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] cluster = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] compression_format = gzip {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] compute_api_class = cinder.compute.nova.API {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] config_dir = [] {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] config_source = [] {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] control_exchange = openstack {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] debug = True {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] default_availability_zone = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] default_group_type = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] default_volume_type = QuobyteHD {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] deployment_max_gigabytes = -1 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] disk_geometry = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85800]: INFO cinder.volume.manager [None req-7e672085-8b93-430a-9d28-25844abd3cce None None] Starting volume driver QuobyteDriver (1.2.1) Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] driver_client_cert = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85800]: DEBUG cinder.volume.drivers.remotefs [None req-7e672085-8b93-430a-9d28-25844abd3cce None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85800) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] driver_client_cert_key = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] driver_data_namespace = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] driver_ssl_cert_path = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] driver_ssl_cert_verify = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] driver_use_ssl = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] enable_new_services = True {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] enable_unsupported_driver = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] enabled_backends = ['QuobyteHD'] {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] enforce_multipath_for_image_xfer = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] filter_function = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] glance_api_insecure = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] glance_api_servers = ['http://192.168.122.21/image'] {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] glance_api_ssl_compression = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] glance_ca_certificates_file = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] glance_catalog_info = image:glance:publicURL {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] glance_certfile = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] glance_keyfile = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] glance_num_retries = 3 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] glance_request_timeout = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] goodness_function = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] graceful_shutdown_timeout = 5 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] group_api_class = cinder.group.api.API {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] host = devstack {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] image_compress_on_upload = True {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] image_conversion_address_space_limit = 1 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] image_conversion_cpu_limit = 60 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] image_conversion_disable = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] image_introspection_address_space_limit = 1 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] image_introspection_cpu_limit = 60 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] image_upload_use_cinder_backend = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] image_upload_use_internal_tenant = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] image_volume_cache_enabled = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] image_volume_cache_max_count = 0 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] image_volume_cache_max_size_gb = 0 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] init_host_max_objects_retrieval = 0 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] instance_format = [instance: %(uuid)s] {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] iscsi_target_flags = {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] iscsi_write_cache = on {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] iser_helper = tgtadm {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] iser_ip_address = 192.168.122.21 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] iser_port = 3260 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] log_color = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] log_config_append = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] log_dir = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] log_file = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] log_options = True {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] log_rotate_interval = 1 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] log_rotate_interval_type = days {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] log_rotation_type = none {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] max_age = 0 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] max_logfile_count = 30 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] max_logfile_size_mb = 200 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] max_over_subscription_ratio = 20.0 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] message_reap_interval = 86400 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] message_ttl = 2592000 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] migration_create_volume_timeout_secs = 300 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] monkey_patch = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] monkey_patch_modules = [] {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] my_ip = 192.168.122.21 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] no_snapshot_gb_quota = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] num_iser_scan_tries = 3 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] num_shell_tries = 3 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] num_volume_device_scan_tries = 3 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] nvmeof_conn_info_version = 1 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] nvmet_ns_id = 10 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] nvmet_port_id = 1 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] osapi_max_limit = 1000 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] osapi_volume_ext_list = [] {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] osapi_volume_listen = 0.0.0.0 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] osapi_volume_listen_port = 8776 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] osapi_volume_use_ssl = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] osapi_volume_workers = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] per_volume_size_limit = -1 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] periodic_fuzzy_delay = 60 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] periodic_interval = 60 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] project_id_regex = [0-9a-f\-]+ {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] public_endpoint = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] publish_errors = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] quota_backup_gigabytes = 1000 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] quota_backups = 10 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] quota_gigabytes = 1000 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] quota_groups = 10 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] quota_snapshots = 10 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] quota_volumes = 10 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] rate_limit_burst = 0 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] rate_limit_except_level = CRITICAL {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] rate_limit_interval = 0 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] reinit_driver_count = 3 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] replication_device = **** {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] report_discard_supported = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] report_interval = 120 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] reservation_clean_interval = 86400 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] reservation_expire = 86400 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] reserved_image_namespaces = [] {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] reserved_percentage = 0 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] rpc_response_timeout = 120 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] run_external_periodic_tasks = True {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] scst_target_driver = iscsi {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] scst_target_iqn_name = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] service_down_time = 720 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] shell_completion = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] snapshot_name_template = snapshot-%s {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] split_loggers = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] state_path = /opt/stack/data/cinder {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] storage_availability_zone = nova {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] storage_protocol = iSCSI {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] syslog_log_facility = LOG_USER {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] target_helper = lioadm {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] target_ip_address = 192.168.122.21 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] target_port = 3260 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] target_protocol = iscsi {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] target_secondary_ip_addresses = [] {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] trace_flags = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] transfer_api_class = cinder.transfer.api.API {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] transport_url = **** {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] until_refresh = 0 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] use_chap_auth = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] use_default_quota_class = True {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] use_journal = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] use_json = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] use_multipath_for_image_xfer = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] use_stderr = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] use_syslog = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] verify_glance_signatures = enabled {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] volume_api_class = cinder.volume.api.API {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] volume_backend_name = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] volume_clear = zero {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] volume_clear_ionice = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] volume_clear_size = 0 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] volume_copy_bps_limit = 0 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] volume_dd_blocksize = 1M {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] volume_name_template = volume-%s {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] volume_service_inithost_offload = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] volume_usage_audit_period = month {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] zoning_mode = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] oslo_concurrency.disable_process_locking = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] keystone_authtoken.auth_section = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] keystone_authtoken.auth_type = password {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] keystone_authtoken.auth_version = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] keystone_authtoken.cache = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] keystone_authtoken.certfile = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] keystone_authtoken.delay_auth_decision = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] keystone_authtoken.http_connect_timeout = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] keystone_authtoken.include_service_catalog = True {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] keystone_authtoken.insecure = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] keystone_authtoken.interface = public {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] keystone_authtoken.keyfile = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] keystone_authtoken.memcache_password = **** {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85800]: DEBUG cinder.volume.drivers.quobyte [None req-7e672085-8b93-430a-9d28-25844abd3cce None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85800) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 23 00:08:34 devstack cinder-volume[85800]: WARNING cinder.volume.drivers.quobyte [None req-7e672085-8b93-430a-9d28-25844abd3cce None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 23 00:08:34 devstack cinder-volume[85800]: WARNING cinder.volume.drivers.quobyte [None req-7e672085-8b93-430a-9d28-25844abd3cce None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85800]: DEBUG oslo_concurrency.processutils [None req-7e672085-8b93-430a-9d28-25844abd3cce None None] Running cmd (subprocess): mount.quobyte {{(pid=85800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] keystone_authtoken.memcache_username = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] keystone_authtoken.region_name = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] keystone_authtoken.service_token_roles_required = True {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] keystone_authtoken.service_type = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] keystone_authtoken.token_cache_time = 300 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.21/identity {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] cache.backend = dogpile.cache.null {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] cache.backend_argument = **** {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] cache.backend_expiration_time = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] cache.config_prefix = cache.oslo {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] cache.debug_cache_backend = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] cache.enable_retry_client = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] cache.enable_socket_keepalive = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] cache.enabled = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] cache.expiration_time = 600 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] cache.hashclient_retry_attempts = 2 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] cache.memcache_dead_retry = 300 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] cache.memcache_pool_maxsize = 10 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] cache.memcache_sasl_enabled = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] cache.password = **** {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] cache.proxies = [] {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] cache.redis_db = 0 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] cache.redis_sentinel_service_name = mymaster {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] cache.redis_server = localhost:6379 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] cache.retry_attempts = 2 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] cache.retry_delay = 0.0 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] cache.socket_keepalive_count = 1 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] cache.socket_keepalive_idle = 1 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] cache.socket_keepalive_interval = 1 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] cache.socket_timeout = 1.0 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] cache.tls_allowed_ciphers = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] cache.tls_cafile = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] cache.tls_certfile = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] cache.tls_enabled = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] cache.tls_keyfile = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] cache.username = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] coordination.backend_url = **** {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] database.asyncio_connection = **** {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] database.asyncio_slave_connection = **** {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] database.backend = sqlalchemy {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] database.connection = **** {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] database.connection_debug = 0 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] database.connection_parameters = {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] database.connection_recycle_time = 3600 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] database.connection_trace = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] database.db_inc_retry_interval = True {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] database.db_max_retries = 20 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] database.db_max_retry_interval = 10 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] database.db_retry_interval = 1 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] database.max_overflow = 50 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] database.max_pool_size = 5 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] database.max_retries = 10 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] database.mysql_wsrep_sync_wait = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] database.pool_timeout = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] database.retry_interval = 10 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] database.slave_connection = **** {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] database.sqlite_synchronous = True {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] database.synchronous_reader = True {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] database.use_db_reconnect = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] oslo_messaging_tracing.insecure = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] profiler.connection_string = messaging:// {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] profiler.enabled = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] profiler.es_doc_type = notification {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] profiler.es_scroll_size = 10000 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] profiler.es_scroll_time = 2m {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] profiler.filter_error_trace = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] profiler.hmac_keys = **** {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] profiler.sentinel_service_name = mymaster {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] profiler.socket_timeout = 0.1 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] profiler.trace_requests = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] profiler.trace_sqlalchemy = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] profiler_jaeger.process_tags = {} {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] profiler_jaeger.service_name_prefix = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] profiler_otlp.service_name_prefix = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] oslo_policy.enforce_new_defaults = True {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] oslo_policy.policy_default_rule = default {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] oslo_policy.policy_file = policy.yaml {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] oslo_policy.remote_timeout = 60.0 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] privsep_osbrick.group = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] privsep_osbrick.helper_command = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] privsep_osbrick.user = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] cinder_sys_admin.group = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] cinder_sys_admin.helper_command = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] cinder_sys_admin.user = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] service_user.auth_section = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] service_user.auth_type = password {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] service_user.cafile = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] service_user.certfile = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] service_user.collect_timing = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] service_user.insecure = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] service_user.keyfile = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] service_user.send_service_user_token = True {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] service_user.split_loggers = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] service_user.timeout = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] service_user.tls_ciphers = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] service_user.tls_min_version = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] glance.auth_section = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] glance.auth_type = password {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] glance.certfile = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] glance.collect_timing = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] glance.insecure = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] glance.keyfile = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] glance.region_name = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] glance.split_loggers = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] glance.timeout = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] glance.tls_ciphers = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] glance.tls_min_version = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.backend_availability_zone = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.chap_password = **** {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.chap_username = {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.disk_geometry = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.driver_client_cert = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.driver_client_cert_key = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.driver_data_namespace = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.driver_use_ssl = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.enable_unsupported_driver = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack quobyte-client[85809]: Reading configuration file: /etc/quobyte/client.cfg Sep 23 00:08:34 devstack quobyte-client[85809]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.extra_capabilities = {} {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.filter_function = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.goodness_function = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.iscsi_target_flags = {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.iscsi_write_cache = on {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85800]: DEBUG oslo_concurrency.processutils [None req-7e672085-8b93-430a-9d28-25844abd3cce None None] CMD "mount.quobyte" returned: 1 in 0.112s {{(pid=85800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:08:34 devstack cinder-volume[85800]: DEBUG oslo_concurrency.lockutils [None req-7e672085-8b93-430a-9d28-25844abd3cce None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85800) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:08:34 devstack cinder-volume[85800]: DEBUG oslo_concurrency.lockutils [None req-7e672085-8b93-430a-9d28-25844abd3cce None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85800) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.iser_helper = tgtadm {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.iser_ip_address = 192.168.122.21 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.iser_port = 3260 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.nas_host = {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.nas_login = admin {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.nas_mount_options = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85800]: DEBUG cinder.volume.drivers.quobyte [None req-7e672085-8b93-430a-9d28-25844abd3cce None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=85800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.nas_password = **** {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.nas_private_key = {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.nas_share_path = {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.nas_ssh_port = 22 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85800]: INFO cinder.volume.drivers.quobyte [None req-7e672085-8b93-430a-9d28-25844abd3cce None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 ... Sep 23 00:08:34 devstack cinder-volume[85800]: DEBUG oslo_concurrency.processutils [None req-7e672085-8b93-430a-9d28-25844abd3cce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 -c /etc/quobyte/client-cinder.cfg {{(pid=85800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.num_shell_tries = 3 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.nvmet_port_id = 1 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.quobyte_client_cfg = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.quobyte_volume_url = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.replication_device = **** {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.report_discard_supported = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.reserved_percentage = 0 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.scst_target_driver = iscsi {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.scst_target_iqn_name = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.storage_protocol = iSCSI {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.target_helper = tgtadm {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.target_ip_address = 192.168.122.21 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.target_port = 3260 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.target_protocol = iscsi {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.trace_flags = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.unique_fqdn_network = True {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.use_chap_auth = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.volume_backend_name = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.volume_clear = zero {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.volume_clear_ionice = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.volume_clear_size = 0 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] oslo_reports.file_event_handler = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] oslo_reports.log_dir = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.backend_availability_zone = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.backend_host = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack sudo[85810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 -c /etc/quobyte/client-cinder.cfg Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.chap_password = **** {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.chap_username = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.chiscsi_conf = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack sudo[85810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.disk_geometry = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.driver_client_cert = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.driver_client_cert_key = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.driver_data_namespace = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.driver_use_ssl = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.extra_capabilities = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.filter_function = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.goodness_function = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.iscsi_target_flags = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.iscsi_write_cache = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.iser_helper = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.iser_ip_address = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.iser_port = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.iser_target_prefix = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.nas_host = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.nas_login = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.nas_mount_options = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.nas_password = **** {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.nas_private_key = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.nas_share_path = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.nas_ssh_port = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.num_shell_tries = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.nvmet_ns_id = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.nvmet_port_id = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.replication_device = **** {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.report_discard_supported = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.reserved_percentage = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.scst_target_driver = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.storage_protocol = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.target_helper = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.target_ip_address = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.target_port = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.target_prefix = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.target_protocol = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.trace_flags = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.unique_fqdn_network = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.use_chap_auth = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.volume_clear = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.volume_clear_ionice = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.volume_clear_size = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] QuobyteHD.volumes_dir = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:34 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] oslo_messaging_rabbit.ssl = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] oslo_messaging_rabbit.ssl_version = {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] oslo_messaging_notifications.driver = [] {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] oslo_messaging_notifications.retry = -1 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] oslo_messaging_notifications.transport_url = **** {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] key_manager.fixed_key = **** {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] barbican.barbican_api_version = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] barbican.barbican_endpoint = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] barbican.barbican_endpoint_type = public {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] barbican.barbican_region_name = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] barbican.cafile = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] barbican.certfile = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] barbican.collect_timing = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] barbican.insecure = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] barbican.keyfile = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] barbican.number_of_retries = 60 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] barbican.retry_delay = 1 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] barbican.send_service_user_token = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] barbican.split_loggers = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] barbican.timeout = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] barbican.tls_ciphers = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] barbican.tls_min_version = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] barbican.verify_ssl = True {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] barbican.verify_ssl_path = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] barbican_service_user.auth_section = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] barbican_service_user.auth_type = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] barbican_service_user.cafile = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] barbican_service_user.certfile = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] barbican_service_user.collect_timing = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] barbican_service_user.insecure = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] barbican_service_user.keyfile = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] barbican_service_user.split_loggers = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] barbican_service_user.timeout = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] barbican_service_user.tls_ciphers = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] barbican_service_user.tls_min_version = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] vault.approle_role_id = **** {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] vault.approle_secret_id = **** {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] vault.auth_method = approle {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] vault.auth_path = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] vault.kv_mountpoint = secret {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] vault.kv_path = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] vault.kv_version = 2 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] vault.namespace = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] vault.root_token_id = **** {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] vault.ssl_ca_crt_file = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] vault.timeout = 60.0 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] vault.token_file = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] vault.token_role = None {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] vault.use_ssl = False {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:35 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] ******************************************************************************** {{(pid=85578) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 23 00:08:35 devstack sudo[85810]: pam_unix(sudo:session): session closed for user root Sep 23 00:08:35 devstack cinder-volume[85800]: DEBUG oslo_concurrency.processutils [None req-7e672085-8b93-430a-9d28-25844abd3cce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.552s {{(pid=85800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:08:35 devstack cinder-volume[85800]: INFO cinder.volume.drivers.quobyte [None req-7e672085-8b93-430a-9d28-25844abd3cce None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 succeeded Sep 23 00:08:35 devstack cinder-volume[85800]: DEBUG cinder.volume.drivers.quobyte [None req-7e672085-8b93-430a-9d28-25844abd3cce None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=85800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:08:35 devstack cinder-volume[85800]: DEBUG oslo_concurrency.lockutils [None req-7e672085-8b93-430a-9d28-25844abd3cce None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.599s {{(pid=85800) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:08:35 devstack cinder-volume[85800]: DEBUG oslo_concurrency.processutils [None req-7e672085-8b93-430a-9d28-25844abd3cce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=85800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:08:35 devstack sudo[85917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:08:35 devstack sudo[85917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:08:35 devstack sudo[85917]: pam_unix(sudo:session): session closed for user root Sep 23 00:08:35 devstack cinder-volume[85800]: DEBUG oslo_concurrency.processutils [None req-7e672085-8b93-430a-9d28-25844abd3cce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.247s {{(pid=85800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:08:35 devstack cinder-volume[85800]: INFO cinder.volume.driver [None req-7e672085-8b93-430a-9d28-25844abd3cce None None] Driver hasn't implemented _init_vendor_properties() Sep 23 00:08:35 devstack cinder-volume[85800]: DEBUG cinder.volume.driver [None req-7e672085-8b93-430a-9d28-25844abd3cce None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5221061706543, 'free_capacity_gb': 1775.5221061706543, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85800) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 23 00:08:35 devstack cinder-volume[85800]: DEBUG oslo_db.sqlalchemy.engines [None req-7e672085-8b93-430a-9d28-25844abd3cce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85800) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:08:35 devstack cinder-volume[85800]: DEBUG dbcounter [-] [85800] Writer thread running {{(pid=85800) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 23 00:08:35 devstack cinder-volume[85800]: DEBUG cinder.db.api [None req-7e672085-8b93-430a-9d28-25844abd3cce None None] Building query based on filter {{(pid=85800) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 23 00:08:35 devstack cinder-volume[85800]: DEBUG cinder.image.image_utils [None req-7e672085-8b93-430a-9d28-25844abd3cce None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85800) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 23 00:08:35 devstack cinder-volume[85800]: INFO cinder.keymgr.migration [None req-44b1ad65-92e8-4f9c-a570-e5fafc4a9cca None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 23 00:08:35 devstack cinder-volume[85800]: DEBUG oslo_concurrency.lockutils [None req-7e672085-8b93-430a-9d28-25844abd3cce None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85800) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:08:35 devstack cinder-volume[85800]: DEBUG oslo_concurrency.lockutils [None req-7e672085-8b93-430a-9d28-25844abd3cce None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85800) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:08:35 devstack cinder-volume[85800]: DEBUG cinder.volume.drivers.quobyte [None req-7e672085-8b93-430a-9d28-25844abd3cce None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=85800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:08:35 devstack cinder-volume[85800]: DEBUG cinder.volume.drivers.quobyte [None req-7e672085-8b93-430a-9d28-25844abd3cce None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=85800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:08:35 devstack cinder-volume[85800]: DEBUG oslo_concurrency.lockutils [None req-7e672085-8b93-430a-9d28-25844abd3cce None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85800) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:08:35 devstack cinder-volume[85800]: DEBUG oslo_concurrency.processutils [None req-7e672085-8b93-430a-9d28-25844abd3cce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=85800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:08:35 devstack sudo[85930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:08:35 devstack sudo[85930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:08:36 devstack sudo[85930]: pam_unix(sudo:session): session closed for user root Sep 23 00:08:36 devstack cinder-volume[85800]: DEBUG oslo_concurrency.processutils [None req-7e672085-8b93-430a-9d28-25844abd3cce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.237s {{(pid=85800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:08:36 devstack cinder-volume[85800]: DEBUG cinder.manager [None req-7e672085-8b93-430a-9d28-25844abd3cce None None] Notifying Schedulers of capabilities ... {{(pid=85800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:08:36 devstack cinder-volume[85800]: INFO cinder.volume.manager [None req-7e672085-8b93-430a-9d28-25844abd3cce None None] Driver initialization completed successfully. Sep 23 00:08:36 devstack cinder-volume[85800]: INFO cinder.manager [None req-7e672085-8b93-430a-9d28-25844abd3cce None None] Initiating service 3 cleanup Sep 23 00:08:36 devstack cinder-volume[85800]: INFO cinder.manager [None req-7e672085-8b93-430a-9d28-25844abd3cce None None] Service 3 cleanup completed. Sep 23 00:08:36 devstack cinder-volume[85800]: DEBUG cinder.service [None req-7e672085-8b93-430a-9d28-25844abd3cce None None] Creating RPC server for service cinder-volume {{(pid=85800) start /opt/stack/cinder/cinder/service.py:231}} Sep 23 00:08:36 devstack cinder-volume[85800]: DEBUG cinder.service [None req-7e672085-8b93-430a-9d28-25844abd3cce None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85800) start /opt/stack/cinder/cinder/service.py:237}} Sep 23 00:08:36 devstack cinder-volume[85800]: INFO cinder.volume.manager [None req-7e672085-8b93-430a-9d28-25844abd3cce None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 23 00:08:36 devstack cinder-volume[85800]: DEBUG oslo_concurrency.lockutils [None req-7e672085-8b93-430a-9d28-25844abd3cce None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85800) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:08:36 devstack cinder-volume[85800]: DEBUG oslo_concurrency.lockutils [None req-7e672085-8b93-430a-9d28-25844abd3cce None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85800) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:08:36 devstack cinder-volume[85800]: DEBUG cinder.volume.drivers.quobyte [None req-7e672085-8b93-430a-9d28-25844abd3cce None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=85800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:08:36 devstack cinder-volume[85800]: DEBUG cinder.volume.drivers.quobyte [None req-7e672085-8b93-430a-9d28-25844abd3cce None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=85800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:08:36 devstack cinder-volume[85800]: DEBUG oslo_concurrency.lockutils [None req-7e672085-8b93-430a-9d28-25844abd3cce None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85800) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:08:36 devstack cinder-volume[85800]: DEBUG oslo_concurrency.processutils [None req-7e672085-8b93-430a-9d28-25844abd3cce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=85800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:08:36 devstack sudo[85941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:08:36 devstack sudo[85941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:08:36 devstack sudo[85941]: pam_unix(sudo:session): session closed for user root Sep 23 00:08:36 devstack cinder-volume[85800]: DEBUG oslo_concurrency.processutils [None req-7e672085-8b93-430a-9d28-25844abd3cce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.273s {{(pid=85800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:08:36 devstack cinder-volume[85800]: INFO cinder.volume.manager [None req-7e672085-8b93-430a-9d28-25844abd3cce None None] Driver post RPC initialization completed successfully. Sep 23 00:08:41 devstack cinder-volume[85800]: DEBUG oslo_concurrency.lockutils [None req-5651c252-19cc-4fc9-8037-d0df0347ae5f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85800) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:08:41 devstack cinder-volume[85800]: DEBUG oslo_concurrency.lockutils [None req-5651c252-19cc-4fc9-8037-d0df0347ae5f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85800) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:08:41 devstack cinder-volume[85800]: DEBUG cinder.volume.drivers.quobyte [None req-5651c252-19cc-4fc9-8037-d0df0347ae5f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=85800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:08:41 devstack cinder-volume[85800]: DEBUG cinder.volume.drivers.quobyte [None req-5651c252-19cc-4fc9-8037-d0df0347ae5f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=85800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:08:41 devstack cinder-volume[85800]: DEBUG oslo_concurrency.lockutils [None req-5651c252-19cc-4fc9-8037-d0df0347ae5f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85800) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:08:41 devstack cinder-volume[85800]: DEBUG oslo_concurrency.processutils [None req-5651c252-19cc-4fc9-8037-d0df0347ae5f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=85800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:08:41 devstack sudo[86138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:08:41 devstack sudo[86138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:08:41 devstack sudo[86138]: pam_unix(sudo:session): session closed for user root Sep 23 00:08:41 devstack cinder-volume[85800]: DEBUG oslo_concurrency.processutils [None req-5651c252-19cc-4fc9-8037-d0df0347ae5f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.271s {{(pid=85800) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:08:41 devstack cinder-volume[85800]: DEBUG cinder.manager [None req-5651c252-19cc-4fc9-8037-d0df0347ae5f None None] Notifying Schedulers of capabilities ... {{(pid=85800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:08:44 devstack cinder-volume[85578]: DEBUG dbcounter [-] [85578] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=85578) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:08:44 devstack cinder-volume[85578]: INFO oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] Caught SIGTERM, stopping children Sep 23 00:08:44 devstack cinder-volume[85578]: DEBUG oslo_concurrency.lockutils [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] Acquiring lock "singleton_lock" {{(pid=85578) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 23 00:08:44 devstack cinder-volume[85578]: DEBUG oslo_concurrency.lockutils [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] Acquired lock "singleton_lock" {{(pid=85578) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 23 00:08:44 devstack cinder-volume[85578]: DEBUG oslo_concurrency.lockutils [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] Releasing lock "singleton_lock" {{(pid=85578) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 23 00:08:44 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] Stop services. {{(pid=85578) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 23 00:08:44 devstack cinder-volume[85578]: DEBUG oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] Killing children. {{(pid=85578) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 23 00:08:44 devstack cinder-volume[85578]: INFO oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] Waiting on 1 children to exit Sep 23 00:08:46 devstack cinder-volume[85800]: DEBUG dbcounter [-] [85800] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=85800) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:08:46 devstack cinder-volume[85800]: DEBUG dbcounter [-] [85800] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=85800) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:08:49 devstack cinder-volume[85800]: DEBUG oslo_concurrency.lockutils [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] Acquiring lock "singleton_lock" {{(pid=85800) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 23 00:08:49 devstack cinder-volume[85800]: DEBUG oslo_concurrency.lockutils [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] Acquired lock "singleton_lock" {{(pid=85800) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 23 00:08:49 devstack cinder-volume[85800]: DEBUG oslo_concurrency.lockutils [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] Releasing lock "singleton_lock" {{(pid=85800) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 23 00:08:49 devstack cinder-volume[85800]: WARNING amqp [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 23 00:08:49 devstack cinder-volume[85800]: WARNING amqp [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 23 00:08:49 devstack cinder-volume[85578]: INFO oslo_service.backend._eventlet.service [None req-af303f64-01a7-4917-bf22-fc47d3c86b9c None None] Child 85800 exited with status 0 Sep 23 00:08:50 devstack cinder-volume[86336]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 23 00:08:50 devstack cinder-volume[86336]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 23 00:08:50 devstack cinder-volume[86336]: we strongly recommend against using it for new projects. Sep 23 00:08:50 devstack cinder-volume[86336]: If you are already using Eventlet, we recommend migrating to a different Sep 23 00:08:50 devstack cinder-volume[86336]: framework. For more detail see Sep 23 00:08:50 devstack cinder-volume[86336]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 23 00:08:50 devstack cinder-volume[86336]: import eventlet # noqa Sep 23 00:08:53 devstack cinder-volume[86336]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86336) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 23 00:08:53 devstack cinder-volume[86336]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86336) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 23 00:08:53 devstack cinder-volume[86336]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86336) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 23 00:08:53 devstack cinder-volume[86336]: INFO dbcounter [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] Registered counter for database cinder Sep 23 00:08:53 devstack cinder-volume[86336]: DEBUG oslo_db.sqlalchemy.engines [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86336) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG dbcounter [-] [86336] Writer thread running {{(pid=86336) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 23 00:08:54 devstack cinder-volume[86336]: INFO cinder.rpc [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 23 00:08:54 devstack cinder-volume[86336]: INFO cinder.rpc [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_db.sqlalchemy.engines [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86336) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:08:54 devstack cinder-volume[86336]: INFO cinder.volume.manager [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] Determined volume DB was empty at startup. Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG cinder.volume.manager [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86336) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 23 00:08:54 devstack cinder-volume[86336]: WARNING stevedore.named [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 23 00:08:54 devstack cinder-volume[86336]: WARNING castellan.key_manager [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 23 00:08:54 devstack cinder-volume[86336]: WARNING cinder.keymgr.conf_key_mgr [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 23 00:08:54 devstack cinder-volume[86336]: INFO cinder.volume.manager [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_db.sqlalchemy.engines [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86336) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:08:54 devstack cinder-volume[86336]: INFO oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] Starting 1 workers Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] Started child 86591 {{(pid=86336) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] Full set of CONF: {{(pid=86336) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] ******************************************************************************** {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] Configuration options gathered from: {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] ================================================================================ {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] allow_availability_zone_fallback = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] allow_compression_on_image_upload = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] allowed_direct_url_schemes = [] {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] api_rate_limit = True {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] auth_strategy = keystone {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_availability_zone = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_host = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_name = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_stats_polling_interval = 60 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backup_api_class = cinder.backup.api.API {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backup_name_template = backup-%s {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backup_use_same_host = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backup_use_temp_snapshot = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] chap_password = **** {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86591]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] chap_username = {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] cinder_internal_tenant_project_id = a72d187c2a984c1babeaae38bb5ad275 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] cinder_internal_tenant_user_id = b10d8019a19e46299f68101cef3e3ce4 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] cluster = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] compression_format = gzip {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] compute_api_class = cinder.compute.nova.API {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] config_dir = [] {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] config_source = [] {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] control_exchange = openstack {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] debug = True {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] default_availability_zone = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] default_group_type = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] default_volume_type = QuobyteHD {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] deployment_max_gigabytes = -1 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] disk_geometry = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] driver_client_cert = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] driver_client_cert_key = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] driver_data_namespace = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] driver_ssl_cert_path = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] driver_ssl_cert_verify = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] driver_use_ssl = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] enable_new_services = True {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] enable_unsupported_driver = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] enabled_backends = ['QuobyteHD'] {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] enforce_multipath_for_image_xfer = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] filter_function = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] glance_api_insecure = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] glance_api_servers = ['http://192.168.122.21/image'] {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] glance_api_ssl_compression = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] glance_ca_certificates_file = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] glance_catalog_info = image:glance:publicURL {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] glance_certfile = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] glance_keyfile = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] glance_num_retries = 3 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] glance_request_timeout = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] goodness_function = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] graceful_shutdown_timeout = 5 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] group_api_class = cinder.group.api.API {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] host = devstack {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] image_compress_on_upload = True {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] image_conversion_address_space_limit = 1 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] image_conversion_cpu_limit = 60 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] image_conversion_disable = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] image_introspection_address_space_limit = 1 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] image_introspection_cpu_limit = 60 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] image_upload_use_cinder_backend = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] image_upload_use_internal_tenant = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] image_volume_cache_enabled = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] image_volume_cache_max_count = 0 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] image_volume_cache_max_size_gb = 0 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] init_host_max_objects_retrieval = 0 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] instance_format = [instance: %(uuid)s] {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] iscsi_target_flags = {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] iscsi_write_cache = on {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] iser_helper = tgtadm {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] iser_ip_address = 192.168.122.21 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] iser_port = 3260 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] log_color = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] log_config_append = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] log_dir = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] log_file = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] log_options = True {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] log_rotate_interval = 1 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] log_rotate_interval_type = days {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] log_rotation_type = none {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] max_age = 0 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] max_logfile_count = 30 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-572582e4-0585-4fc7-90fb-590e25383bec None None] Starting volume driver QuobyteDriver (1.2.1) Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] max_logfile_size_mb = 200 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-572582e4-0585-4fc7-90fb-590e25383bec None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86591) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] max_over_subscription_ratio = 20.0 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] message_reap_interval = 86400 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] message_ttl = 2592000 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] migration_create_volume_timeout_secs = 300 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] monkey_patch = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] monkey_patch_modules = [] {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] my_ip = 192.168.122.21 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] no_snapshot_gb_quota = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] num_iser_scan_tries = 3 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] num_shell_tries = 3 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] num_volume_device_scan_tries = 3 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] nvmeof_conn_info_version = 1 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] nvmet_ns_id = 10 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] nvmet_port_id = 1 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] osapi_max_limit = 1000 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] osapi_volume_ext_list = [] {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] osapi_volume_listen_port = 8776 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] osapi_volume_use_ssl = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] osapi_volume_workers = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] per_volume_size_limit = -1 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] periodic_fuzzy_delay = 60 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] periodic_interval = 60 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] public_endpoint = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] publish_errors = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] quota_backup_gigabytes = 1000 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] quota_backups = 10 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] quota_gigabytes = 1000 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] quota_groups = 10 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] quota_snapshots = 10 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] quota_volumes = 10 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] rate_limit_burst = 0 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] rate_limit_except_level = CRITICAL {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] rate_limit_interval = 0 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] reinit_driver_count = 3 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] replication_device = **** {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] report_discard_supported = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] report_interval = 120 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] reservation_clean_interval = 86400 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] reservation_expire = 86400 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] reserved_image_namespaces = [] {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] reserved_percentage = 0 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] rpc_response_timeout = 120 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] run_external_periodic_tasks = True {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] scst_target_driver = iscsi {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] scst_target_iqn_name = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] service_down_time = 720 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] shell_completion = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] snapshot_name_template = snapshot-%s {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] split_loggers = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] state_path = /opt/stack/data/cinder {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] storage_availability_zone = nova {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] storage_protocol = iSCSI {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] syslog_log_facility = LOG_USER {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] target_helper = lioadm {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] target_ip_address = 192.168.122.21 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] target_port = 3260 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] target_protocol = iscsi {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] target_secondary_ip_addresses = [] {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] trace_flags = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] transport_url = **** {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] until_refresh = 0 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] use_chap_auth = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] use_default_quota_class = True {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] use_journal = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] use_json = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] use_multipath_for_image_xfer = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] use_stderr = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] use_syslog = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] verify_glance_signatures = enabled {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] volume_api_class = cinder.volume.api.API {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] volume_backend_name = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] volume_clear = zero {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] volume_clear_ionice = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] volume_clear_size = 0 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] volume_copy_bps_limit = 0 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] volume_dd_blocksize = 1M {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] volume_name_template = volume-%s {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] volume_service_inithost_offload = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] volume_usage_audit_period = month {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] zoning_mode = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] oslo_concurrency.disable_process_locking = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] keystone_authtoken.auth_section = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] keystone_authtoken.auth_type = password {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] keystone_authtoken.auth_version = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] keystone_authtoken.cache = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] keystone_authtoken.certfile = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] keystone_authtoken.include_service_catalog = True {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] keystone_authtoken.insecure = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] keystone_authtoken.interface = public {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] keystone_authtoken.keyfile = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] keystone_authtoken.memcache_password = **** {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] keystone_authtoken.memcache_username = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] keystone_authtoken.region_name = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] keystone_authtoken.service_type = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.21/identity {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] cache.backend = dogpile.cache.null {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] cache.backend_argument = **** {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] cache.backend_expiration_time = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] cache.config_prefix = cache.oslo {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] cache.debug_cache_backend = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] cache.enable_retry_client = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] cache.enable_socket_keepalive = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] cache.enabled = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] cache.expiration_time = 600 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] cache.hashclient_retry_attempts = 2 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] cache.memcache_dead_retry = 300 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] cache.memcache_pool_maxsize = 10 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] cache.memcache_sasl_enabled = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] cache.password = **** {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-572582e4-0585-4fc7-90fb-590e25383bec None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86591) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] cache.proxies = [] {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] cache.redis_db = 0 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.quobyte [None req-572582e4-0585-4fc7-90fb-590e25383bec None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.quobyte [None req-572582e4-0585-4fc7-90fb-590e25383bec None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] cache.redis_server = localhost:6379 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] cache.retry_attempts = 2 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] cache.retry_delay = 0.0 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] cache.socket_keepalive_count = 1 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-572582e4-0585-4fc7-90fb-590e25383bec None None] Running cmd (subprocess): mount.quobyte {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] cache.socket_keepalive_idle = 1 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] cache.socket_keepalive_interval = 1 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] cache.socket_timeout = 1.0 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] cache.tls_allowed_ciphers = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] cache.tls_cafile = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] cache.tls_certfile = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] cache.tls_enabled = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] cache.tls_keyfile = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] cache.username = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] coordination.backend_url = **** {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] database.asyncio_connection = **** {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] database.asyncio_slave_connection = **** {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] database.backend = sqlalchemy {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] database.connection = **** {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] database.connection_debug = 0 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] database.connection_parameters = {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] database.connection_recycle_time = 3600 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] database.connection_trace = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] database.db_inc_retry_interval = True {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] database.db_max_retries = 20 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] database.db_max_retry_interval = 10 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] database.db_retry_interval = 1 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] database.max_overflow = 50 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] database.max_pool_size = 5 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] database.max_retries = 10 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] database.mysql_wsrep_sync_wait = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] database.pool_timeout = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] database.retry_interval = 10 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] database.slave_connection = **** {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] database.sqlite_synchronous = True {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] database.synchronous_reader = True {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] database.use_db_reconnect = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] oslo_messaging_tracing.insecure = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] profiler.connection_string = messaging:// {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] profiler.enabled = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] profiler.es_doc_type = notification {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] profiler.es_scroll_size = 10000 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] profiler.es_scroll_time = 2m {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] profiler.filter_error_trace = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] profiler.hmac_keys = **** {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] profiler.sentinel_service_name = mymaster {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] profiler.socket_timeout = 0.1 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] profiler.trace_requests = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] profiler.trace_sqlalchemy = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] profiler_jaeger.process_tags = {} {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] profiler_jaeger.service_name_prefix = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] profiler_otlp.service_name_prefix = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] oslo_policy.enforce_new_defaults = True {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] oslo_policy.policy_default_rule = default {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] oslo_policy.policy_file = policy.yaml {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] privsep_osbrick.group = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] privsep_osbrick.helper_command = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] privsep_osbrick.user = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] cinder_sys_admin.group = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] cinder_sys_admin.helper_command = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] cinder_sys_admin.user = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] service_user.auth_section = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] service_user.auth_type = password {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] service_user.cafile = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] service_user.certfile = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] service_user.collect_timing = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] service_user.insecure = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] service_user.keyfile = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] service_user.send_service_user_token = True {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] service_user.split_loggers = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] service_user.timeout = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] service_user.tls_ciphers = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] service_user.tls_min_version = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] glance.auth_section = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] glance.auth_type = password {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] glance.certfile = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] glance.collect_timing = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] glance.insecure = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] glance.keyfile = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] glance.region_name = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] glance.split_loggers = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] glance.timeout = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] glance.tls_ciphers = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] glance.tls_min_version = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.backend_availability_zone = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.chap_password = **** {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.chap_username = {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.disk_geometry = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.driver_client_cert = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.driver_client_cert_key = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.driver_data_namespace = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.driver_use_ssl = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.extra_capabilities = {} {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.filter_function = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.goodness_function = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.iscsi_target_flags = {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.iscsi_write_cache = on {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.iser_helper = tgtadm {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.iser_ip_address = 192.168.122.21 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.iser_port = 3260 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.nas_host = {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.nas_login = admin {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.nas_mount_options = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.nas_password = **** {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.nas_private_key = {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.nas_share_path = {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.num_shell_tries = 3 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack quobyte-client[86592]: Reading configuration file: /etc/quobyte/client.cfg Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack quobyte-client[86592]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.quobyte_volume_url = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.replication_device = **** {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.report_discard_supported = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.reserved_percentage = 0 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-572582e4-0585-4fc7-90fb-590e25383bec None None] CMD "mount.quobyte" returned: 1 in 0.053s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-572582e4-0585-4fc7-90fb-590e25383bec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-572582e4-0585-4fc7-90fb-590e25383bec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.target_helper = tgtadm {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-572582e4-0585-4fc7-90fb-590e25383bec None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.target_ip_address = 192.168.122.21 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.target_port = 3260 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.target_protocol = iscsi {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.trace_flags = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.unique_fqdn_network = True {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.use_chap_auth = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.volume_backend_name = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.volume_clear = zero {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.volume_clear_ionice = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.volume_clear_size = 0 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] oslo_reports.file_event_handler = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] oslo_reports.log_dir = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.backend_availability_zone = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.backend_host = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.chap_password = **** {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.chap_username = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.chiscsi_conf = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.disk_geometry = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-572582e4-0585-4fc7-90fb-590e25383bec None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.driver_client_cert = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-572582e4-0585-4fc7-90fb-590e25383bec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.driver_data_namespace = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-572582e4-0585-4fc7-90fb-590e25383bec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.driver_use_ssl = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.extra_capabilities = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.filter_function = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.goodness_function = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.iser_helper = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.iser_ip_address = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.iser_port = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.iser_target_prefix = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.nas_host = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.nas_login = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.nas_mount_options = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.nas_password = **** {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.nas_private_key = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.nas_share_path = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.nas_ssh_port = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.num_shell_tries = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.nvmet_port_id = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.replication_device = **** {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.report_discard_supported = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.reserved_percentage = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.scst_target_driver = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.storage_protocol = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.target_helper = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.target_ip_address = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.target_port = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.target_prefix = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.target_protocol = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.trace_flags = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.use_chap_auth = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.volume_clear = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack sudo[86593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.volume_clear_size = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack sudo[86593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] QuobyteHD.volumes_dir = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] oslo_messaging_rabbit.ssl = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] oslo_messaging_notifications.driver = [] {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] oslo_messaging_notifications.retry = -1 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] key_manager.fixed_key = **** {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] barbican.barbican_api_version = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] barbican.barbican_endpoint = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] barbican.barbican_endpoint_type = public {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] barbican.barbican_region_name = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] barbican.cafile = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] barbican.certfile = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] barbican.collect_timing = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] barbican.insecure = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] barbican.keyfile = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] barbican.number_of_retries = 60 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] barbican.retry_delay = 1 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] barbican.send_service_user_token = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] barbican.split_loggers = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] barbican.timeout = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] barbican.tls_ciphers = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] barbican.tls_min_version = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] barbican.verify_ssl = True {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] barbican.verify_ssl_path = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] barbican_service_user.auth_section = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] barbican_service_user.auth_type = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] barbican_service_user.cafile = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] barbican_service_user.certfile = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] barbican_service_user.collect_timing = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] barbican_service_user.insecure = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] barbican_service_user.keyfile = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] barbican_service_user.split_loggers = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] barbican_service_user.timeout = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] barbican_service_user.tls_ciphers = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] barbican_service_user.tls_min_version = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] vault.approle_role_id = **** {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] vault.approle_secret_id = **** {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] vault.auth_method = approle {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] vault.auth_path = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] vault.kv_mountpoint = secret {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] vault.kv_path = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] vault.kv_version = 2 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] vault.namespace = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] vault.root_token_id = **** {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] vault.ssl_ca_crt_file = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] vault.timeout = 60.0 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] vault.token_file = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] vault.token_role = None {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] vault.use_ssl = False {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:54 devstack cinder-volume[86336]: DEBUG oslo_service.backend._eventlet.service [None req-86f493a3-b41b-4d41-b4d9-fbce07216a69 None None] ******************************************************************************** {{(pid=86336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 23 00:08:54 devstack sudo[86593]: pam_unix(sudo:session): session closed for user root Sep 23 00:08:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-572582e4-0585-4fc7-90fb-590e25383bec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.238s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:08:54 devstack cinder-volume[86591]: INFO cinder.volume.driver [None req-572582e4-0585-4fc7-90fb-590e25383bec None None] Driver hasn't implemented _init_vendor_properties() Sep 23 00:08:54 devstack cinder-volume[86591]: DEBUG cinder.volume.driver [None req-572582e4-0585-4fc7-90fb-590e25383bec None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5221061706543, 'free_capacity_gb': 1775.5221061706543, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86591) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 23 00:08:54 devstack cinder-volume[86591]: DEBUG oslo_db.sqlalchemy.engines [None req-572582e4-0585-4fc7-90fb-590e25383bec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86591) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:08:54 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writer thread running {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 23 00:08:54 devstack cinder-volume[86591]: DEBUG cinder.db.api [None req-572582e4-0585-4fc7-90fb-590e25383bec None None] Building query based on filter {{(pid=86591) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 23 00:08:54 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-572582e4-0585-4fc7-90fb-590e25383bec None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86591) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 23 00:08:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-572582e4-0585-4fc7-90fb-590e25383bec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:08:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-572582e4-0585-4fc7-90fb-590e25383bec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:08:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-572582e4-0585-4fc7-90fb-590e25383bec None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:08:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-572582e4-0585-4fc7-90fb-590e25383bec None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:08:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-572582e4-0585-4fc7-90fb-590e25383bec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:08:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-572582e4-0585-4fc7-90fb-590e25383bec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:08:54 devstack cinder-volume[86591]: INFO cinder.keymgr.migration [None req-30be07a7-505f-43da-adb0-ccd53aaecf88 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 23 00:08:54 devstack sudo[86596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:08:54 devstack sudo[86596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:08:55 devstack sudo[86596]: pam_unix(sudo:session): session closed for user root Sep 23 00:08:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-572582e4-0585-4fc7-90fb-590e25383bec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.255s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:08:55 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-572582e4-0585-4fc7-90fb-590e25383bec None None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:08:55 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-572582e4-0585-4fc7-90fb-590e25383bec None None] Driver initialization completed successfully. Sep 23 00:08:55 devstack cinder-volume[86591]: INFO cinder.manager [None req-572582e4-0585-4fc7-90fb-590e25383bec None None] Initiating service 3 cleanup Sep 23 00:08:55 devstack cinder-volume[86591]: INFO cinder.manager [None req-572582e4-0585-4fc7-90fb-590e25383bec None None] Service 3 cleanup completed. Sep 23 00:08:55 devstack cinder-volume[86591]: DEBUG cinder.service [None req-572582e4-0585-4fc7-90fb-590e25383bec None None] Creating RPC server for service cinder-volume {{(pid=86591) start /opt/stack/cinder/cinder/service.py:231}} Sep 23 00:08:55 devstack cinder-volume[86591]: DEBUG cinder.service [None req-572582e4-0585-4fc7-90fb-590e25383bec None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86591) start /opt/stack/cinder/cinder/service.py:237}} Sep 23 00:08:55 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-572582e4-0585-4fc7-90fb-590e25383bec None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 23 00:08:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-572582e4-0585-4fc7-90fb-590e25383bec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:08:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-572582e4-0585-4fc7-90fb-590e25383bec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:08:55 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-572582e4-0585-4fc7-90fb-590e25383bec None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:08:55 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-572582e4-0585-4fc7-90fb-590e25383bec None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:08:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-572582e4-0585-4fc7-90fb-590e25383bec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:08:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-572582e4-0585-4fc7-90fb-590e25383bec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:08:55 devstack sudo[86662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:08:55 devstack sudo[86662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:08:55 devstack sudo[86662]: pam_unix(sudo:session): session closed for user root Sep 23 00:08:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-572582e4-0585-4fc7-90fb-590e25383bec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.242s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:08:55 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-572582e4-0585-4fc7-90fb-590e25383bec None None] Driver post RPC initialization completed successfully. Sep 23 00:09:04 devstack cinder-volume[86336]: DEBUG dbcounter [-] [86336] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86336) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:09:05 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:09:05 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=3 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:09:16 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running periodic task VolumeManager._thread_info {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:09:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] thread count: 6 {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:09:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] thread info: [<_MainThread(MainThread, started 135440660459648)>, , , , , ] {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:10:03 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-9835f276-e093-4167-8771-7d2d194295a3 tempest-VolumeQuotasAdminTestJSON-1604054035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:10:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9835f276-e093-4167-8771-7d2d194295a3 tempest-VolumeQuotasAdminTestJSON-1604054035 None] Flow 'volume_create_manager' (41baf373-e732-42bf-a64f-aa48a571b47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:10:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9835f276-e093-4167-8771-7d2d194295a3 tempest-VolumeQuotasAdminTestJSON-1604054035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23f6c4e0-bdbc-425e-adce-c34f68c37602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9835f276-e093-4167-8771-7d2d194295a3 tempest-VolumeQuotasAdminTestJSON-1604054035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23f6c4e0-bdbc-425e-adce-c34f68c37602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:10:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-41059598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bad0c66b-4109-4aa6-a73c-21eb9a76aec9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03c0a007ceee47cebdf1c89373c4aaa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:10:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:10:04Z,use_quota=True,user_id='5208300bfaf046c6ae6662bcda8b076d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9835f276-e093-4167-8771-7d2d194295a3 tempest-VolumeQuotasAdminTestJSON-1604054035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (499f47a5-c7f9-4abd-924b-1d2154aa6211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9835f276-e093-4167-8771-7d2d194295a3 tempest-VolumeQuotasAdminTestJSON-1604054035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (499f47a5-c7f9-4abd-924b-1d2154aa6211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9835f276-e093-4167-8771-7d2d194295a3 tempest-VolumeQuotasAdminTestJSON-1604054035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0daf3cee-499e-4bf8-97e3-4089896379b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9835f276-e093-4167-8771-7d2d194295a3 tempest-VolumeQuotasAdminTestJSON-1604054035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0daf3cee-499e-4bf8-97e3-4089896379b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bad0c66b-4109-4aa6-a73c-21eb9a76aec9', 'volume_name': 'volume-bad0c66b-4109-4aa6-a73c-21eb9a76aec9', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9835f276-e093-4167-8771-7d2d194295a3 tempest-VolumeQuotasAdminTestJSON-1604054035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (012c37ff-9212-4727-b6a7-5a16c9bac07c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9835f276-e093-4167-8771-7d2d194295a3 tempest-VolumeQuotasAdminTestJSON-1604054035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (012c37ff-9212-4727-b6a7-5a16c9bac07c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9835f276-e093-4167-8771-7d2d194295a3 tempest-VolumeQuotasAdminTestJSON-1604054035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4561585-7fda-4944-acb6-02a221036189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:04 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-9835f276-e093-4167-8771-7d2d194295a3 tempest-VolumeQuotasAdminTestJSON-1604054035 None] Volume bad0c66b-4109-4aa6-a73c-21eb9a76aec9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bad0c66b-4109-4aa6-a73c-21eb9a76aec9', 'volume_size': 1} Sep 23 00:10:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9835f276-e093-4167-8771-7d2d194295a3 tempest-VolumeQuotasAdminTestJSON-1604054035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:10:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9835f276-e093-4167-8771-7d2d194295a3 tempest-VolumeQuotasAdminTestJSON-1604054035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:10:04 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9835f276-e093-4167-8771-7d2d194295a3 tempest-VolumeQuotasAdminTestJSON-1604054035 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:10:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-41059598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bad0c66b-4109-4aa6-a73c-21eb9a76aec9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03c0a007ceee47cebdf1c89373c4aaa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:10:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:10:04Z,use_quota=True,user_id='5208300bfaf046c6ae6662bcda8b076d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:10:04 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-9835f276-e093-4167-8771-7d2d194295a3 tempest-VolumeQuotasAdminTestJSON-1604054035 None] Creating volume bad0c66b-4109-4aa6-a73c-21eb9a76aec9 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:10:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9835f276-e093-4167-8771-7d2d194295a3 tempest-VolumeQuotasAdminTestJSON-1604054035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:10:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9835f276-e093-4167-8771-7d2d194295a3 tempest-VolumeQuotasAdminTestJSON-1604054035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:10:04 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9835f276-e093-4167-8771-7d2d194295a3 tempest-VolumeQuotasAdminTestJSON-1604054035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:10:04 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9835f276-e093-4167-8771-7d2d194295a3 tempest-VolumeQuotasAdminTestJSON-1604054035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:10:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9835f276-e093-4167-8771-7d2d194295a3 tempest-VolumeQuotasAdminTestJSON-1604054035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:10:04 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9835f276-e093-4167-8771-7d2d194295a3 tempest-VolumeQuotasAdminTestJSON-1604054035 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:10:04 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-9835f276-e093-4167-8771-7d2d194295a3 tempest-VolumeQuotasAdminTestJSON-1604054035 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:10:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9835f276-e093-4167-8771-7d2d194295a3 tempest-VolumeQuotasAdminTestJSON-1604054035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-bad0c66b-4109-4aa6-a73c-21eb9a76aec9 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:04 devstack sudo[87356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-bad0c66b-4109-4aa6-a73c-21eb9a76aec9 1073741824 Sep 23 00:10:04 devstack sudo[87356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:05 devstack sudo[87356]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9835f276-e093-4167-8771-7d2d194295a3 tempest-VolumeQuotasAdminTestJSON-1604054035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-bad0c66b-4109-4aa6-a73c-21eb9a76aec9 1073741824" returned: 0 in 1.092s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9835f276-e093-4167-8771-7d2d194295a3 tempest-VolumeQuotasAdminTestJSON-1604054035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-bad0c66b-4109-4aa6-a73c-21eb9a76aec9 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:05 devstack sudo[87699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-bad0c66b-4109-4aa6-a73c-21eb9a76aec9 Sep 23 00:10:05 devstack sudo[87699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:05 devstack sudo[87699]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9835f276-e093-4167-8771-7d2d194295a3 tempest-VolumeQuotasAdminTestJSON-1604054035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-bad0c66b-4109-4aa6-a73c-21eb9a76aec9" returned: 0 in 0.372s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:05 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9835f276-e093-4167-8771-7d2d194295a3 tempest-VolumeQuotasAdminTestJSON-1604054035 None] <== create_volume: return (1614ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:10:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9835f276-e093-4167-8771-7d2d194295a3 tempest-VolumeQuotasAdminTestJSON-1604054035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.623s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:10:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9835f276-e093-4167-8771-7d2d194295a3 tempest-VolumeQuotasAdminTestJSON-1604054035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4561585-7fda-4944-acb6-02a221036189) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bad0c66b-4109-4aa6-a73c-21eb9a76aec9', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9835f276-e093-4167-8771-7d2d194295a3 tempest-VolumeQuotasAdminTestJSON-1604054035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07fd52a0-5af0-449d-aa26-20d0c13fa76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:05 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-9835f276-e093-4167-8771-7d2d194295a3 tempest-VolumeQuotasAdminTestJSON-1604054035 None] Volume volume-bad0c66b-4109-4aa6-a73c-21eb9a76aec9 (bad0c66b-4109-4aa6-a73c-21eb9a76aec9): created successfully Sep 23 00:10:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9835f276-e093-4167-8771-7d2d194295a3 tempest-VolumeQuotasAdminTestJSON-1604054035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07fd52a0-5af0-449d-aa26-20d0c13fa76e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9835f276-e093-4167-8771-7d2d194295a3 tempest-VolumeQuotasAdminTestJSON-1604054035 None] Flow 'volume_create_manager' (41baf373-e732-42bf-a64f-aa48a571b47d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:10:06 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-9835f276-e093-4167-8771-7d2d194295a3 tempest-VolumeQuotasAdminTestJSON-1604054035 None] Created volume successfully. Sep 23 00:10:07 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-552fc9b5-53ad-4168-a283-09d77aeaf16b tempest-VolumeQuotasAdminTestJSON-1604054035 None] Acquiring lock "cinder-bad0c66b-4109-4aa6-a73c-21eb9a76aec9-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:10:07 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-552fc9b5-53ad-4168-a283-09d77aeaf16b tempest-VolumeQuotasAdminTestJSON-1604054035 None] Lock "cinder-bad0c66b-4109-4aa6-a73c-21eb9a76aec9-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:10:07 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-552fc9b5-53ad-4168-a283-09d77aeaf16b tempest-VolumeQuotasAdminTestJSON-1604054035 None] Acquiring lock "cinder-quobyte-bad0c66b-4109-4aa6-a73c-21eb9a76aec9" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:10:07 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-552fc9b5-53ad-4168-a283-09d77aeaf16b tempest-VolumeQuotasAdminTestJSON-1604054035 None] Lock "cinder-quobyte-bad0c66b-4109-4aa6-a73c-21eb9a76aec9" acquired by "delete_volume" :: waited 0.037s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:10:07 devstack cinder-volume[86591]: INFO oslo.privsep.daemon [None req-552fc9b5-53ad-4168-a283-09d77aeaf16b tempest-VolumeQuotasAdminTestJSON-1604054035 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp22qhg2jp/privsep.sock'] Sep 23 00:10:07 devstack sudo[87749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp22qhg2jp/privsep.sock Sep 23 00:10:07 devstack sudo[87749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:09 devstack cinder-volume[86591]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 23 00:10:09 devstack cinder-volume[86591]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 23 00:10:09 devstack cinder-volume[86591]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 23 00:10:09 devstack cinder-volume[86591]: WARNING oslo.privsep.daemon [-] privsep log: Sep 23 00:10:09 devstack cinder-volume[86591]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 23 00:10:09 devstack cinder-volume[86591]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 23 00:10:09 devstack cinder-volume[86591]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 23 00:10:09 devstack cinder-volume[86591]: WARNING oslo.privsep.daemon [-] privsep log: Sep 23 00:10:09 devstack cinder-volume[86591]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 23 00:10:10 devstack sudo[87749]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:10 devstack cinder-volume[86591]: INFO oslo.privsep.daemon [None req-552fc9b5-53ad-4168-a283-09d77aeaf16b tempest-VolumeQuotasAdminTestJSON-1604054035 None] Spawned new privsep daemon via rootwrap Sep 23 00:10:10 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [None req-552fc9b5-53ad-4168-a283-09d77aeaf16b tempest-VolumeQuotasAdminTestJSON-1604054035 None] Accepted privsep connection to /tmp/tmp22qhg2jp/privsep.sock {{(pid=86591) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 23 00:10:10 devstack cinder-volume[86591]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 23 00:10:10 devstack cinder-volume[86591]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 23 00:10:10 devstack cinder-volume[86591]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 23 00:10:10 devstack cinder-volume[86591]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87822 Sep 23 00:10:10 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ddd242-b6ef-4469-b58d-95f3e177dd2a]: (2,) {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:10:10 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[777863fa-4134-47c2-85d3-e5226e14b5a0]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:10:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-552fc9b5-53ad-4168-a283-09d77aeaf16b tempest-VolumeQuotasAdminTestJSON-1604054035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-bad0c66b-4109-4aa6-a73c-21eb9a76aec9 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:11 devstack sudo[87847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-bad0c66b-4109-4aa6-a73c-21eb9a76aec9 Sep 23 00:10:11 devstack sudo[87847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:11 devstack sudo[87847]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-552fc9b5-53ad-4168-a283-09d77aeaf16b tempest-VolumeQuotasAdminTestJSON-1604054035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-bad0c66b-4109-4aa6-a73c-21eb9a76aec9" returned: 0 in 1.295s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-552fc9b5-53ad-4168-a283-09d77aeaf16b tempest-VolumeQuotasAdminTestJSON-1604054035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-bad0c66b-4109-4aa6-a73c-21eb9a76aec9 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:12 devstack sudo[87877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-bad0c66b-4109-4aa6-a73c-21eb9a76aec9 Sep 23 00:10:12 devstack sudo[87877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:12 devstack sudo[87877]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-552fc9b5-53ad-4168-a283-09d77aeaf16b tempest-VolumeQuotasAdminTestJSON-1604054035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-bad0c66b-4109-4aa6-a73c-21eb9a76aec9" returned: 0 in 0.914s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:12 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-552fc9b5-53ad-4168-a283-09d77aeaf16b tempest-VolumeQuotasAdminTestJSON-1604054035 None] Lock "cinder-quobyte-bad0c66b-4109-4aa6-a73c-21eb9a76aec9" released by "delete_volume" :: held 5.461s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:10:13 devstack cinder-volume[86591]: WARNING cinder.quota [None req-552fc9b5-53ad-4168-a283-09d77aeaf16b tempest-VolumeQuotasAdminTestJSON-1604054035 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:10:13 devstack cinder-volume[86591]: WARNING cinder.quota [None req-552fc9b5-53ad-4168-a283-09d77aeaf16b tempest-VolumeQuotasAdminTestJSON-1604054035 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:10:13 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-552fc9b5-53ad-4168-a283-09d77aeaf16b tempest-VolumeQuotasAdminTestJSON-1604054035 None] Created reservations ['766489eb-cbb0-4f4c-bc48-f316c87f12b7', '72741a7a-f4d8-43cc-b7cb-9b0bd60c2d78', '537337d8-71f0-4ca7-bfb8-101c12c1a56f', '0e369f41-9827-42a1-a518-37d6c3d08c1a'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:10:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-552fc9b5-53ad-4168-a283-09d77aeaf16b tempest-VolumeQuotasAdminTestJSON-1604054035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:10:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-552fc9b5-53ad-4168-a283-09d77aeaf16b tempest-VolumeQuotasAdminTestJSON-1604054035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:10:13 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-552fc9b5-53ad-4168-a283-09d77aeaf16b tempest-VolumeQuotasAdminTestJSON-1604054035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:10:13 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-552fc9b5-53ad-4168-a283-09d77aeaf16b tempest-VolumeQuotasAdminTestJSON-1604054035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:10:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-552fc9b5-53ad-4168-a283-09d77aeaf16b tempest-VolumeQuotasAdminTestJSON-1604054035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:10:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-552fc9b5-53ad-4168-a283-09d77aeaf16b tempest-VolumeQuotasAdminTestJSON-1604054035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:13 devstack sudo[87935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:10:13 devstack sudo[87935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:14 devstack sudo[87935]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-552fc9b5-53ad-4168-a283-09d77aeaf16b tempest-VolumeQuotasAdminTestJSON-1604054035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.541s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:14 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-552fc9b5-53ad-4168-a283-09d77aeaf16b tempest-VolumeQuotasAdminTestJSON-1604054035 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:10:14 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-552fc9b5-53ad-4168-a283-09d77aeaf16b tempest-VolumeQuotasAdminTestJSON-1604054035 None] Deleted volume successfully. Sep 23 00:10:14 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-552fc9b5-53ad-4168-a283-09d77aeaf16b tempest-VolumeQuotasAdminTestJSON-1604054035 None] Lock "cinder-bad0c66b-4109-4aa6-a73c-21eb9a76aec9-delete_volume" released by "delete_volume" :: held 7.169s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:10:16 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-e564c312-9922-4352-bfa5-240efcd3200c tempest-VolumeQuotasAdminTestJSON-1604054035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:10:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e564c312-9922-4352-bfa5-240efcd3200c tempest-VolumeQuotasAdminTestJSON-1604054035 None] Flow 'volume_create_manager' (e78586c1-fcb8-4bd5-9b57-0e534590ad58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:10:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e564c312-9922-4352-bfa5-240efcd3200c tempest-VolumeQuotasAdminTestJSON-1604054035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (666aba9d-9dce-4e93-8f70-a3140ea1a195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:16 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:10:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:10:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:10:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:10:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:10:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:10:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:16 devstack sudo[88009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:10:16 devstack sudo[88009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e564c312-9922-4352-bfa5-240efcd3200c tempest-VolumeQuotasAdminTestJSON-1604054035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (666aba9d-9dce-4e93-8f70-a3140ea1a195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:10:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1653993036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e4f12dd-42b1-4c2c-baac-0f3f30e14518,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03c0a007ceee47cebdf1c89373c4aaa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:10:16Z,use_quota=True,user_id='5208300bfaf046c6ae6662bcda8b076d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e564c312-9922-4352-bfa5-240efcd3200c tempest-VolumeQuotasAdminTestJSON-1604054035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d45dd04-3cbc-4bbd-ae26-2632dfd4b56b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e564c312-9922-4352-bfa5-240efcd3200c tempest-VolumeQuotasAdminTestJSON-1604054035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d45dd04-3cbc-4bbd-ae26-2632dfd4b56b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e564c312-9922-4352-bfa5-240efcd3200c tempest-VolumeQuotasAdminTestJSON-1604054035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (400f9ad9-69f3-49d5-a017-77416dcb8065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e564c312-9922-4352-bfa5-240efcd3200c tempest-VolumeQuotasAdminTestJSON-1604054035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (400f9ad9-69f3-49d5-a017-77416dcb8065) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e4f12dd-42b1-4c2c-baac-0f3f30e14518', 'volume_name': 'volume-2e4f12dd-42b1-4c2c-baac-0f3f30e14518', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e564c312-9922-4352-bfa5-240efcd3200c tempest-VolumeQuotasAdminTestJSON-1604054035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebdeef7a-3b23-44a1-b9b9-c8f213fb6e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e564c312-9922-4352-bfa5-240efcd3200c tempest-VolumeQuotasAdminTestJSON-1604054035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebdeef7a-3b23-44a1-b9b9-c8f213fb6e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e564c312-9922-4352-bfa5-240efcd3200c tempest-VolumeQuotasAdminTestJSON-1604054035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a83149f-b6f9-4742-8cdb-4ad0eabcd611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:16 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-e564c312-9922-4352-bfa5-240efcd3200c tempest-VolumeQuotasAdminTestJSON-1604054035 None] Volume 2e4f12dd-42b1-4c2c-baac-0f3f30e14518: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e4f12dd-42b1-4c2c-baac-0f3f30e14518', 'volume_size': 1} Sep 23 00:10:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e564c312-9922-4352-bfa5-240efcd3200c tempest-VolumeQuotasAdminTestJSON-1604054035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:10:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e564c312-9922-4352-bfa5-240efcd3200c tempest-VolumeQuotasAdminTestJSON-1604054035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:10:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e564c312-9922-4352-bfa5-240efcd3200c tempest-VolumeQuotasAdminTestJSON-1604054035 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:10:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1653993036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e4f12dd-42b1-4c2c-baac-0f3f30e14518,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03c0a007ceee47cebdf1c89373c4aaa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:10:16Z,use_quota=True,user_id='5208300bfaf046c6ae6662bcda8b076d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:10:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-e564c312-9922-4352-bfa5-240efcd3200c tempest-VolumeQuotasAdminTestJSON-1604054035 None] Creating volume 2e4f12dd-42b1-4c2c-baac-0f3f30e14518 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:10:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e564c312-9922-4352-bfa5-240efcd3200c tempest-VolumeQuotasAdminTestJSON-1604054035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:10:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e564c312-9922-4352-bfa5-240efcd3200c tempest-VolumeQuotasAdminTestJSON-1604054035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:10:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e564c312-9922-4352-bfa5-240efcd3200c tempest-VolumeQuotasAdminTestJSON-1604054035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:10:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e564c312-9922-4352-bfa5-240efcd3200c tempest-VolumeQuotasAdminTestJSON-1604054035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:10:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e564c312-9922-4352-bfa5-240efcd3200c tempest-VolumeQuotasAdminTestJSON-1604054035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:10:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e564c312-9922-4352-bfa5-240efcd3200c tempest-VolumeQuotasAdminTestJSON-1604054035 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:10:16 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-e564c312-9922-4352-bfa5-240efcd3200c tempest-VolumeQuotasAdminTestJSON-1604054035 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:10:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e564c312-9922-4352-bfa5-240efcd3200c tempest-VolumeQuotasAdminTestJSON-1604054035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2e4f12dd-42b1-4c2c-baac-0f3f30e14518 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:17 devstack sudo[88011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2e4f12dd-42b1-4c2c-baac-0f3f30e14518 1073741824 Sep 23 00:10:17 devstack sudo[88011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:17 devstack sudo[88009]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.907s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:17 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:10:17 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running periodic task VolumeManager._thread_info {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:10:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] thread count: 8 {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:10:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] thread info: [<_MainThread(MainThread, started 135440660459648)>, , , , , , , ] {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:10:18 devstack sudo[88011]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e564c312-9922-4352-bfa5-240efcd3200c tempest-VolumeQuotasAdminTestJSON-1604054035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2e4f12dd-42b1-4c2c-baac-0f3f30e14518 1073741824" returned: 0 in 1.322s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e564c312-9922-4352-bfa5-240efcd3200c tempest-VolumeQuotasAdminTestJSON-1604054035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2e4f12dd-42b1-4c2c-baac-0f3f30e14518 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:18 devstack sudo[88038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2e4f12dd-42b1-4c2c-baac-0f3f30e14518 Sep 23 00:10:18 devstack sudo[88038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:19 devstack sudo[88038]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e564c312-9922-4352-bfa5-240efcd3200c tempest-VolumeQuotasAdminTestJSON-1604054035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2e4f12dd-42b1-4c2c-baac-0f3f30e14518" returned: 0 in 0.680s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:19 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e564c312-9922-4352-bfa5-240efcd3200c tempest-VolumeQuotasAdminTestJSON-1604054035 None] <== create_volume: return (2142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:10:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e564c312-9922-4352-bfa5-240efcd3200c tempest-VolumeQuotasAdminTestJSON-1604054035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.152s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:10:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e564c312-9922-4352-bfa5-240efcd3200c tempest-VolumeQuotasAdminTestJSON-1604054035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a83149f-b6f9-4742-8cdb-4ad0eabcd611) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e4f12dd-42b1-4c2c-baac-0f3f30e14518', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e564c312-9922-4352-bfa5-240efcd3200c tempest-VolumeQuotasAdminTestJSON-1604054035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b877e20-2e66-4d4f-95be-088a65d4b968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:19 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-e564c312-9922-4352-bfa5-240efcd3200c tempest-VolumeQuotasAdminTestJSON-1604054035 None] Volume volume-2e4f12dd-42b1-4c2c-baac-0f3f30e14518 (2e4f12dd-42b1-4c2c-baac-0f3f30e14518): created successfully Sep 23 00:10:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e564c312-9922-4352-bfa5-240efcd3200c tempest-VolumeQuotasAdminTestJSON-1604054035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b877e20-2e66-4d4f-95be-088a65d4b968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e564c312-9922-4352-bfa5-240efcd3200c tempest-VolumeQuotasAdminTestJSON-1604054035 None] Flow 'volume_create_manager' (e78586c1-fcb8-4bd5-9b57-0e534590ad58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:10:19 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-e564c312-9922-4352-bfa5-240efcd3200c tempest-VolumeQuotasAdminTestJSON-1604054035 None] Created volume successfully. Sep 23 00:10:21 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2827d18-94dd-4323-95dd-01b59fa59e66 tempest-VolumesAdminNegativeTest-1629556618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:10:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a2827d18-94dd-4323-95dd-01b59fa59e66 tempest-VolumesAdminNegativeTest-1629556618 None] Flow 'volume_create_manager' (9035322a-ea6e-4254-92b3-39f468ae0acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:10:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a2827d18-94dd-4323-95dd-01b59fa59e66 tempest-VolumesAdminNegativeTest-1629556618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d43b46a2-4a55-4d2d-8b71-260995ad5db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a2827d18-94dd-4323-95dd-01b59fa59e66 tempest-VolumesAdminNegativeTest-1629556618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d43b46a2-4a55-4d2d-8b71-260995ad5db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:10:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1009935268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3247398d-6c4d-4718-8dce-a7729eea23d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='933b566c1b714975b1815133a413fe72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:10:21Z,use_quota=True,user_id='dfd6fdb057ab46a59ed12f8adfd60159',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a2827d18-94dd-4323-95dd-01b59fa59e66 tempest-VolumesAdminNegativeTest-1629556618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db012c76-7adf-4f1f-b0f7-87ca238292be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a2827d18-94dd-4323-95dd-01b59fa59e66 tempest-VolumesAdminNegativeTest-1629556618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db012c76-7adf-4f1f-b0f7-87ca238292be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a2827d18-94dd-4323-95dd-01b59fa59e66 tempest-VolumesAdminNegativeTest-1629556618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8300d70-4cda-4479-88d5-97c58a2ff6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a2827d18-94dd-4323-95dd-01b59fa59e66 tempest-VolumesAdminNegativeTest-1629556618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8300d70-4cda-4479-88d5-97c58a2ff6b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3247398d-6c4d-4718-8dce-a7729eea23d8', 'volume_name': 'volume-3247398d-6c4d-4718-8dce-a7729eea23d8', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a2827d18-94dd-4323-95dd-01b59fa59e66 tempest-VolumesAdminNegativeTest-1629556618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3b6c80a-bf98-4110-9096-c9d470f8e7e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a2827d18-94dd-4323-95dd-01b59fa59e66 tempest-VolumesAdminNegativeTest-1629556618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3b6c80a-bf98-4110-9096-c9d470f8e7e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a2827d18-94dd-4323-95dd-01b59fa59e66 tempest-VolumesAdminNegativeTest-1629556618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b702ec25-d00b-4fe2-990c-7b51892bd90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:21 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-a2827d18-94dd-4323-95dd-01b59fa59e66 tempest-VolumesAdminNegativeTest-1629556618 None] Volume 3247398d-6c4d-4718-8dce-a7729eea23d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3247398d-6c4d-4718-8dce-a7729eea23d8', 'volume_size': 1} Sep 23 00:10:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a2827d18-94dd-4323-95dd-01b59fa59e66 tempest-VolumesAdminNegativeTest-1629556618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:10:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a2827d18-94dd-4323-95dd-01b59fa59e66 tempest-VolumesAdminNegativeTest-1629556618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:10:21 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a2827d18-94dd-4323-95dd-01b59fa59e66 tempest-VolumesAdminNegativeTest-1629556618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:10:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1009935268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3247398d-6c4d-4718-8dce-a7729eea23d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='933b566c1b714975b1815133a413fe72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:10:21Z,use_quota=True,user_id='dfd6fdb057ab46a59ed12f8adfd60159',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:10:21 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-a2827d18-94dd-4323-95dd-01b59fa59e66 tempest-VolumesAdminNegativeTest-1629556618 None] Creating volume 3247398d-6c4d-4718-8dce-a7729eea23d8 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:10:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a2827d18-94dd-4323-95dd-01b59fa59e66 tempest-VolumesAdminNegativeTest-1629556618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:10:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a2827d18-94dd-4323-95dd-01b59fa59e66 tempest-VolumesAdminNegativeTest-1629556618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:10:21 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a2827d18-94dd-4323-95dd-01b59fa59e66 tempest-VolumesAdminNegativeTest-1629556618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:10:21 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a2827d18-94dd-4323-95dd-01b59fa59e66 tempest-VolumesAdminNegativeTest-1629556618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:10:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a2827d18-94dd-4323-95dd-01b59fa59e66 tempest-VolumesAdminNegativeTest-1629556618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:10:21 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a2827d18-94dd-4323-95dd-01b59fa59e66 tempest-VolumesAdminNegativeTest-1629556618 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:10:21 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-a2827d18-94dd-4323-95dd-01b59fa59e66 tempest-VolumesAdminNegativeTest-1629556618 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:10:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a2827d18-94dd-4323-95dd-01b59fa59e66 tempest-VolumesAdminNegativeTest-1629556618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3247398d-6c4d-4718-8dce-a7729eea23d8 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:21 devstack sudo[88096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3247398d-6c4d-4718-8dce-a7729eea23d8 1073741824 Sep 23 00:10:21 devstack sudo[88096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:21 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-777c1592-de57-4037-b7f4-640b794930d2 tempest-VolumeQuotasAdminTestJSON-562016896 None] Transfer volume completed successfully. Sep 23 00:10:22 devstack sudo[88096]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a2827d18-94dd-4323-95dd-01b59fa59e66 tempest-VolumesAdminNegativeTest-1629556618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3247398d-6c4d-4718-8dce-a7729eea23d8 1073741824" returned: 0 in 0.876s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a2827d18-94dd-4323-95dd-01b59fa59e66 tempest-VolumesAdminNegativeTest-1629556618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3247398d-6c4d-4718-8dce-a7729eea23d8 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:22 devstack sudo[88102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3247398d-6c4d-4718-8dce-a7729eea23d8 Sep 23 00:10:22 devstack sudo[88102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:22 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4148d528-5663-480b-8cd1-950abc43f28e tempest-VolumeQuotasAdminTestJSON-49921442 None] Acquiring lock "cinder-2e4f12dd-42b1-4c2c-baac-0f3f30e14518-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:10:22 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4148d528-5663-480b-8cd1-950abc43f28e tempest-VolumeQuotasAdminTestJSON-49921442 None] Lock "cinder-2e4f12dd-42b1-4c2c-baac-0f3f30e14518-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:10:22 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4148d528-5663-480b-8cd1-950abc43f28e tempest-VolumeQuotasAdminTestJSON-49921442 None] Acquiring lock "cinder-quobyte-2e4f12dd-42b1-4c2c-baac-0f3f30e14518" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:10:22 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4148d528-5663-480b-8cd1-950abc43f28e tempest-VolumeQuotasAdminTestJSON-49921442 None] Lock "cinder-quobyte-2e4f12dd-42b1-4c2c-baac-0f3f30e14518" acquired by "delete_volume" :: waited 0.063s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:10:23 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[7510f9a2-2b12-4400-afb5-d3702d268957]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:10:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4148d528-5663-480b-8cd1-950abc43f28e tempest-VolumeQuotasAdminTestJSON-49921442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2e4f12dd-42b1-4c2c-baac-0f3f30e14518 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:23 devstack sudo[88102]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a2827d18-94dd-4323-95dd-01b59fa59e66 tempest-VolumesAdminNegativeTest-1629556618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3247398d-6c4d-4718-8dce-a7729eea23d8" returned: 0 in 0.607s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:23 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a2827d18-94dd-4323-95dd-01b59fa59e66 tempest-VolumesAdminNegativeTest-1629556618 None] <== create_volume: return (1563ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:10:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a2827d18-94dd-4323-95dd-01b59fa59e66 tempest-VolumesAdminNegativeTest-1629556618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.567s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:10:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a2827d18-94dd-4323-95dd-01b59fa59e66 tempest-VolumesAdminNegativeTest-1629556618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b702ec25-d00b-4fe2-990c-7b51892bd90e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3247398d-6c4d-4718-8dce-a7729eea23d8', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a2827d18-94dd-4323-95dd-01b59fa59e66 tempest-VolumesAdminNegativeTest-1629556618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f7960c9-9aab-4d0c-b0ef-78dd5699c3ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:23 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-a2827d18-94dd-4323-95dd-01b59fa59e66 tempest-VolumesAdminNegativeTest-1629556618 None] Volume volume-3247398d-6c4d-4718-8dce-a7729eea23d8 (3247398d-6c4d-4718-8dce-a7729eea23d8): created successfully Sep 23 00:10:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a2827d18-94dd-4323-95dd-01b59fa59e66 tempest-VolumesAdminNegativeTest-1629556618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f7960c9-9aab-4d0c-b0ef-78dd5699c3ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a2827d18-94dd-4323-95dd-01b59fa59e66 tempest-VolumesAdminNegativeTest-1629556618 None] Flow 'volume_create_manager' (9035322a-ea6e-4254-92b3-39f468ae0acb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:10:23 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-a2827d18-94dd-4323-95dd-01b59fa59e66 tempest-VolumesAdminNegativeTest-1629556618 None] Created volume successfully. Sep 23 00:10:23 devstack sudo[88105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2e4f12dd-42b1-4c2c-baac-0f3f30e14518 Sep 23 00:10:23 devstack sudo[88105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:23 devstack sudo[88105]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4148d528-5663-480b-8cd1-950abc43f28e tempest-VolumeQuotasAdminTestJSON-49921442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2e4f12dd-42b1-4c2c-baac-0f3f30e14518" returned: 0 in 0.517s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4148d528-5663-480b-8cd1-950abc43f28e tempest-VolumeQuotasAdminTestJSON-49921442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2e4f12dd-42b1-4c2c-baac-0f3f30e14518 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:23 devstack sudo[88110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2e4f12dd-42b1-4c2c-baac-0f3f30e14518 Sep 23 00:10:23 devstack sudo[88110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:24 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-14ca269b-0a03-4220-b805-4b176d2fba86 tempest-VolumesAdminNegativeTest-1629556618 None] Acquiring lock "cinder-3247398d-6c4d-4718-8dce-a7729eea23d8-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:10:24 devstack sudo[88110]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4148d528-5663-480b-8cd1-950abc43f28e tempest-VolumeQuotasAdminTestJSON-49921442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2e4f12dd-42b1-4c2c-baac-0f3f30e14518" returned: 0 in 0.568s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:24 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-14ca269b-0a03-4220-b805-4b176d2fba86 tempest-VolumesAdminNegativeTest-1629556618 None] Lock "cinder-3247398d-6c4d-4718-8dce-a7729eea23d8-delete_volume" acquired by "delete_volume" :: waited 0.151s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:10:24 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4148d528-5663-480b-8cd1-950abc43f28e tempest-VolumeQuotasAdminTestJSON-49921442 None] Lock "cinder-quobyte-2e4f12dd-42b1-4c2c-baac-0f3f30e14518" released by "delete_volume" :: held 1.300s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:10:24 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-14ca269b-0a03-4220-b805-4b176d2fba86 tempest-VolumesAdminNegativeTest-1629556618 None] Acquiring lock "cinder-quobyte-3247398d-6c4d-4718-8dce-a7729eea23d8" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:10:24 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-14ca269b-0a03-4220-b805-4b176d2fba86 tempest-VolumesAdminNegativeTest-1629556618 None] Lock "cinder-quobyte-3247398d-6c4d-4718-8dce-a7729eea23d8" acquired by "delete_volume" :: waited 0.029s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:10:24 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ec7f2b-f2cd-4dae-ae5b-544a100b133e]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:10:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-14ca269b-0a03-4220-b805-4b176d2fba86 tempest-VolumesAdminNegativeTest-1629556618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3247398d-6c4d-4718-8dce-a7729eea23d8 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:24 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-4148d528-5663-480b-8cd1-950abc43f28e tempest-VolumeQuotasAdminTestJSON-49921442 None] Created reservations ['bbd5e17b-45c6-4e34-ae4e-ce52430fc833', 'bb379a40-f3d0-44cc-99e7-e40c0c511a22', '6ec93486-73f9-479a-bd87-8df6719c02dc', '704f0573-83ac-4504-8895-4c30dafb3abf'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:10:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4148d528-5663-480b-8cd1-950abc43f28e tempest-VolumeQuotasAdminTestJSON-49921442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:10:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4148d528-5663-480b-8cd1-950abc43f28e tempest-VolumeQuotasAdminTestJSON-49921442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:10:24 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4148d528-5663-480b-8cd1-950abc43f28e tempest-VolumeQuotasAdminTestJSON-49921442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:10:24 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4148d528-5663-480b-8cd1-950abc43f28e tempest-VolumeQuotasAdminTestJSON-49921442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:10:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4148d528-5663-480b-8cd1-950abc43f28e tempest-VolumeQuotasAdminTestJSON-49921442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:10:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4148d528-5663-480b-8cd1-950abc43f28e tempest-VolumeQuotasAdminTestJSON-49921442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:24 devstack sudo[88115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:10:24 devstack sudo[88115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:24 devstack sudo[88114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3247398d-6c4d-4718-8dce-a7729eea23d8 Sep 23 00:10:24 devstack sudo[88114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:25 devstack sudo[88115]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4148d528-5663-480b-8cd1-950abc43f28e tempest-VolumeQuotasAdminTestJSON-49921442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.347s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:25 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-4148d528-5663-480b-8cd1-950abc43f28e tempest-VolumeQuotasAdminTestJSON-49921442 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:10:25 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-4148d528-5663-480b-8cd1-950abc43f28e tempest-VolumeQuotasAdminTestJSON-49921442 None] Deleted volume successfully. Sep 23 00:10:25 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4148d528-5663-480b-8cd1-950abc43f28e tempest-VolumeQuotasAdminTestJSON-49921442 None] Lock "cinder-2e4f12dd-42b1-4c2c-baac-0f3f30e14518-delete_volume" released by "delete_volume" :: held 2.365s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:10:25 devstack sudo[88114]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-14ca269b-0a03-4220-b805-4b176d2fba86 tempest-VolumesAdminNegativeTest-1629556618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3247398d-6c4d-4718-8dce-a7729eea23d8" returned: 0 in 0.633s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-14ca269b-0a03-4220-b805-4b176d2fba86 tempest-VolumesAdminNegativeTest-1629556618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3247398d-6c4d-4718-8dce-a7729eea23d8 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:25 devstack sudo[88122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3247398d-6c4d-4718-8dce-a7729eea23d8 Sep 23 00:10:25 devstack sudo[88122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:25 devstack sudo[88122]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-14ca269b-0a03-4220-b805-4b176d2fba86 tempest-VolumesAdminNegativeTest-1629556618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3247398d-6c4d-4718-8dce-a7729eea23d8" returned: 0 in 0.516s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:25 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-14ca269b-0a03-4220-b805-4b176d2fba86 tempest-VolumesAdminNegativeTest-1629556618 None] Lock "cinder-quobyte-3247398d-6c4d-4718-8dce-a7729eea23d8" released by "delete_volume" :: held 1.234s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:10:25 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-14ca269b-0a03-4220-b805-4b176d2fba86 tempest-VolumesAdminNegativeTest-1629556618 None] Created reservations ['368f2e56-7c0a-4cc7-a49f-7b5ab419d51d', 'f031a70a-6643-471a-a87a-cbea143ade04', '5f839de5-c292-4ec7-b099-1603f12d5691', '2812d31a-7090-43e6-a4e5-844517d9340d'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:10:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-14ca269b-0a03-4220-b805-4b176d2fba86 tempest-VolumesAdminNegativeTest-1629556618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:10:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-14ca269b-0a03-4220-b805-4b176d2fba86 tempest-VolumesAdminNegativeTest-1629556618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:10:25 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-14ca269b-0a03-4220-b805-4b176d2fba86 tempest-VolumesAdminNegativeTest-1629556618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:10:25 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-14ca269b-0a03-4220-b805-4b176d2fba86 tempest-VolumesAdminNegativeTest-1629556618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:10:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-14ca269b-0a03-4220-b805-4b176d2fba86 tempest-VolumesAdminNegativeTest-1629556618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:10:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-14ca269b-0a03-4220-b805-4b176d2fba86 tempest-VolumesAdminNegativeTest-1629556618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:26 devstack sudo[88129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:10:26 devstack sudo[88129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:26 devstack sudo[88129]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-14ca269b-0a03-4220-b805-4b176d2fba86 tempest-VolumesAdminNegativeTest-1629556618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.585s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:26 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-14ca269b-0a03-4220-b805-4b176d2fba86 tempest-VolumesAdminNegativeTest-1629556618 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:10:26 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-14ca269b-0a03-4220-b805-4b176d2fba86 tempest-VolumesAdminNegativeTest-1629556618 None] Deleted volume successfully. Sep 23 00:10:26 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-14ca269b-0a03-4220-b805-4b176d2fba86 tempest-VolumesAdminNegativeTest-1629556618 None] Lock "cinder-3247398d-6c4d-4718-8dce-a7729eea23d8-delete_volume" released by "delete_volume" :: held 2.436s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:10:35 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=21,cinder:UPDATE=38,cinder:INSERT=9,cinder:DELETE=3 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:10:36 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea6e467d-16c9-4c23-8209-f325dde57059 tempest-VolumeQuotasNegativeTestJSON-962025857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:10:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ea6e467d-16c9-4c23-8209-f325dde57059 tempest-VolumeQuotasNegativeTestJSON-962025857 None] Flow 'volume_create_manager' (5171972c-245a-4094-93d3-3fedb2abb0a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:10:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ea6e467d-16c9-4c23-8209-f325dde57059 tempest-VolumeQuotasNegativeTestJSON-962025857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60f3c2e6-5e30-41de-aab3-6e57ab424c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ea6e467d-16c9-4c23-8209-f325dde57059 tempest-VolumeQuotasNegativeTestJSON-962025857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60f3c2e6-5e30-41de-aab3-6e57ab424c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:10:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1690174171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32205ed8-0257-4621-880d-d82d7f9c7fd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d13666bf4e4e4ae492e81d86d0718fbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:10:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:10:36Z,use_quota=True,user_id='d0232640bcab44789ce669503794aef9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ea6e467d-16c9-4c23-8209-f325dde57059 tempest-VolumeQuotasNegativeTestJSON-962025857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20abb9a4-ecef-40ba-b83d-746a2aa7c804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ea6e467d-16c9-4c23-8209-f325dde57059 tempest-VolumeQuotasNegativeTestJSON-962025857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20abb9a4-ecef-40ba-b83d-746a2aa7c804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ea6e467d-16c9-4c23-8209-f325dde57059 tempest-VolumeQuotasNegativeTestJSON-962025857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (135a5456-f5c1-4fb5-a478-a8047656c6ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ea6e467d-16c9-4c23-8209-f325dde57059 tempest-VolumeQuotasNegativeTestJSON-962025857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (135a5456-f5c1-4fb5-a478-a8047656c6ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32205ed8-0257-4621-880d-d82d7f9c7fd8', 'volume_name': 'volume-32205ed8-0257-4621-880d-d82d7f9c7fd8', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ea6e467d-16c9-4c23-8209-f325dde57059 tempest-VolumeQuotasNegativeTestJSON-962025857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62a17964-4f9f-4631-ad19-70d1fc349ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ea6e467d-16c9-4c23-8209-f325dde57059 tempest-VolumeQuotasNegativeTestJSON-962025857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62a17964-4f9f-4631-ad19-70d1fc349ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ea6e467d-16c9-4c23-8209-f325dde57059 tempest-VolumeQuotasNegativeTestJSON-962025857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (349151c0-87b5-45a7-a7eb-1cc611b326b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:36 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-ea6e467d-16c9-4c23-8209-f325dde57059 tempest-VolumeQuotasNegativeTestJSON-962025857 None] Volume 32205ed8-0257-4621-880d-d82d7f9c7fd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32205ed8-0257-4621-880d-d82d7f9c7fd8', 'volume_size': 1} Sep 23 00:10:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ea6e467d-16c9-4c23-8209-f325dde57059 tempest-VolumeQuotasNegativeTestJSON-962025857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:10:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ea6e467d-16c9-4c23-8209-f325dde57059 tempest-VolumeQuotasNegativeTestJSON-962025857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:10:36 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ea6e467d-16c9-4c23-8209-f325dde57059 tempest-VolumeQuotasNegativeTestJSON-962025857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:10:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1690174171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32205ed8-0257-4621-880d-d82d7f9c7fd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d13666bf4e4e4ae492e81d86d0718fbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:10:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:10:36Z,use_quota=True,user_id='d0232640bcab44789ce669503794aef9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:10:36 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-ea6e467d-16c9-4c23-8209-f325dde57059 tempest-VolumeQuotasNegativeTestJSON-962025857 None] Creating volume 32205ed8-0257-4621-880d-d82d7f9c7fd8 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:10:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ea6e467d-16c9-4c23-8209-f325dde57059 tempest-VolumeQuotasNegativeTestJSON-962025857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:10:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ea6e467d-16c9-4c23-8209-f325dde57059 tempest-VolumeQuotasNegativeTestJSON-962025857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:10:36 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ea6e467d-16c9-4c23-8209-f325dde57059 tempest-VolumeQuotasNegativeTestJSON-962025857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:10:36 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ea6e467d-16c9-4c23-8209-f325dde57059 tempest-VolumeQuotasNegativeTestJSON-962025857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:10:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ea6e467d-16c9-4c23-8209-f325dde57059 tempest-VolumeQuotasNegativeTestJSON-962025857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:10:36 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ea6e467d-16c9-4c23-8209-f325dde57059 tempest-VolumeQuotasNegativeTestJSON-962025857 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:10:36 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-ea6e467d-16c9-4c23-8209-f325dde57059 tempest-VolumeQuotasNegativeTestJSON-962025857 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:10:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ea6e467d-16c9-4c23-8209-f325dde57059 tempest-VolumeQuotasNegativeTestJSON-962025857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-32205ed8-0257-4621-880d-d82d7f9c7fd8 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:36 devstack sudo[88194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-32205ed8-0257-4621-880d-d82d7f9c7fd8 1073741824 Sep 23 00:10:36 devstack sudo[88194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:36 devstack sudo[88194]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ea6e467d-16c9-4c23-8209-f325dde57059 tempest-VolumeQuotasNegativeTestJSON-962025857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-32205ed8-0257-4621-880d-d82d7f9c7fd8 1073741824" returned: 0 in 0.633s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ea6e467d-16c9-4c23-8209-f325dde57059 tempest-VolumeQuotasNegativeTestJSON-962025857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-32205ed8-0257-4621-880d-d82d7f9c7fd8 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:36 devstack sudo[88201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-32205ed8-0257-4621-880d-d82d7f9c7fd8 Sep 23 00:10:36 devstack sudo[88201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:37 devstack sudo[88201]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ea6e467d-16c9-4c23-8209-f325dde57059 tempest-VolumeQuotasNegativeTestJSON-962025857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-32205ed8-0257-4621-880d-d82d7f9c7fd8" returned: 0 in 0.315s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ea6e467d-16c9-4c23-8209-f325dde57059 tempest-VolumeQuotasNegativeTestJSON-962025857 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:10:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ea6e467d-16c9-4c23-8209-f325dde57059 tempest-VolumeQuotasNegativeTestJSON-962025857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:10:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ea6e467d-16c9-4c23-8209-f325dde57059 tempest-VolumeQuotasNegativeTestJSON-962025857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (349151c0-87b5-45a7-a7eb-1cc611b326b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32205ed8-0257-4621-880d-d82d7f9c7fd8', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ea6e467d-16c9-4c23-8209-f325dde57059 tempest-VolumeQuotasNegativeTestJSON-962025857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (371382bf-0b87-4b8a-bfdc-6b8627793e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:37 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-ea6e467d-16c9-4c23-8209-f325dde57059 tempest-VolumeQuotasNegativeTestJSON-962025857 None] Volume volume-32205ed8-0257-4621-880d-d82d7f9c7fd8 (32205ed8-0257-4621-880d-d82d7f9c7fd8): created successfully Sep 23 00:10:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ea6e467d-16c9-4c23-8209-f325dde57059 tempest-VolumeQuotasNegativeTestJSON-962025857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (371382bf-0b87-4b8a-bfdc-6b8627793e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ea6e467d-16c9-4c23-8209-f325dde57059 tempest-VolumeQuotasNegativeTestJSON-962025857 None] Flow 'volume_create_manager' (5171972c-245a-4094-93d3-3fedb2abb0a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:10:37 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-ea6e467d-16c9-4c23-8209-f325dde57059 tempest-VolumeQuotasNegativeTestJSON-962025857 None] Created volume successfully. Sep 23 00:10:39 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e49a2ae1-7314-4188-b515-913e4d0c758c tempest-VolumeQuotasNegativeTestJSON-962025857 None] Acquiring lock "cinder-32205ed8-0257-4621-880d-d82d7f9c7fd8-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:10:39 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e49a2ae1-7314-4188-b515-913e4d0c758c tempest-VolumeQuotasNegativeTestJSON-962025857 None] Lock "cinder-32205ed8-0257-4621-880d-d82d7f9c7fd8-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:10:39 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e49a2ae1-7314-4188-b515-913e4d0c758c tempest-VolumeQuotasNegativeTestJSON-962025857 None] Acquiring lock "cinder-quobyte-32205ed8-0257-4621-880d-d82d7f9c7fd8" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:10:39 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e49a2ae1-7314-4188-b515-913e4d0c758c tempest-VolumeQuotasNegativeTestJSON-962025857 None] Lock "cinder-quobyte-32205ed8-0257-4621-880d-d82d7f9c7fd8" acquired by "delete_volume" :: waited 0.023s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:10:39 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[279816cb-22d5-4de7-87b9-39f735268571]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:10:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e49a2ae1-7314-4188-b515-913e4d0c758c tempest-VolumeQuotasNegativeTestJSON-962025857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-32205ed8-0257-4621-880d-d82d7f9c7fd8 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:39 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee360acd-0111-4bea-8668-8dec3a35ed61 tempest-AttachVolumeNegativeTest-86753276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:10:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ee360acd-0111-4bea-8668-8dec3a35ed61 tempest-AttachVolumeNegativeTest-86753276 None] Flow 'volume_create_manager' (2d007061-ff31-4fab-ac19-50c5a311df37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:10:39 devstack sudo[88207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-32205ed8-0257-4621-880d-d82d7f9c7fd8 Sep 23 00:10:39 devstack sudo[88207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ee360acd-0111-4bea-8668-8dec3a35ed61 tempest-AttachVolumeNegativeTest-86753276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d88d461-a932-4219-acc5-54226141d34a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ee360acd-0111-4bea-8668-8dec3a35ed61 tempest-AttachVolumeNegativeTest-86753276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d88d461-a932-4219-acc5-54226141d34a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:10:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1273698332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4d2ec28-8869-46e8-bc62-4265c35d0eb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf852d90769e4bda8c3bcaf3abc9cdde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:10:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:10:40Z,use_quota=True,user_id='d38946cf23d046538a65564ac3e17d4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ee360acd-0111-4bea-8668-8dec3a35ed61 tempest-AttachVolumeNegativeTest-86753276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1e61bc4-b1da-4224-8197-fc0d89b0c61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ee360acd-0111-4bea-8668-8dec3a35ed61 tempest-AttachVolumeNegativeTest-86753276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1e61bc4-b1da-4224-8197-fc0d89b0c61f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ee360acd-0111-4bea-8668-8dec3a35ed61 tempest-AttachVolumeNegativeTest-86753276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4ef4cbd-6fdb-48cf-acbb-dc76bee2faad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ee360acd-0111-4bea-8668-8dec3a35ed61 tempest-AttachVolumeNegativeTest-86753276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4ef4cbd-6fdb-48cf-acbb-dc76bee2faad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4d2ec28-8869-46e8-bc62-4265c35d0eb1', 'volume_name': 'volume-c4d2ec28-8869-46e8-bc62-4265c35d0eb1', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ee360acd-0111-4bea-8668-8dec3a35ed61 tempest-AttachVolumeNegativeTest-86753276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37e0f121-8214-4dc4-bba3-2d305871f660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ee360acd-0111-4bea-8668-8dec3a35ed61 tempest-AttachVolumeNegativeTest-86753276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37e0f121-8214-4dc4-bba3-2d305871f660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ee360acd-0111-4bea-8668-8dec3a35ed61 tempest-AttachVolumeNegativeTest-86753276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bc93775-c9e9-4f4e-bb55-6d2fffadf731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:39 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-ee360acd-0111-4bea-8668-8dec3a35ed61 tempest-AttachVolumeNegativeTest-86753276 None] Volume c4d2ec28-8869-46e8-bc62-4265c35d0eb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4d2ec28-8869-46e8-bc62-4265c35d0eb1', 'volume_size': 1} Sep 23 00:10:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ee360acd-0111-4bea-8668-8dec3a35ed61 tempest-AttachVolumeNegativeTest-86753276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:10:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ee360acd-0111-4bea-8668-8dec3a35ed61 tempest-AttachVolumeNegativeTest-86753276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:10:39 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ee360acd-0111-4bea-8668-8dec3a35ed61 tempest-AttachVolumeNegativeTest-86753276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:10:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1273698332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4d2ec28-8869-46e8-bc62-4265c35d0eb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf852d90769e4bda8c3bcaf3abc9cdde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:10:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:10:40Z,use_quota=True,user_id='d38946cf23d046538a65564ac3e17d4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:10:39 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-ee360acd-0111-4bea-8668-8dec3a35ed61 tempest-AttachVolumeNegativeTest-86753276 None] Creating volume c4d2ec28-8869-46e8-bc62-4265c35d0eb1 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:10:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ee360acd-0111-4bea-8668-8dec3a35ed61 tempest-AttachVolumeNegativeTest-86753276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:10:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ee360acd-0111-4bea-8668-8dec3a35ed61 tempest-AttachVolumeNegativeTest-86753276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:10:39 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ee360acd-0111-4bea-8668-8dec3a35ed61 tempest-AttachVolumeNegativeTest-86753276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:10:39 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ee360acd-0111-4bea-8668-8dec3a35ed61 tempest-AttachVolumeNegativeTest-86753276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:10:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ee360acd-0111-4bea-8668-8dec3a35ed61 tempest-AttachVolumeNegativeTest-86753276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:10:39 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ee360acd-0111-4bea-8668-8dec3a35ed61 tempest-AttachVolumeNegativeTest-86753276 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:10:39 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-ee360acd-0111-4bea-8668-8dec3a35ed61 tempest-AttachVolumeNegativeTest-86753276 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:10:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ee360acd-0111-4bea-8668-8dec3a35ed61 tempest-AttachVolumeNegativeTest-86753276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c4d2ec28-8869-46e8-bc62-4265c35d0eb1 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:40 devstack sudo[88209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c4d2ec28-8869-46e8-bc62-4265c35d0eb1 1073741824 Sep 23 00:10:40 devstack sudo[88209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:40 devstack sudo[88207]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e49a2ae1-7314-4188-b515-913e4d0c758c tempest-VolumeQuotasNegativeTestJSON-962025857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-32205ed8-0257-4621-880d-d82d7f9c7fd8" returned: 0 in 0.484s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e49a2ae1-7314-4188-b515-913e4d0c758c tempest-VolumeQuotasNegativeTestJSON-962025857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-32205ed8-0257-4621-880d-d82d7f9c7fd8 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:40 devstack sudo[88214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-32205ed8-0257-4621-880d-d82d7f9c7fd8 Sep 23 00:10:40 devstack sudo[88214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:40 devstack sudo[88214]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e49a2ae1-7314-4188-b515-913e4d0c758c tempest-VolumeQuotasNegativeTestJSON-962025857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-32205ed8-0257-4621-880d-d82d7f9c7fd8" returned: 0 in 0.361s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:40 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e49a2ae1-7314-4188-b515-913e4d0c758c tempest-VolumeQuotasNegativeTestJSON-962025857 None] Lock "cinder-quobyte-32205ed8-0257-4621-880d-d82d7f9c7fd8" released by "delete_volume" :: held 0.935s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:10:40 devstack sudo[88209]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ee360acd-0111-4bea-8668-8dec3a35ed61 tempest-AttachVolumeNegativeTest-86753276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c4d2ec28-8869-46e8-bc62-4265c35d0eb1 1073741824" returned: 0 in 0.651s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ee360acd-0111-4bea-8668-8dec3a35ed61 tempest-AttachVolumeNegativeTest-86753276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c4d2ec28-8869-46e8-bc62-4265c35d0eb1 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:40 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-e49a2ae1-7314-4188-b515-913e4d0c758c tempest-VolumeQuotasNegativeTestJSON-962025857 None] Created reservations ['075c53ef-2a5b-44fc-87e2-0d7c602fc7e1', '57e3b5a4-9c0d-447f-9442-738455a6dddc', '9369ba74-e62b-40f7-8ea7-385d49cad182', 'aa609790-7496-41d6-8576-ce990f2f8576'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:10:40 devstack sudo[88221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c4d2ec28-8869-46e8-bc62-4265c35d0eb1 Sep 23 00:10:40 devstack sudo[88221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e49a2ae1-7314-4188-b515-913e4d0c758c tempest-VolumeQuotasNegativeTestJSON-962025857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:10:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e49a2ae1-7314-4188-b515-913e4d0c758c tempest-VolumeQuotasNegativeTestJSON-962025857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:10:40 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e49a2ae1-7314-4188-b515-913e4d0c758c tempest-VolumeQuotasNegativeTestJSON-962025857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:10:40 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e49a2ae1-7314-4188-b515-913e4d0c758c tempest-VolumeQuotasNegativeTestJSON-962025857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:10:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e49a2ae1-7314-4188-b515-913e4d0c758c tempest-VolumeQuotasNegativeTestJSON-962025857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:10:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e49a2ae1-7314-4188-b515-913e4d0c758c tempest-VolumeQuotasNegativeTestJSON-962025857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:40 devstack sudo[88223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:10:40 devstack sudo[88223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:41 devstack sudo[88221]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ee360acd-0111-4bea-8668-8dec3a35ed61 tempest-AttachVolumeNegativeTest-86753276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c4d2ec28-8869-46e8-bc62-4265c35d0eb1" returned: 0 in 0.350s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ee360acd-0111-4bea-8668-8dec3a35ed61 tempest-AttachVolumeNegativeTest-86753276 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:10:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ee360acd-0111-4bea-8668-8dec3a35ed61 tempest-AttachVolumeNegativeTest-86753276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:10:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ee360acd-0111-4bea-8668-8dec3a35ed61 tempest-AttachVolumeNegativeTest-86753276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bc93775-c9e9-4f4e-bb55-6d2fffadf731) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4d2ec28-8869-46e8-bc62-4265c35d0eb1', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ee360acd-0111-4bea-8668-8dec3a35ed61 tempest-AttachVolumeNegativeTest-86753276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34f70799-ba85-42d3-93e3-40173630bedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:41 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-ee360acd-0111-4bea-8668-8dec3a35ed61 tempest-AttachVolumeNegativeTest-86753276 None] Volume volume-c4d2ec28-8869-46e8-bc62-4265c35d0eb1 (c4d2ec28-8869-46e8-bc62-4265c35d0eb1): created successfully Sep 23 00:10:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ee360acd-0111-4bea-8668-8dec3a35ed61 tempest-AttachVolumeNegativeTest-86753276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34f70799-ba85-42d3-93e3-40173630bedf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ee360acd-0111-4bea-8668-8dec3a35ed61 tempest-AttachVolumeNegativeTest-86753276 None] Flow 'volume_create_manager' (2d007061-ff31-4fab-ac19-50c5a311df37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:10:41 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-ee360acd-0111-4bea-8668-8dec3a35ed61 tempest-AttachVolumeNegativeTest-86753276 None] Created volume successfully. Sep 23 00:10:41 devstack sudo[88223]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e49a2ae1-7314-4188-b515-913e4d0c758c tempest-VolumeQuotasNegativeTestJSON-962025857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.314s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:41 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-e49a2ae1-7314-4188-b515-913e4d0c758c tempest-VolumeQuotasNegativeTestJSON-962025857 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:10:41 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-e49a2ae1-7314-4188-b515-913e4d0c758c tempest-VolumeQuotasNegativeTestJSON-962025857 None] Deleted volume successfully. Sep 23 00:10:41 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e49a2ae1-7314-4188-b515-913e4d0c758c tempest-VolumeQuotasNegativeTestJSON-962025857 None] Lock "cinder-32205ed8-0257-4621-880d-d82d7f9c7fd8-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:10:45 devstack cinder-volume[86591]: WARNING py.warnings [req-8838195a-86c6-4c7d-ac48-0b95f5a63550 req-172aee4a-c975-4e60-8c25-9d2049e57ecb tempest-AttachVolumeNegativeTest-86753276 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Sep 23 00:10:45 devstack cinder-volume[86591]: .first() Sep 23 00:10:45 devstack cinder-volume[86591]: Sep 23 00:10:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-8838195a-86c6-4c7d-ac48-0b95f5a63550 req-172aee4a-c975-4e60-8c25-9d2049e57ecb tempest-AttachVolumeNegativeTest-86753276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:10:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-8838195a-86c6-4c7d-ac48-0b95f5a63550 req-172aee4a-c975-4e60-8c25-9d2049e57ecb tempest-AttachVolumeNegativeTest-86753276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:10:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-8838195a-86c6-4c7d-ac48-0b95f5a63550 req-172aee4a-c975-4e60-8c25-9d2049e57ecb tempest-AttachVolumeNegativeTest-86753276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:10:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-8838195a-86c6-4c7d-ac48-0b95f5a63550 req-172aee4a-c975-4e60-8c25-9d2049e57ecb tempest-AttachVolumeNegativeTest-86753276 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974', 'name': 'volume-c4d2ec28-8869-46e8-bc62-4265c35d0eb1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'afc7978d-3d4a-46a6-8124-38f2c6fece34', 'enforce_multipath': True} {{(pid=86591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:10:45 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-8838195a-86c6-4c7d-ac48-0b95f5a63550 req-172aee4a-c975-4e60-8c25-9d2049e57ecb tempest-AttachVolumeNegativeTest-86753276 None] attachment_update completed successfully. Sep 23 00:10:55 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:UPDATE=16,cinder:SELECT=17,cinder:DELETE=3,cinder:INSERT=4 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:10:55 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=36,cinder:UPDATE=43,cinder:DELETE=3,cinder:INSERT=8 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:10:56 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-404e249b-5496-4f75-b4a8-bb6c9a5efa8e tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:10:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-404e249b-5496-4f75-b4a8-bb6c9a5efa8e tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Flow 'volume_create_manager' (530455a4-7c1f-4de0-812c-5fd4013883b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:10:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-404e249b-5496-4f75-b4a8-bb6c9a5efa8e tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea658499-05eb-4c5d-a472-58e5dc4bba09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-404e249b-5496-4f75-b4a8-bb6c9a5efa8e tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea658499-05eb-4c5d-a472-58e5dc4bba09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:10:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-201298710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=726ba71e-a198-4d29-8428-875e84840ff4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46cd207e36a345ea99827fb7a47d4beb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:10:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:10:56Z,use_quota=True,user_id='2557d17148e14250a0a29f8e76ecfbdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-404e249b-5496-4f75-b4a8-bb6c9a5efa8e tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b844c7d5-dcd6-4dd7-9144-16488b0a48b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-404e249b-5496-4f75-b4a8-bb6c9a5efa8e tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b844c7d5-dcd6-4dd7-9144-16488b0a48b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-404e249b-5496-4f75-b4a8-bb6c9a5efa8e tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79fae4a5-95ef-48d9-824e-ad971e8406de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-404e249b-5496-4f75-b4a8-bb6c9a5efa8e tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79fae4a5-95ef-48d9-824e-ad971e8406de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '726ba71e-a198-4d29-8428-875e84840ff4', 'volume_name': 'volume-726ba71e-a198-4d29-8428-875e84840ff4', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-404e249b-5496-4f75-b4a8-bb6c9a5efa8e tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a19e96c-1e68-461e-84a6-39bbc70f879e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-404e249b-5496-4f75-b4a8-bb6c9a5efa8e tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a19e96c-1e68-461e-84a6-39bbc70f879e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-404e249b-5496-4f75-b4a8-bb6c9a5efa8e tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81bdf4a2-b112-4495-b79a-5ed9ef983d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:56 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-404e249b-5496-4f75-b4a8-bb6c9a5efa8e tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Volume 726ba71e-a198-4d29-8428-875e84840ff4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-726ba71e-a198-4d29-8428-875e84840ff4', 'volume_size': 1} Sep 23 00:10:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-404e249b-5496-4f75-b4a8-bb6c9a5efa8e tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:10:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-404e249b-5496-4f75-b4a8-bb6c9a5efa8e tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:10:56 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-404e249b-5496-4f75-b4a8-bb6c9a5efa8e tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:10:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-201298710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=726ba71e-a198-4d29-8428-875e84840ff4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46cd207e36a345ea99827fb7a47d4beb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:10:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:10:56Z,use_quota=True,user_id='2557d17148e14250a0a29f8e76ecfbdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:10:56 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-404e249b-5496-4f75-b4a8-bb6c9a5efa8e tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Creating volume 726ba71e-a198-4d29-8428-875e84840ff4 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:10:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-404e249b-5496-4f75-b4a8-bb6c9a5efa8e tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:10:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-404e249b-5496-4f75-b4a8-bb6c9a5efa8e tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:10:56 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-404e249b-5496-4f75-b4a8-bb6c9a5efa8e tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:10:56 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-404e249b-5496-4f75-b4a8-bb6c9a5efa8e tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:10:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-404e249b-5496-4f75-b4a8-bb6c9a5efa8e tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:10:56 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-404e249b-5496-4f75-b4a8-bb6c9a5efa8e tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:10:56 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-404e249b-5496-4f75-b4a8-bb6c9a5efa8e tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:10:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-404e249b-5496-4f75-b4a8-bb6c9a5efa8e tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-726ba71e-a198-4d29-8428-875e84840ff4 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:56 devstack sudo[88759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-726ba71e-a198-4d29-8428-875e84840ff4 1073741824 Sep 23 00:10:56 devstack sudo[88759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:57 devstack sudo[88759]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-404e249b-5496-4f75-b4a8-bb6c9a5efa8e tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-726ba71e-a198-4d29-8428-875e84840ff4 1073741824" returned: 0 in 0.708s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-404e249b-5496-4f75-b4a8-bb6c9a5efa8e tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-726ba71e-a198-4d29-8428-875e84840ff4 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:57 devstack sudo[88773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-726ba71e-a198-4d29-8428-875e84840ff4 Sep 23 00:10:57 devstack sudo[88773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:58 devstack sudo[88773]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-404e249b-5496-4f75-b4a8-bb6c9a5efa8e tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-726ba71e-a198-4d29-8428-875e84840ff4" returned: 0 in 0.656s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:58 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-404e249b-5496-4f75-b4a8-bb6c9a5efa8e tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] <== create_volume: return (1470ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:10:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-404e249b-5496-4f75-b4a8-bb6c9a5efa8e tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.476s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:10:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-404e249b-5496-4f75-b4a8-bb6c9a5efa8e tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81bdf4a2-b112-4495-b79a-5ed9ef983d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-726ba71e-a198-4d29-8428-875e84840ff4', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-404e249b-5496-4f75-b4a8-bb6c9a5efa8e tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2597d4ed-7315-45a4-a451-8b547baca9cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:58 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-404e249b-5496-4f75-b4a8-bb6c9a5efa8e tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Volume volume-726ba71e-a198-4d29-8428-875e84840ff4 (726ba71e-a198-4d29-8428-875e84840ff4): created successfully Sep 23 00:10:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-404e249b-5496-4f75-b4a8-bb6c9a5efa8e tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2597d4ed-7315-45a4-a451-8b547baca9cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-404e249b-5496-4f75-b4a8-bb6c9a5efa8e tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Flow 'volume_create_manager' (530455a4-7c1f-4de0-812c-5fd4013883b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:10:58 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-404e249b-5496-4f75-b4a8-bb6c9a5efa8e tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Created volume successfully. Sep 23 00:10:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-430a709f-9087-4374-907b-8f8417d13205 tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:10:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-430a709f-9087-4374-907b-8f8417d13205 tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:10:58 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-430a709f-9087-4374-907b-8f8417d13205 tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Creating offline snapshot b54d9db3-0fb9-4168-bc65-bbf9136cab2c of volume 726ba71e-a198-4d29-8428-875e84840ff4 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:10:58 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7bd184-6610-4e24-b36b-5f8b7c1277f8]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:10:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-430a709f-9087-4374-907b-8f8417d13205 tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-726ba71e-a198-4d29-8428-875e84840ff4 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:59 devstack sudo[88841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-726ba71e-a198-4d29-8428-875e84840ff4 Sep 23 00:10:59 devstack sudo[88841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:59 devstack sudo[88841]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-430a709f-9087-4374-907b-8f8417d13205 tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-726ba71e-a198-4d29-8428-875e84840ff4" returned: 0 in 0.529s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-430a709f-9087-4374-907b-8f8417d13205 tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-726ba71e-a198-4d29-8428-875e84840ff4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-726ba71e-a198-4d29-8428-875e84840ff4.b54d9db3-0fb9-4168-bc65-bbf9136cab2c 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:59 devstack sudo[88846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-726ba71e-a198-4d29-8428-875e84840ff4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-726ba71e-a198-4d29-8428-875e84840ff4.b54d9db3-0fb9-4168-bc65-bbf9136cab2c 1G Sep 23 00:10:59 devstack sudo[88846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:00 devstack sudo[88846]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-430a709f-9087-4374-907b-8f8417d13205 tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-726ba71e-a198-4d29-8428-875e84840ff4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-726ba71e-a198-4d29-8428-875e84840ff4.b54d9db3-0fb9-4168-bc65-bbf9136cab2c 1G" returned: 0 in 0.578s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-430a709f-9087-4374-907b-8f8417d13205 tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-726ba71e-a198-4d29-8428-875e84840ff4 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-726ba71e-a198-4d29-8428-875e84840ff4.b54d9db3-0fb9-4168-bc65-bbf9136cab2c {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:00 devstack sudo[88853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-726ba71e-a198-4d29-8428-875e84840ff4 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-726ba71e-a198-4d29-8428-875e84840ff4.b54d9db3-0fb9-4168-bc65-bbf9136cab2c Sep 23 00:11:00 devstack sudo[88853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:00 devstack sudo[88853]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-430a709f-9087-4374-907b-8f8417d13205 tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-726ba71e-a198-4d29-8428-875e84840ff4 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-726ba71e-a198-4d29-8428-875e84840ff4.b54d9db3-0fb9-4168-bc65-bbf9136cab2c" returned: 0 in 0.464s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:00 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-430a709f-9087-4374-907b-8f8417d13205 tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-726ba71e-a198-4d29-8428-875e84840ff4.b54d9db3-0fb9-4168-bc65-bbf9136cab2c is being set with open permissions: ugo+rw Sep 23 00:11:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-430a709f-9087-4374-907b-8f8417d13205 tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-726ba71e-a198-4d29-8428-875e84840ff4.b54d9db3-0fb9-4168-bc65-bbf9136cab2c {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:00 devstack sudo[88859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-726ba71e-a198-4d29-8428-875e84840ff4.b54d9db3-0fb9-4168-bc65-bbf9136cab2c Sep 23 00:11:00 devstack sudo[88859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:01 devstack sudo[88859]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-430a709f-9087-4374-907b-8f8417d13205 tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-726ba71e-a198-4d29-8428-875e84840ff4.b54d9db3-0fb9-4168-bc65-bbf9136cab2c" returned: 0 in 0.541s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-430a709f-9087-4374-907b-8f8417d13205 tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-726ba71e-a198-4d29-8428-875e84840ff4.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:01 devstack sudo[88866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-726ba71e-a198-4d29-8428-875e84840ff4.info Sep 23 00:11:01 devstack sudo[88866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:01 devstack sudo[88866]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-430a709f-9087-4374-907b-8f8417d13205 tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-726ba71e-a198-4d29-8428-875e84840ff4.info" returned: 0 in 0.480s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:01 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-430a709f-9087-4374-907b-8f8417d13205 tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-726ba71e-a198-4d29-8428-875e84840ff4.info is being set with open permissions: ugo+rw Sep 23 00:11:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-430a709f-9087-4374-907b-8f8417d13205 tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-726ba71e-a198-4d29-8428-875e84840ff4.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:01 devstack sudo[88869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-726ba71e-a198-4d29-8428-875e84840ff4.info Sep 23 00:11:01 devstack sudo[88869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:02 devstack sudo[88869]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-430a709f-9087-4374-907b-8f8417d13205 tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-726ba71e-a198-4d29-8428-875e84840ff4.info" returned: 0 in 0.539s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-430a709f-9087-4374-907b-8f8417d13205 tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.378s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:11:02 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-430a709f-9087-4374-907b-8f8417d13205 tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Create snapshot completed successfully Sep 23 00:11:04 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-845adf57-f603-4873-b5dc-aaec50002867 tempest-DeleteServersTestJSON-1435765606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:11:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-845adf57-f603-4873-b5dc-aaec50002867 tempest-DeleteServersTestJSON-1435765606 None] Flow 'volume_create_manager' (ffb29698-998c-44c1-9aa6-ca5c0bf0d5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:11:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-845adf57-f603-4873-b5dc-aaec50002867 tempest-DeleteServersTestJSON-1435765606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dace4f3-ba64-4fb5-acfc-f4539f103077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:04 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-df81c64a-1505-4792-9f88-34a590af3515 tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Acquiring lock "cinder-b54d9db3-0fb9-4168-bc65-bbf9136cab2c-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:11:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-845adf57-f603-4873-b5dc-aaec50002867 tempest-DeleteServersTestJSON-1435765606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dace4f3-ba64-4fb5-acfc-f4539f103077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-120206950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d07a809-7f86-497e-b321-62c77ed242fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87216d160ebe4a0fb9154ba42e46f06b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:11:05Z,use_quota=True,user_id='518d276401734a5fb47dfe1c0fca3228',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-845adf57-f603-4873-b5dc-aaec50002867 tempest-DeleteServersTestJSON-1435765606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16d66bb7-1313-4548-811e-a5993d32ce6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-845adf57-f603-4873-b5dc-aaec50002867 tempest-DeleteServersTestJSON-1435765606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16d66bb7-1313-4548-811e-a5993d32ce6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-845adf57-f603-4873-b5dc-aaec50002867 tempest-DeleteServersTestJSON-1435765606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87b3c355-37b6-4e95-a199-89ddc64e4191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-845adf57-f603-4873-b5dc-aaec50002867 tempest-DeleteServersTestJSON-1435765606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87b3c355-37b6-4e95-a199-89ddc64e4191) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d07a809-7f86-497e-b321-62c77ed242fe', 'volume_name': 'volume-2d07a809-7f86-497e-b321-62c77ed242fe', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-845adf57-f603-4873-b5dc-aaec50002867 tempest-DeleteServersTestJSON-1435765606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50748c12-84dd-4be2-8795-c43dcdb41135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-845adf57-f603-4873-b5dc-aaec50002867 tempest-DeleteServersTestJSON-1435765606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50748c12-84dd-4be2-8795-c43dcdb41135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-845adf57-f603-4873-b5dc-aaec50002867 tempest-DeleteServersTestJSON-1435765606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bcf3438-eb53-4a74-bf62-a5dd0ccf283e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:04 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-845adf57-f603-4873-b5dc-aaec50002867 tempest-DeleteServersTestJSON-1435765606 None] Volume 2d07a809-7f86-497e-b321-62c77ed242fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d07a809-7f86-497e-b321-62c77ed242fe', 'volume_size': 1} Sep 23 00:11:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-845adf57-f603-4873-b5dc-aaec50002867 tempest-DeleteServersTestJSON-1435765606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:11:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-845adf57-f603-4873-b5dc-aaec50002867 tempest-DeleteServersTestJSON-1435765606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:11:04 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-845adf57-f603-4873-b5dc-aaec50002867 tempest-DeleteServersTestJSON-1435765606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-120206950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d07a809-7f86-497e-b321-62c77ed242fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87216d160ebe4a0fb9154ba42e46f06b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:11:05Z,use_quota=True,user_id='518d276401734a5fb47dfe1c0fca3228',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:11:04 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-845adf57-f603-4873-b5dc-aaec50002867 tempest-DeleteServersTestJSON-1435765606 None] Creating volume 2d07a809-7f86-497e-b321-62c77ed242fe {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:11:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-845adf57-f603-4873-b5dc-aaec50002867 tempest-DeleteServersTestJSON-1435765606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:11:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-845adf57-f603-4873-b5dc-aaec50002867 tempest-DeleteServersTestJSON-1435765606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:11:04 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-845adf57-f603-4873-b5dc-aaec50002867 tempest-DeleteServersTestJSON-1435765606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:11:04 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-845adf57-f603-4873-b5dc-aaec50002867 tempest-DeleteServersTestJSON-1435765606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:11:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-845adf57-f603-4873-b5dc-aaec50002867 tempest-DeleteServersTestJSON-1435765606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:11:04 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-845adf57-f603-4873-b5dc-aaec50002867 tempest-DeleteServersTestJSON-1435765606 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:11:04 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-845adf57-f603-4873-b5dc-aaec50002867 tempest-DeleteServersTestJSON-1435765606 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:11:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-845adf57-f603-4873-b5dc-aaec50002867 tempest-DeleteServersTestJSON-1435765606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2d07a809-7f86-497e-b321-62c77ed242fe 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:04 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-df81c64a-1505-4792-9f88-34a590af3515 tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Lock "cinder-b54d9db3-0fb9-4168-bc65-bbf9136cab2c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.125s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:11:04 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-df81c64a-1505-4792-9f88-34a590af3515 tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Acquiring lock "cinder-quobyte-726ba71e-a198-4d29-8428-875e84840ff4" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:11:04 devstack sudo[88914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2d07a809-7f86-497e-b321-62c77ed242fe 1073741824 Sep 23 00:11:04 devstack sudo[88914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:04 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-df81c64a-1505-4792-9f88-34a590af3515 tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Lock "cinder-quobyte-726ba71e-a198-4d29-8428-875e84840ff4" acquired by "delete_snapshot" :: waited 0.048s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:11:04 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-df81c64a-1505-4792-9f88-34a590af3515 tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Acquiring lock "cinder-quobyte-b54d9db3-0fb9-4168-bc65-bbf9136cab2c" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:11:04 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-df81c64a-1505-4792-9f88-34a590af3515 tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Lock "cinder-quobyte-b54d9db3-0fb9-4168-bc65-bbf9136cab2c" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:11:05 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-df81c64a-1505-4792-9f88-34a590af3515 tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Deleting offline snapshot b54d9db3-0fb9-4168-bc65-bbf9136cab2c of volume 726ba71e-a198-4d29-8428-875e84840ff4 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:11:05 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-df81c64a-1505-4792-9f88-34a590af3515 tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] snapshot_file for this snap is: volume-726ba71e-a198-4d29-8428-875e84840ff4.b54d9db3-0fb9-4168-bc65-bbf9136cab2c {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:11:05 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ecf4e5b-0d29-4585-8a0d-e58ace9de61e]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:11:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-df81c64a-1505-4792-9f88-34a590af3515 tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-726ba71e-a198-4d29-8428-875e84840ff4.b54d9db3-0fb9-4168-bc65-bbf9136cab2c {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:05 devstack sudo[88918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-726ba71e-a198-4d29-8428-875e84840ff4.b54d9db3-0fb9-4168-bc65-bbf9136cab2c Sep 23 00:11:05 devstack sudo[88918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:05 devstack sudo[88914]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-845adf57-f603-4873-b5dc-aaec50002867 tempest-DeleteServersTestJSON-1435765606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2d07a809-7f86-497e-b321-62c77ed242fe 1073741824" returned: 0 in 0.967s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-845adf57-f603-4873-b5dc-aaec50002867 tempest-DeleteServersTestJSON-1435765606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2d07a809-7f86-497e-b321-62c77ed242fe {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:05 devstack sudo[88952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2d07a809-7f86-497e-b321-62c77ed242fe Sep 23 00:11:05 devstack sudo[88952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:06 devstack sudo[88918]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-df81c64a-1505-4792-9f88-34a590af3515 tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-726ba71e-a198-4d29-8428-875e84840ff4.b54d9db3-0fb9-4168-bc65-bbf9136cab2c" returned: 0 in 1.194s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-df81c64a-1505-4792-9f88-34a590af3515 tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-726ba71e-a198-4d29-8428-875e84840ff4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:11:06 devstack sudo[88952]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-845adf57-f603-4873-b5dc-aaec50002867 tempest-DeleteServersTestJSON-1435765606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2d07a809-7f86-497e-b321-62c77ed242fe" returned: 0 in 0.459s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-845adf57-f603-4873-b5dc-aaec50002867 tempest-DeleteServersTestJSON-1435765606 None] <== create_volume: return (1526ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:11:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-845adf57-f603-4873-b5dc-aaec50002867 tempest-DeleteServersTestJSON-1435765606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.530s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:11:06 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[73430eaa-48b0-45d6-97a2-2b7167114908]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:11:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-df81c64a-1505-4792-9f88-34a590af3515 tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-726ba71e-a198-4d29-8428-875e84840ff4 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-845adf57-f603-4873-b5dc-aaec50002867 tempest-DeleteServersTestJSON-1435765606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bcf3438-eb53-4a74-bf62-a5dd0ccf283e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d07a809-7f86-497e-b321-62c77ed242fe', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-845adf57-f603-4873-b5dc-aaec50002867 tempest-DeleteServersTestJSON-1435765606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1fefa4f-0a6f-4e2b-b0c9-75061e95fb32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:06 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-845adf57-f603-4873-b5dc-aaec50002867 tempest-DeleteServersTestJSON-1435765606 None] Volume volume-2d07a809-7f86-497e-b321-62c77ed242fe (2d07a809-7f86-497e-b321-62c77ed242fe): created successfully Sep 23 00:11:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-845adf57-f603-4873-b5dc-aaec50002867 tempest-DeleteServersTestJSON-1435765606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1fefa4f-0a6f-4e2b-b0c9-75061e95fb32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-845adf57-f603-4873-b5dc-aaec50002867 tempest-DeleteServersTestJSON-1435765606 None] Flow 'volume_create_manager' (ffb29698-998c-44c1-9aa6-ca5c0bf0d5fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:11:06 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-845adf57-f603-4873-b5dc-aaec50002867 tempest-DeleteServersTestJSON-1435765606 None] Created volume successfully. Sep 23 00:11:06 devstack sudo[88959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-726ba71e-a198-4d29-8428-875e84840ff4 Sep 23 00:11:06 devstack sudo[88959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:07 devstack sudo[88959]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-df81c64a-1505-4792-9f88-34a590af3515 tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-726ba71e-a198-4d29-8428-875e84840ff4" returned: 0 in 1.043s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-df81c64a-1505-4792-9f88-34a590af3515 tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-726ba71e-a198-4d29-8428-875e84840ff4.b54d9db3-0fb9-4168-bc65-bbf9136cab2c {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:07 devstack sudo[88966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-726ba71e-a198-4d29-8428-875e84840ff4.b54d9db3-0fb9-4168-bc65-bbf9136cab2c Sep 23 00:11:07 devstack sudo[88966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:08 devstack sudo[88966]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-df81c64a-1505-4792-9f88-34a590af3515 tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-726ba71e-a198-4d29-8428-875e84840ff4.b54d9db3-0fb9-4168-bc65-bbf9136cab2c" returned: 0 in 0.859s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-df81c64a-1505-4792-9f88-34a590af3515 tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-726ba71e-a198-4d29-8428-875e84840ff4.b54d9db3-0fb9-4168-bc65-bbf9136cab2c {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:08 devstack sudo[88980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-726ba71e-a198-4d29-8428-875e84840ff4.b54d9db3-0fb9-4168-bc65-bbf9136cab2c Sep 23 00:11:08 devstack sudo[88980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:09 devstack sudo[88980]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-df81c64a-1505-4792-9f88-34a590af3515 tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-726ba71e-a198-4d29-8428-875e84840ff4.b54d9db3-0fb9-4168-bc65-bbf9136cab2c" returned: 0 in 0.866s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:09 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-df81c64a-1505-4792-9f88-34a590af3515 tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Lock "cinder-quobyte-b54d9db3-0fb9-4168-bc65-bbf9136cab2c" released by "_delete_snapshot" :: held 4.294s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:11:09 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-df81c64a-1505-4792-9f88-34a590af3515 tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Lock "cinder-quobyte-726ba71e-a198-4d29-8428-875e84840ff4" released by "delete_snapshot" :: held 4.375s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:11:09 devstack cinder-volume[86591]: WARNING cinder.quota [None req-df81c64a-1505-4792-9f88-34a590af3515 tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:11:09 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-df81c64a-1505-4792-9f88-34a590af3515 tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Created reservations ['ce553609-ad9f-4f0d-8a58-c0edf99b3827', '4fddd248-2119-43a6-a56c-c950134f3d4c', '8cc1d932-c217-489c-b095-0b0eed629f67', '2343b9cf-3656-4588-b6e9-458d863cfd6b'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:11:09 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-df81c64a-1505-4792-9f88-34a590af3515 tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Delete snapshot completed successfully. Sep 23 00:11:09 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-df81c64a-1505-4792-9f88-34a590af3515 tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Lock "cinder-b54d9db3-0fb9-4168-bc65-bbf9136cab2c-delete_snapshot" released by "delete_snapshot" :: held 4.901s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:11:10 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b9263c4f-2492-480e-afdc-0dccd70e1bdd tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Acquiring lock "cinder-726ba71e-a198-4d29-8428-875e84840ff4-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:11:10 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b9263c4f-2492-480e-afdc-0dccd70e1bdd tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Lock "cinder-726ba71e-a198-4d29-8428-875e84840ff4-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:11:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-ee8d46ec-7cd2-4421-a051-3bd5c386644f req-e58b4343-0391-4ba9-9a7a-cfd6a6664cfc tempest-DeleteServersTestJSON-1435765606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:11:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-ee8d46ec-7cd2-4421-a051-3bd5c386644f req-e58b4343-0391-4ba9-9a7a-cfd6a6664cfc tempest-DeleteServersTestJSON-1435765606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:11:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-ee8d46ec-7cd2-4421-a051-3bd5c386644f req-e58b4343-0391-4ba9-9a7a-cfd6a6664cfc tempest-DeleteServersTestJSON-1435765606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.060s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:11:10 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b9263c4f-2492-480e-afdc-0dccd70e1bdd tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Acquiring lock "cinder-quobyte-726ba71e-a198-4d29-8428-875e84840ff4" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:11:10 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b9263c4f-2492-480e-afdc-0dccd70e1bdd tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Lock "cinder-quobyte-726ba71e-a198-4d29-8428-875e84840ff4" acquired by "delete_volume" :: waited 0.028s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:11:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-ee8d46ec-7cd2-4421-a051-3bd5c386644f req-e58b4343-0391-4ba9-9a7a-cfd6a6664cfc tempest-DeleteServersTestJSON-1435765606 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974', 'name': 'volume-2d07a809-7f86-497e-b321-62c77ed242fe', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b923b91c-620d-4e38-a669-e913055ac2a5', 'enforce_multipath': True} {{(pid=86591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:11:11 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[816378ad-f111-40ff-ab2b-4025284ca3bb]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:11:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b9263c4f-2492-480e-afdc-0dccd70e1bdd tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-726ba71e-a198-4d29-8428-875e84840ff4 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:11 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-ee8d46ec-7cd2-4421-a051-3bd5c386644f req-e58b4343-0391-4ba9-9a7a-cfd6a6664cfc tempest-DeleteServersTestJSON-1435765606 None] attachment_update completed successfully. Sep 23 00:11:11 devstack sudo[88996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-726ba71e-a198-4d29-8428-875e84840ff4 Sep 23 00:11:11 devstack sudo[88996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:12 devstack sudo[88996]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b9263c4f-2492-480e-afdc-0dccd70e1bdd tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-726ba71e-a198-4d29-8428-875e84840ff4" returned: 0 in 1.008s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b9263c4f-2492-480e-afdc-0dccd70e1bdd tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-726ba71e-a198-4d29-8428-875e84840ff4 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:12 devstack sudo[89005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-726ba71e-a198-4d29-8428-875e84840ff4 Sep 23 00:11:12 devstack sudo[89005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:12 devstack sudo[89005]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b9263c4f-2492-480e-afdc-0dccd70e1bdd tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-726ba71e-a198-4d29-8428-875e84840ff4" returned: 0 in 0.669s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:12 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b9263c4f-2492-480e-afdc-0dccd70e1bdd tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Lock "cinder-quobyte-726ba71e-a198-4d29-8428-875e84840ff4" released by "delete_volume" :: held 1.835s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:11:12 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-b9263c4f-2492-480e-afdc-0dccd70e1bdd tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Created reservations ['9f9977b8-bebf-41c4-a462-5cff35a25ad7', '036c8b98-703c-4d14-bb57-7856f8b4c5c0', 'a06203bd-e761-4872-bf48-3c954ad36f29', '7afee13b-98c3-44f6-bd97-f1c0c19fd68e'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:11:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b9263c4f-2492-480e-afdc-0dccd70e1bdd tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:11:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b9263c4f-2492-480e-afdc-0dccd70e1bdd tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:11:13 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b9263c4f-2492-480e-afdc-0dccd70e1bdd tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:11:13 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b9263c4f-2492-480e-afdc-0dccd70e1bdd tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:11:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b9263c4f-2492-480e-afdc-0dccd70e1bdd tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:11:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b9263c4f-2492-480e-afdc-0dccd70e1bdd tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:13 devstack sudo[89008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:11:13 devstack sudo[89008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:13 devstack sudo[89008]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b9263c4f-2492-480e-afdc-0dccd70e1bdd tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.608s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:13 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-b9263c4f-2492-480e-afdc-0dccd70e1bdd tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:11:13 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-b9263c4f-2492-480e-afdc-0dccd70e1bdd tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Deleted volume successfully. Sep 23 00:11:13 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b9263c4f-2492-480e-afdc-0dccd70e1bdd tempest-VolumeSnapshotQuotasNegativeTestJSON-863693122 None] Lock "cinder-726ba71e-a198-4d29-8428-875e84840ff4-delete_volume" released by "delete_volume" :: held 3.009s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:11:16 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-c1241cd1-3b33-47d4-9ce9-886a8649799d req-a0ba2700-b6fc-4a1c-b42f-afb7edb6e097 tempest-DeleteServersTestJSON-1435765606 None] Terminate volume connection completed successfully. Sep 23 00:11:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-c1241cd1-3b33-47d4-9ce9-886a8649799d req-a0ba2700-b6fc-4a1c-b42f-afb7edb6e097 tempest-DeleteServersTestJSON-1435765606 None] Deleting attachment b923b91c-620d-4e38-a669-e913055ac2a5. {{(pid=86591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:11:16 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:11:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:11:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:11:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:11:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:11:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:11:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:16 devstack sudo[89042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:11:16 devstack sudo[89042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:17 devstack sudo[89042]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.552s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:17 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:11:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-628e34c9-978a-4506-b5f0-0451fe21da57 tempest-DeleteServersTestJSON-1435765606 None] Acquiring lock "cinder-2d07a809-7f86-497e-b321-62c77ed242fe-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:11:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-628e34c9-978a-4506-b5f0-0451fe21da57 tempest-DeleteServersTestJSON-1435765606 None] Lock "cinder-2d07a809-7f86-497e-b321-62c77ed242fe-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:11:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-628e34c9-978a-4506-b5f0-0451fe21da57 tempest-DeleteServersTestJSON-1435765606 None] Acquiring lock "cinder-quobyte-2d07a809-7f86-497e-b321-62c77ed242fe" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:11:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-628e34c9-978a-4506-b5f0-0451fe21da57 tempest-DeleteServersTestJSON-1435765606 None] Lock "cinder-quobyte-2d07a809-7f86-497e-b321-62c77ed242fe" acquired by "delete_volume" :: waited 0.029s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:11:19 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aefe49f-f0a0-47fa-a1fd-6b1a58d9f9f0]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:11:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-628e34c9-978a-4506-b5f0-0451fe21da57 tempest-DeleteServersTestJSON-1435765606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2d07a809-7f86-497e-b321-62c77ed242fe {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:19 devstack sudo[89055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2d07a809-7f86-497e-b321-62c77ed242fe Sep 23 00:11:19 devstack sudo[89055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:20 devstack sudo[89055]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-628e34c9-978a-4506-b5f0-0451fe21da57 tempest-DeleteServersTestJSON-1435765606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2d07a809-7f86-497e-b321-62c77ed242fe" returned: 0 in 0.681s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-628e34c9-978a-4506-b5f0-0451fe21da57 tempest-DeleteServersTestJSON-1435765606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2d07a809-7f86-497e-b321-62c77ed242fe {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:20 devstack sudo[89060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2d07a809-7f86-497e-b321-62c77ed242fe Sep 23 00:11:20 devstack sudo[89060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:20 devstack sudo[89060]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-628e34c9-978a-4506-b5f0-0451fe21da57 tempest-DeleteServersTestJSON-1435765606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2d07a809-7f86-497e-b321-62c77ed242fe" returned: 0 in 0.487s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:20 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-628e34c9-978a-4506-b5f0-0451fe21da57 tempest-DeleteServersTestJSON-1435765606 None] Lock "cinder-quobyte-2d07a809-7f86-497e-b321-62c77ed242fe" released by "delete_volume" :: held 1.237s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:11:20 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-628e34c9-978a-4506-b5f0-0451fe21da57 tempest-DeleteServersTestJSON-1435765606 None] Created reservations ['d2da8aa2-872c-4a7a-b7ee-1c743b4e5a78', '58442dd0-361a-4280-9cc1-d12dd1d1cc5a', 'd7f67ff6-3f00-485e-b93a-7be3a2a4c717', 'd4798a08-add9-4776-a962-0a6697c7c783'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:11:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-628e34c9-978a-4506-b5f0-0451fe21da57 tempest-DeleteServersTestJSON-1435765606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:11:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-628e34c9-978a-4506-b5f0-0451fe21da57 tempest-DeleteServersTestJSON-1435765606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:11:20 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-628e34c9-978a-4506-b5f0-0451fe21da57 tempest-DeleteServersTestJSON-1435765606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:11:20 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-628e34c9-978a-4506-b5f0-0451fe21da57 tempest-DeleteServersTestJSON-1435765606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:11:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-628e34c9-978a-4506-b5f0-0451fe21da57 tempest-DeleteServersTestJSON-1435765606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:11:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-628e34c9-978a-4506-b5f0-0451fe21da57 tempest-DeleteServersTestJSON-1435765606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:20 devstack sudo[89063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:11:20 devstack sudo[89063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:21 devstack sudo[89063]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-628e34c9-978a-4506-b5f0-0451fe21da57 tempest-DeleteServersTestJSON-1435765606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.413s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:21 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-628e34c9-978a-4506-b5f0-0451fe21da57 tempest-DeleteServersTestJSON-1435765606 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:11:21 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-628e34c9-978a-4506-b5f0-0451fe21da57 tempest-DeleteServersTestJSON-1435765606 None] Deleted volume successfully. Sep 23 00:11:21 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-628e34c9-978a-4506-b5f0-0451fe21da57 tempest-DeleteServersTestJSON-1435765606 None] Lock "cinder-2d07a809-7f86-497e-b321-62c77ed242fe-delete_volume" released by "delete_volume" :: held 2.070s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:11:25 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-5647cc07-24c3-429d-acf1-3b3f9c5ac5c2 tempest-VolumesListAdminTestJSON-1893521726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:11:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5647cc07-24c3-429d-acf1-3b3f9c5ac5c2 tempest-VolumesListAdminTestJSON-1893521726 None] Flow 'volume_create_manager' (9fe55504-8eeb-4bc8-b28c-62c4cc343983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:11:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5647cc07-24c3-429d-acf1-3b3f9c5ac5c2 tempest-VolumesListAdminTestJSON-1893521726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aadebcbc-5dce-4772-9ffb-994a4e90068e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5647cc07-24c3-429d-acf1-3b3f9c5ac5c2 tempest-VolumesListAdminTestJSON-1893521726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aadebcbc-5dce-4772-9ffb-994a4e90068e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:11:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1232868967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd394fb0-5168-478d-a753-24922c9f24a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b65840b0b342425fa996465d905d155d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:11:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:11:25Z,use_quota=True,user_id='785e461689ae473c808b4747ea192f8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5647cc07-24c3-429d-acf1-3b3f9c5ac5c2 tempest-VolumesListAdminTestJSON-1893521726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c65d33cd-701c-4c27-a421-d8873529a633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5647cc07-24c3-429d-acf1-3b3f9c5ac5c2 tempest-VolumesListAdminTestJSON-1893521726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c65d33cd-701c-4c27-a421-d8873529a633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5647cc07-24c3-429d-acf1-3b3f9c5ac5c2 tempest-VolumesListAdminTestJSON-1893521726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4916cac-3b50-4744-b14d-83adae3ad6a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5647cc07-24c3-429d-acf1-3b3f9c5ac5c2 tempest-VolumesListAdminTestJSON-1893521726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4916cac-3b50-4744-b14d-83adae3ad6a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd394fb0-5168-478d-a753-24922c9f24a8', 'volume_name': 'volume-bd394fb0-5168-478d-a753-24922c9f24a8', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5647cc07-24c3-429d-acf1-3b3f9c5ac5c2 tempest-VolumesListAdminTestJSON-1893521726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5c04cba-58cc-4f01-86e1-5eb4b5f1631e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5647cc07-24c3-429d-acf1-3b3f9c5ac5c2 tempest-VolumesListAdminTestJSON-1893521726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5c04cba-58cc-4f01-86e1-5eb4b5f1631e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5647cc07-24c3-429d-acf1-3b3f9c5ac5c2 tempest-VolumesListAdminTestJSON-1893521726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b980ffed-66bc-4987-adfc-09947167436e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:25 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-5647cc07-24c3-429d-acf1-3b3f9c5ac5c2 tempest-VolumesListAdminTestJSON-1893521726 None] Volume bd394fb0-5168-478d-a753-24922c9f24a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd394fb0-5168-478d-a753-24922c9f24a8', 'volume_size': 1} Sep 23 00:11:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5647cc07-24c3-429d-acf1-3b3f9c5ac5c2 tempest-VolumesListAdminTestJSON-1893521726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:11:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5647cc07-24c3-429d-acf1-3b3f9c5ac5c2 tempest-VolumesListAdminTestJSON-1893521726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:11:25 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5647cc07-24c3-429d-acf1-3b3f9c5ac5c2 tempest-VolumesListAdminTestJSON-1893521726 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:11:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1232868967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd394fb0-5168-478d-a753-24922c9f24a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b65840b0b342425fa996465d905d155d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:11:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:11:25Z,use_quota=True,user_id='785e461689ae473c808b4747ea192f8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:11:25 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-5647cc07-24c3-429d-acf1-3b3f9c5ac5c2 tempest-VolumesListAdminTestJSON-1893521726 None] Creating volume bd394fb0-5168-478d-a753-24922c9f24a8 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:11:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5647cc07-24c3-429d-acf1-3b3f9c5ac5c2 tempest-VolumesListAdminTestJSON-1893521726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:11:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5647cc07-24c3-429d-acf1-3b3f9c5ac5c2 tempest-VolumesListAdminTestJSON-1893521726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:11:25 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5647cc07-24c3-429d-acf1-3b3f9c5ac5c2 tempest-VolumesListAdminTestJSON-1893521726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:11:25 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5647cc07-24c3-429d-acf1-3b3f9c5ac5c2 tempest-VolumesListAdminTestJSON-1893521726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:11:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5647cc07-24c3-429d-acf1-3b3f9c5ac5c2 tempest-VolumesListAdminTestJSON-1893521726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:11:25 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5647cc07-24c3-429d-acf1-3b3f9c5ac5c2 tempest-VolumesListAdminTestJSON-1893521726 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:11:25 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-5647cc07-24c3-429d-acf1-3b3f9c5ac5c2 tempest-VolumesListAdminTestJSON-1893521726 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:11:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5647cc07-24c3-429d-acf1-3b3f9c5ac5c2 tempest-VolumesListAdminTestJSON-1893521726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-bd394fb0-5168-478d-a753-24922c9f24a8 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:25 devstack sudo[89095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-bd394fb0-5168-478d-a753-24922c9f24a8 1073741824 Sep 23 00:11:25 devstack sudo[89095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:25 devstack sudo[89095]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5647cc07-24c3-429d-acf1-3b3f9c5ac5c2 tempest-VolumesListAdminTestJSON-1893521726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-bd394fb0-5168-478d-a753-24922c9f24a8 1073741824" returned: 0 in 0.558s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5647cc07-24c3-429d-acf1-3b3f9c5ac5c2 tempest-VolumesListAdminTestJSON-1893521726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-bd394fb0-5168-478d-a753-24922c9f24a8 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:25 devstack sudo[89102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-bd394fb0-5168-478d-a753-24922c9f24a8 Sep 23 00:11:25 devstack sudo[89102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:26 devstack sudo[89102]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5647cc07-24c3-429d-acf1-3b3f9c5ac5c2 tempest-VolumesListAdminTestJSON-1893521726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-bd394fb0-5168-478d-a753-24922c9f24a8" returned: 0 in 0.270s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:26 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5647cc07-24c3-429d-acf1-3b3f9c5ac5c2 tempest-VolumesListAdminTestJSON-1893521726 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:11:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5647cc07-24c3-429d-acf1-3b3f9c5ac5c2 tempest-VolumesListAdminTestJSON-1893521726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:11:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5647cc07-24c3-429d-acf1-3b3f9c5ac5c2 tempest-VolumesListAdminTestJSON-1893521726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b980ffed-66bc-4987-adfc-09947167436e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd394fb0-5168-478d-a753-24922c9f24a8', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5647cc07-24c3-429d-acf1-3b3f9c5ac5c2 tempest-VolumesListAdminTestJSON-1893521726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a050ecdc-0601-4a8a-b112-d7e82a165e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:26 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-5647cc07-24c3-429d-acf1-3b3f9c5ac5c2 tempest-VolumesListAdminTestJSON-1893521726 None] Volume volume-bd394fb0-5168-478d-a753-24922c9f24a8 (bd394fb0-5168-478d-a753-24922c9f24a8): created successfully Sep 23 00:11:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5647cc07-24c3-429d-acf1-3b3f9c5ac5c2 tempest-VolumesListAdminTestJSON-1893521726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a050ecdc-0601-4a8a-b112-d7e82a165e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5647cc07-24c3-429d-acf1-3b3f9c5ac5c2 tempest-VolumesListAdminTestJSON-1893521726 None] Flow 'volume_create_manager' (9fe55504-8eeb-4bc8-b28c-62c4cc343983) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:11:26 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-5647cc07-24c3-429d-acf1-3b3f9c5ac5c2 tempest-VolumesListAdminTestJSON-1893521726 None] Created volume successfully. Sep 23 00:11:28 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-598069ad-8892-4235-93db-87510f5f0794 tempest-VolumesListAdminTestJSON-1893521726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:11:28 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-598069ad-8892-4235-93db-87510f5f0794 tempest-VolumesListAdminTestJSON-1893521726 None] Flow 'volume_create_manager' (aaf393f2-d4ae-4866-a441-671fcb6cb173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:11:28 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-598069ad-8892-4235-93db-87510f5f0794 tempest-VolumesListAdminTestJSON-1893521726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0cb687f-a8d2-4e41-94ed-1daa797a6712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:28 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-598069ad-8892-4235-93db-87510f5f0794 tempest-VolumesListAdminTestJSON-1893521726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0cb687f-a8d2-4e41-94ed-1daa797a6712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:11:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1687337986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22c63382-de97-4d9a-8589-91cb02df3377,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b65840b0b342425fa996465d905d155d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:11:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:11:28Z,use_quota=True,user_id='785e461689ae473c808b4747ea192f8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:28 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-598069ad-8892-4235-93db-87510f5f0794 tempest-VolumesListAdminTestJSON-1893521726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e47982a-cb9e-4215-b368-6897ab97f612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:28 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-598069ad-8892-4235-93db-87510f5f0794 tempest-VolumesListAdminTestJSON-1893521726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e47982a-cb9e-4215-b368-6897ab97f612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:28 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-598069ad-8892-4235-93db-87510f5f0794 tempest-VolumesListAdminTestJSON-1893521726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (423b0491-a74a-445c-8181-8371636a816e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:28 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-598069ad-8892-4235-93db-87510f5f0794 tempest-VolumesListAdminTestJSON-1893521726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (423b0491-a74a-445c-8181-8371636a816e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22c63382-de97-4d9a-8589-91cb02df3377', 'volume_name': 'volume-22c63382-de97-4d9a-8589-91cb02df3377', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:28 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-598069ad-8892-4235-93db-87510f5f0794 tempest-VolumesListAdminTestJSON-1893521726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b44b8fb-14c4-4f87-8dee-18ab38fc51ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:28 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-598069ad-8892-4235-93db-87510f5f0794 tempest-VolumesListAdminTestJSON-1893521726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b44b8fb-14c4-4f87-8dee-18ab38fc51ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:28 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-598069ad-8892-4235-93db-87510f5f0794 tempest-VolumesListAdminTestJSON-1893521726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54238f25-ea6f-4b49-aeeb-ef68a9115afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:28 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-598069ad-8892-4235-93db-87510f5f0794 tempest-VolumesListAdminTestJSON-1893521726 None] Volume 22c63382-de97-4d9a-8589-91cb02df3377: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22c63382-de97-4d9a-8589-91cb02df3377', 'volume_size': 1} Sep 23 00:11:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-598069ad-8892-4235-93db-87510f5f0794 tempest-VolumesListAdminTestJSON-1893521726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:11:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-598069ad-8892-4235-93db-87510f5f0794 tempest-VolumesListAdminTestJSON-1893521726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:11:28 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-598069ad-8892-4235-93db-87510f5f0794 tempest-VolumesListAdminTestJSON-1893521726 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:11:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1687337986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22c63382-de97-4d9a-8589-91cb02df3377,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b65840b0b342425fa996465d905d155d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:11:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:11:28Z,use_quota=True,user_id='785e461689ae473c808b4747ea192f8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:11:28 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-598069ad-8892-4235-93db-87510f5f0794 tempest-VolumesListAdminTestJSON-1893521726 None] Creating volume 22c63382-de97-4d9a-8589-91cb02df3377 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:11:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-598069ad-8892-4235-93db-87510f5f0794 tempest-VolumesListAdminTestJSON-1893521726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:11:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-598069ad-8892-4235-93db-87510f5f0794 tempest-VolumesListAdminTestJSON-1893521726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:11:28 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-598069ad-8892-4235-93db-87510f5f0794 tempest-VolumesListAdminTestJSON-1893521726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:11:28 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-598069ad-8892-4235-93db-87510f5f0794 tempest-VolumesListAdminTestJSON-1893521726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:11:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-598069ad-8892-4235-93db-87510f5f0794 tempest-VolumesListAdminTestJSON-1893521726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:11:28 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-598069ad-8892-4235-93db-87510f5f0794 tempest-VolumesListAdminTestJSON-1893521726 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:11:28 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-598069ad-8892-4235-93db-87510f5f0794 tempest-VolumesListAdminTestJSON-1893521726 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:11:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-598069ad-8892-4235-93db-87510f5f0794 tempest-VolumesListAdminTestJSON-1893521726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-22c63382-de97-4d9a-8589-91cb02df3377 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:28 devstack sudo[89109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-22c63382-de97-4d9a-8589-91cb02df3377 1073741824 Sep 23 00:11:28 devstack sudo[89109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:28 devstack sudo[89109]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-598069ad-8892-4235-93db-87510f5f0794 tempest-VolumesListAdminTestJSON-1893521726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-22c63382-de97-4d9a-8589-91cb02df3377 1073741824" returned: 0 in 0.570s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-598069ad-8892-4235-93db-87510f5f0794 tempest-VolumesListAdminTestJSON-1893521726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-22c63382-de97-4d9a-8589-91cb02df3377 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:28 devstack sudo[89115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-22c63382-de97-4d9a-8589-91cb02df3377 Sep 23 00:11:28 devstack sudo[89115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:29 devstack sudo[89115]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-598069ad-8892-4235-93db-87510f5f0794 tempest-VolumesListAdminTestJSON-1893521726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-22c63382-de97-4d9a-8589-91cb02df3377" returned: 0 in 0.339s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:29 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-598069ad-8892-4235-93db-87510f5f0794 tempest-VolumesListAdminTestJSON-1893521726 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:11:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-598069ad-8892-4235-93db-87510f5f0794 tempest-VolumesListAdminTestJSON-1893521726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:11:29 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-598069ad-8892-4235-93db-87510f5f0794 tempest-VolumesListAdminTestJSON-1893521726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54238f25-ea6f-4b49-aeeb-ef68a9115afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22c63382-de97-4d9a-8589-91cb02df3377', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:29 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-598069ad-8892-4235-93db-87510f5f0794 tempest-VolumesListAdminTestJSON-1893521726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d74eb938-45cb-494d-8469-01f51b90b4d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:29 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-598069ad-8892-4235-93db-87510f5f0794 tempest-VolumesListAdminTestJSON-1893521726 None] Volume volume-22c63382-de97-4d9a-8589-91cb02df3377 (22c63382-de97-4d9a-8589-91cb02df3377): created successfully Sep 23 00:11:29 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-598069ad-8892-4235-93db-87510f5f0794 tempest-VolumesListAdminTestJSON-1893521726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d74eb938-45cb-494d-8469-01f51b90b4d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:29 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-598069ad-8892-4235-93db-87510f5f0794 tempest-VolumesListAdminTestJSON-1893521726 None] Flow 'volume_create_manager' (aaf393f2-d4ae-4866-a441-671fcb6cb173) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:11:29 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-598069ad-8892-4235-93db-87510f5f0794 tempest-VolumesListAdminTestJSON-1893521726 None] Created volume successfully. Sep 23 00:11:31 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-49535264-e536-46f7-9880-1be350394cae tempest-VolumesListAdminTestJSON-1893521726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:11:31 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-49535264-e536-46f7-9880-1be350394cae tempest-VolumesListAdminTestJSON-1893521726 None] Flow 'volume_create_manager' (98e8d49d-04cf-483a-9c2c-2ef397bb1c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:11:31 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-49535264-e536-46f7-9880-1be350394cae tempest-VolumesListAdminTestJSON-1893521726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d2ac05f-b939-4dae-9d72-e2b02ca0deeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:31 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-49535264-e536-46f7-9880-1be350394cae tempest-VolumesListAdminTestJSON-1893521726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d2ac05f-b939-4dae-9d72-e2b02ca0deeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:11:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1968259058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a713ebd5-0360-4819-9907-ee49a03572d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b65840b0b342425fa996465d905d155d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:11:31Z,use_quota=True,user_id='785e461689ae473c808b4747ea192f8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:31 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-49535264-e536-46f7-9880-1be350394cae tempest-VolumesListAdminTestJSON-1893521726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f91c057-3a1c-4bcb-a06f-684f42b7da63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:31 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-49535264-e536-46f7-9880-1be350394cae tempest-VolumesListAdminTestJSON-1893521726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f91c057-3a1c-4bcb-a06f-684f42b7da63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:31 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-49535264-e536-46f7-9880-1be350394cae tempest-VolumesListAdminTestJSON-1893521726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1318d973-4522-46ab-b866-920a76b1ff49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:31 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-49535264-e536-46f7-9880-1be350394cae tempest-VolumesListAdminTestJSON-1893521726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1318d973-4522-46ab-b866-920a76b1ff49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a713ebd5-0360-4819-9907-ee49a03572d8', 'volume_name': 'volume-a713ebd5-0360-4819-9907-ee49a03572d8', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:31 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-49535264-e536-46f7-9880-1be350394cae tempest-VolumesListAdminTestJSON-1893521726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (effb2928-0b0d-4b91-b75e-166a2d2807cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:31 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-49535264-e536-46f7-9880-1be350394cae tempest-VolumesListAdminTestJSON-1893521726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (effb2928-0b0d-4b91-b75e-166a2d2807cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:31 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-49535264-e536-46f7-9880-1be350394cae tempest-VolumesListAdminTestJSON-1893521726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69c3e9f5-f308-40af-8547-cbfcc21f2284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:31 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-49535264-e536-46f7-9880-1be350394cae tempest-VolumesListAdminTestJSON-1893521726 None] Volume a713ebd5-0360-4819-9907-ee49a03572d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a713ebd5-0360-4819-9907-ee49a03572d8', 'volume_size': 1} Sep 23 00:11:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-49535264-e536-46f7-9880-1be350394cae tempest-VolumesListAdminTestJSON-1893521726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:11:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-49535264-e536-46f7-9880-1be350394cae tempest-VolumesListAdminTestJSON-1893521726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:11:31 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-49535264-e536-46f7-9880-1be350394cae tempest-VolumesListAdminTestJSON-1893521726 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:11:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1968259058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a713ebd5-0360-4819-9907-ee49a03572d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b65840b0b342425fa996465d905d155d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:11:31Z,use_quota=True,user_id='785e461689ae473c808b4747ea192f8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:11:31 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-49535264-e536-46f7-9880-1be350394cae tempest-VolumesListAdminTestJSON-1893521726 None] Creating volume a713ebd5-0360-4819-9907-ee49a03572d8 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:11:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-49535264-e536-46f7-9880-1be350394cae tempest-VolumesListAdminTestJSON-1893521726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:11:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-49535264-e536-46f7-9880-1be350394cae tempest-VolumesListAdminTestJSON-1893521726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:11:31 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-49535264-e536-46f7-9880-1be350394cae tempest-VolumesListAdminTestJSON-1893521726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:11:31 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-49535264-e536-46f7-9880-1be350394cae tempest-VolumesListAdminTestJSON-1893521726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:11:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-49535264-e536-46f7-9880-1be350394cae tempest-VolumesListAdminTestJSON-1893521726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:11:31 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-49535264-e536-46f7-9880-1be350394cae tempest-VolumesListAdminTestJSON-1893521726 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:11:31 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-49535264-e536-46f7-9880-1be350394cae tempest-VolumesListAdminTestJSON-1893521726 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:11:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-49535264-e536-46f7-9880-1be350394cae tempest-VolumesListAdminTestJSON-1893521726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a713ebd5-0360-4819-9907-ee49a03572d8 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:31 devstack sudo[89119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a713ebd5-0360-4819-9907-ee49a03572d8 1073741824 Sep 23 00:11:31 devstack sudo[89119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:31 devstack sudo[89119]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-49535264-e536-46f7-9880-1be350394cae tempest-VolumesListAdminTestJSON-1893521726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a713ebd5-0360-4819-9907-ee49a03572d8 1073741824" returned: 0 in 0.659s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-49535264-e536-46f7-9880-1be350394cae tempest-VolumesListAdminTestJSON-1893521726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a713ebd5-0360-4819-9907-ee49a03572d8 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:31 devstack sudo[89125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a713ebd5-0360-4819-9907-ee49a03572d8 Sep 23 00:11:31 devstack sudo[89125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:32 devstack sudo[89125]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-49535264-e536-46f7-9880-1be350394cae tempest-VolumesListAdminTestJSON-1893521726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a713ebd5-0360-4819-9907-ee49a03572d8" returned: 0 in 0.381s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:32 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-49535264-e536-46f7-9880-1be350394cae tempest-VolumesListAdminTestJSON-1893521726 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:11:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-49535264-e536-46f7-9880-1be350394cae tempest-VolumesListAdminTestJSON-1893521726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:11:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-49535264-e536-46f7-9880-1be350394cae tempest-VolumesListAdminTestJSON-1893521726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69c3e9f5-f308-40af-8547-cbfcc21f2284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a713ebd5-0360-4819-9907-ee49a03572d8', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-49535264-e536-46f7-9880-1be350394cae tempest-VolumesListAdminTestJSON-1893521726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f570c54-3f89-4d79-8f38-d70a7bea22a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:32 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-49535264-e536-46f7-9880-1be350394cae tempest-VolumesListAdminTestJSON-1893521726 None] Volume volume-a713ebd5-0360-4819-9907-ee49a03572d8 (a713ebd5-0360-4819-9907-ee49a03572d8): created successfully Sep 23 00:11:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-49535264-e536-46f7-9880-1be350394cae tempest-VolumesListAdminTestJSON-1893521726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f570c54-3f89-4d79-8f38-d70a7bea22a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-49535264-e536-46f7-9880-1be350394cae tempest-VolumesListAdminTestJSON-1893521726 None] Flow 'volume_create_manager' (98e8d49d-04cf-483a-9c2c-2ef397bb1c72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:11:32 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-49535264-e536-46f7-9880-1be350394cae tempest-VolumesListAdminTestJSON-1893521726 None] Created volume successfully. Sep 23 00:11:34 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-633a8af9-e61a-4d2b-bd05-aee3816fbbf9 tempest-VolumesListAdminTestJSON-13886898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:11:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-633a8af9-e61a-4d2b-bd05-aee3816fbbf9 tempest-VolumesListAdminTestJSON-13886898 None] Flow 'volume_create_manager' (1ad83f22-e12a-4587-82c4-10c576b3bbf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:11:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-633a8af9-e61a-4d2b-bd05-aee3816fbbf9 tempest-VolumesListAdminTestJSON-13886898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72670ac6-729d-42fd-94b0-f9f6c4219c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-633a8af9-e61a-4d2b-bd05-aee3816fbbf9 tempest-VolumesListAdminTestJSON-13886898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72670ac6-729d-42fd-94b0-f9f6c4219c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:11:34Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d160c09-94eb-44eb-a321-f6a90d23a74d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9024011d0bd842b19f83883c5fcbcb33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:11:34Z,use_quota=True,user_id='b5c9eda550c34b52b8e5dafb8529faa1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-633a8af9-e61a-4d2b-bd05-aee3816fbbf9 tempest-VolumesListAdminTestJSON-13886898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79a19484-5273-4506-9685-bb0fcb15b00c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-633a8af9-e61a-4d2b-bd05-aee3816fbbf9 tempest-VolumesListAdminTestJSON-13886898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79a19484-5273-4506-9685-bb0fcb15b00c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-633a8af9-e61a-4d2b-bd05-aee3816fbbf9 tempest-VolumesListAdminTestJSON-13886898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d86e1601-f974-4d06-8cd8-2382dccbe3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-633a8af9-e61a-4d2b-bd05-aee3816fbbf9 tempest-VolumesListAdminTestJSON-13886898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d86e1601-f974-4d06-8cd8-2382dccbe3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d160c09-94eb-44eb-a321-f6a90d23a74d', 'volume_name': 'volume-2d160c09-94eb-44eb-a321-f6a90d23a74d', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-633a8af9-e61a-4d2b-bd05-aee3816fbbf9 tempest-VolumesListAdminTestJSON-13886898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a62ad67-fa2e-44ed-9453-7c893b50e803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-633a8af9-e61a-4d2b-bd05-aee3816fbbf9 tempest-VolumesListAdminTestJSON-13886898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a62ad67-fa2e-44ed-9453-7c893b50e803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-633a8af9-e61a-4d2b-bd05-aee3816fbbf9 tempest-VolumesListAdminTestJSON-13886898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3899e70-fb5f-41ed-8e7e-0a8a726b0036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:34 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-633a8af9-e61a-4d2b-bd05-aee3816fbbf9 tempest-VolumesListAdminTestJSON-13886898 None] Volume 2d160c09-94eb-44eb-a321-f6a90d23a74d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d160c09-94eb-44eb-a321-f6a90d23a74d', 'volume_size': 1} Sep 23 00:11:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-633a8af9-e61a-4d2b-bd05-aee3816fbbf9 tempest-VolumesListAdminTestJSON-13886898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:11:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-633a8af9-e61a-4d2b-bd05-aee3816fbbf9 tempest-VolumesListAdminTestJSON-13886898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:11:34 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-633a8af9-e61a-4d2b-bd05-aee3816fbbf9 tempest-VolumesListAdminTestJSON-13886898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:11:34Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d160c09-94eb-44eb-a321-f6a90d23a74d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9024011d0bd842b19f83883c5fcbcb33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:11:34Z,use_quota=True,user_id='b5c9eda550c34b52b8e5dafb8529faa1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:11:34 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-633a8af9-e61a-4d2b-bd05-aee3816fbbf9 tempest-VolumesListAdminTestJSON-13886898 None] Creating volume 2d160c09-94eb-44eb-a321-f6a90d23a74d {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:11:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-633a8af9-e61a-4d2b-bd05-aee3816fbbf9 tempest-VolumesListAdminTestJSON-13886898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:11:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-633a8af9-e61a-4d2b-bd05-aee3816fbbf9 tempest-VolumesListAdminTestJSON-13886898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:11:34 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-633a8af9-e61a-4d2b-bd05-aee3816fbbf9 tempest-VolumesListAdminTestJSON-13886898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:11:34 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-633a8af9-e61a-4d2b-bd05-aee3816fbbf9 tempest-VolumesListAdminTestJSON-13886898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:11:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-633a8af9-e61a-4d2b-bd05-aee3816fbbf9 tempest-VolumesListAdminTestJSON-13886898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:11:34 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-633a8af9-e61a-4d2b-bd05-aee3816fbbf9 tempest-VolumesListAdminTestJSON-13886898 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:11:34 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-633a8af9-e61a-4d2b-bd05-aee3816fbbf9 tempest-VolumesListAdminTestJSON-13886898 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:11:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-633a8af9-e61a-4d2b-bd05-aee3816fbbf9 tempest-VolumesListAdminTestJSON-13886898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2d160c09-94eb-44eb-a321-f6a90d23a74d 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:34 devstack sudo[89128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2d160c09-94eb-44eb-a321-f6a90d23a74d 1073741824 Sep 23 00:11:34 devstack sudo[89128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:35 devstack sudo[89128]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-633a8af9-e61a-4d2b-bd05-aee3816fbbf9 tempest-VolumesListAdminTestJSON-13886898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2d160c09-94eb-44eb-a321-f6a90d23a74d 1073741824" returned: 0 in 0.747s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-633a8af9-e61a-4d2b-bd05-aee3816fbbf9 tempest-VolumesListAdminTestJSON-13886898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2d160c09-94eb-44eb-a321-f6a90d23a74d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:35 devstack sudo[89134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2d160c09-94eb-44eb-a321-f6a90d23a74d Sep 23 00:11:35 devstack sudo[89134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:35 devstack sudo[89134]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-633a8af9-e61a-4d2b-bd05-aee3816fbbf9 tempest-VolumesListAdminTestJSON-13886898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2d160c09-94eb-44eb-a321-f6a90d23a74d" returned: 0 in 0.484s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:35 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-633a8af9-e61a-4d2b-bd05-aee3816fbbf9 tempest-VolumesListAdminTestJSON-13886898 None] <== create_volume: return (1294ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:11:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-633a8af9-e61a-4d2b-bd05-aee3816fbbf9 tempest-VolumesListAdminTestJSON-13886898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.298s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:11:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-633a8af9-e61a-4d2b-bd05-aee3816fbbf9 tempest-VolumesListAdminTestJSON-13886898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3899e70-fb5f-41ed-8e7e-0a8a726b0036) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d160c09-94eb-44eb-a321-f6a90d23a74d', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-633a8af9-e61a-4d2b-bd05-aee3816fbbf9 tempest-VolumesListAdminTestJSON-13886898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c99df5f2-17dd-4448-93dc-85dad078fff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:35 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-633a8af9-e61a-4d2b-bd05-aee3816fbbf9 tempest-VolumesListAdminTestJSON-13886898 None] Volume volume-2d160c09-94eb-44eb-a321-f6a90d23a74d (2d160c09-94eb-44eb-a321-f6a90d23a74d): created successfully Sep 23 00:11:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-633a8af9-e61a-4d2b-bd05-aee3816fbbf9 tempest-VolumesListAdminTestJSON-13886898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c99df5f2-17dd-4448-93dc-85dad078fff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-633a8af9-e61a-4d2b-bd05-aee3816fbbf9 tempest-VolumesListAdminTestJSON-13886898 None] Flow 'volume_create_manager' (1ad83f22-e12a-4587-82c4-10c576b3bbf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:11:35 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-633a8af9-e61a-4d2b-bd05-aee3816fbbf9 tempest-VolumesListAdminTestJSON-13886898 None] Created volume successfully. Sep 23 00:11:36 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-16c81b6a-7c4d-44a2-bc46-5413d7200cf4 tempest-VolumesListAdminTestJSON-13886898 None] Acquiring lock "cinder-2d160c09-94eb-44eb-a321-f6a90d23a74d-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:11:36 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-16c81b6a-7c4d-44a2-bc46-5413d7200cf4 tempest-VolumesListAdminTestJSON-13886898 None] Lock "cinder-2d160c09-94eb-44eb-a321-f6a90d23a74d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:11:36 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-16c81b6a-7c4d-44a2-bc46-5413d7200cf4 tempest-VolumesListAdminTestJSON-13886898 None] Acquiring lock "cinder-quobyte-2d160c09-94eb-44eb-a321-f6a90d23a74d" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:11:36 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-16c81b6a-7c4d-44a2-bc46-5413d7200cf4 tempest-VolumesListAdminTestJSON-13886898 None] Lock "cinder-quobyte-2d160c09-94eb-44eb-a321-f6a90d23a74d" acquired by "delete_volume" :: waited 0.043s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:11:36 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5e210d-e212-455a-a6ac-c83d272627d3]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:11:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-16c81b6a-7c4d-44a2-bc46-5413d7200cf4 tempest-VolumesListAdminTestJSON-13886898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2d160c09-94eb-44eb-a321-f6a90d23a74d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:37 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a2c82a3c-8722-4615-a97f-52c845ad6e89 tempest-VolumesListAdminTestJSON-1893521726 None] Acquiring lock "cinder-a713ebd5-0360-4819-9907-ee49a03572d8-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:11:37 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a2c82a3c-8722-4615-a97f-52c845ad6e89 tempest-VolumesListAdminTestJSON-1893521726 None] Lock "cinder-a713ebd5-0360-4819-9907-ee49a03572d8-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:11:37 devstack sudo[89139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2d160c09-94eb-44eb-a321-f6a90d23a74d Sep 23 00:11:37 devstack sudo[89139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:37 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a2c82a3c-8722-4615-a97f-52c845ad6e89 tempest-VolumesListAdminTestJSON-1893521726 None] Acquiring lock "cinder-quobyte-a713ebd5-0360-4819-9907-ee49a03572d8" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:11:37 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a2c82a3c-8722-4615-a97f-52c845ad6e89 tempest-VolumesListAdminTestJSON-1893521726 None] Lock "cinder-quobyte-a713ebd5-0360-4819-9907-ee49a03572d8" acquired by "delete_volume" :: waited 0.037s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:11:37 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc42668e-79bd-4417-a90f-77ba0b9806cd]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:11:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a2c82a3c-8722-4615-a97f-52c845ad6e89 tempest-VolumesListAdminTestJSON-1893521726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a713ebd5-0360-4819-9907-ee49a03572d8 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:37 devstack sudo[89141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a713ebd5-0360-4819-9907-ee49a03572d8 Sep 23 00:11:37 devstack sudo[89141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:37 devstack sudo[89139]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-16c81b6a-7c4d-44a2-bc46-5413d7200cf4 tempest-VolumesListAdminTestJSON-13886898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2d160c09-94eb-44eb-a321-f6a90d23a74d" returned: 0 in 0.842s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-16c81b6a-7c4d-44a2-bc46-5413d7200cf4 tempest-VolumesListAdminTestJSON-13886898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2d160c09-94eb-44eb-a321-f6a90d23a74d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:37 devstack sudo[89146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2d160c09-94eb-44eb-a321-f6a90d23a74d Sep 23 00:11:37 devstack sudo[89146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:38 devstack sudo[89141]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a2c82a3c-8722-4615-a97f-52c845ad6e89 tempest-VolumesListAdminTestJSON-1893521726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a713ebd5-0360-4819-9907-ee49a03572d8" returned: 0 in 0.776s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a2c82a3c-8722-4615-a97f-52c845ad6e89 tempest-VolumesListAdminTestJSON-1893521726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a713ebd5-0360-4819-9907-ee49a03572d8 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:38 devstack sudo[89151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a713ebd5-0360-4819-9907-ee49a03572d8 Sep 23 00:11:38 devstack sudo[89151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:38 devstack sudo[89146]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-16c81b6a-7c4d-44a2-bc46-5413d7200cf4 tempest-VolumesListAdminTestJSON-13886898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2d160c09-94eb-44eb-a321-f6a90d23a74d" returned: 0 in 0.505s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:38 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-16c81b6a-7c4d-44a2-bc46-5413d7200cf4 tempest-VolumesListAdminTestJSON-13886898 None] Lock "cinder-quobyte-2d160c09-94eb-44eb-a321-f6a90d23a74d" released by "delete_volume" :: held 1.472s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:11:38 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-16c81b6a-7c4d-44a2-bc46-5413d7200cf4 tempest-VolumesListAdminTestJSON-13886898 None] Created reservations ['c8e7d7b2-1611-4119-9e16-f5b04b65e173', '00507b1d-eabf-476c-8593-e094f3b56e47', 'e820838e-ba3c-45d2-816e-214ce3bfee0b', '8d7059f6-8a14-4716-8fa2-423fbd9c1c05'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:11:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-16c81b6a-7c4d-44a2-bc46-5413d7200cf4 tempest-VolumesListAdminTestJSON-13886898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:11:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-16c81b6a-7c4d-44a2-bc46-5413d7200cf4 tempest-VolumesListAdminTestJSON-13886898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:11:38 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-16c81b6a-7c4d-44a2-bc46-5413d7200cf4 tempest-VolumesListAdminTestJSON-13886898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:11:38 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-16c81b6a-7c4d-44a2-bc46-5413d7200cf4 tempest-VolumesListAdminTestJSON-13886898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:11:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-16c81b6a-7c4d-44a2-bc46-5413d7200cf4 tempest-VolumesListAdminTestJSON-13886898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:11:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-16c81b6a-7c4d-44a2-bc46-5413d7200cf4 tempest-VolumesListAdminTestJSON-13886898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:38 devstack sudo[89151]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a2c82a3c-8722-4615-a97f-52c845ad6e89 tempest-VolumesListAdminTestJSON-1893521726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a713ebd5-0360-4819-9907-ee49a03572d8" returned: 0 in 0.438s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:38 devstack sudo[89155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:11:38 devstack sudo[89155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:38 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a2c82a3c-8722-4615-a97f-52c845ad6e89 tempest-VolumesListAdminTestJSON-1893521726 None] Lock "cinder-quobyte-a713ebd5-0360-4819-9907-ee49a03572d8" released by "delete_volume" :: held 1.340s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:11:38 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-a2c82a3c-8722-4615-a97f-52c845ad6e89 tempest-VolumesListAdminTestJSON-1893521726 None] Created reservations ['f0c223a0-2708-4d47-b1d5-1ae59d9f5f94', '8b52c6cf-e045-4c90-a1b2-f852cfe8564f', '812de12d-d921-411b-b59a-a9efb94cc1a4', '05931f44-ec91-4e5c-b690-ca41499424e3'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:11:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a2c82a3c-8722-4615-a97f-52c845ad6e89 tempest-VolumesListAdminTestJSON-1893521726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:11:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a2c82a3c-8722-4615-a97f-52c845ad6e89 tempest-VolumesListAdminTestJSON-1893521726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:11:38 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a2c82a3c-8722-4615-a97f-52c845ad6e89 tempest-VolumesListAdminTestJSON-1893521726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:11:38 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a2c82a3c-8722-4615-a97f-52c845ad6e89 tempest-VolumesListAdminTestJSON-1893521726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:11:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a2c82a3c-8722-4615-a97f-52c845ad6e89 tempest-VolumesListAdminTestJSON-1893521726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:11:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a2c82a3c-8722-4615-a97f-52c845ad6e89 tempest-VolumesListAdminTestJSON-1893521726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:39 devstack sudo[89157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:11:39 devstack sudo[89157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:39 devstack sudo[89155]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-16c81b6a-7c4d-44a2-bc46-5413d7200cf4 tempest-VolumesListAdminTestJSON-13886898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.544s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:39 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-16c81b6a-7c4d-44a2-bc46-5413d7200cf4 tempest-VolumesListAdminTestJSON-13886898 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:11:39 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-16c81b6a-7c4d-44a2-bc46-5413d7200cf4 tempest-VolumesListAdminTestJSON-13886898 None] Deleted volume successfully. Sep 23 00:11:39 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-16c81b6a-7c4d-44a2-bc46-5413d7200cf4 tempest-VolumesListAdminTestJSON-13886898 None] Lock "cinder-2d160c09-94eb-44eb-a321-f6a90d23a74d-delete_volume" released by "delete_volume" :: held 2.448s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:11:39 devstack sudo[89157]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a2c82a3c-8722-4615-a97f-52c845ad6e89 tempest-VolumesListAdminTestJSON-1893521726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.459s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:39 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-a2c82a3c-8722-4615-a97f-52c845ad6e89 tempest-VolumesListAdminTestJSON-1893521726 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:11:39 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-a2c82a3c-8722-4615-a97f-52c845ad6e89 tempest-VolumesListAdminTestJSON-1893521726 None] Deleted volume successfully. Sep 23 00:11:39 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a2c82a3c-8722-4615-a97f-52c845ad6e89 tempest-VolumesListAdminTestJSON-1893521726 None] Lock "cinder-a713ebd5-0360-4819-9907-ee49a03572d8-delete_volume" released by "delete_volume" :: held 2.422s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:11:39 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-39ca7139-7f50-4184-acbd-0ab3138f7d03 tempest-VolumesListAdminTestJSON-1893521726 None] Acquiring lock "cinder-22c63382-de97-4d9a-8589-91cb02df3377-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:11:39 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-39ca7139-7f50-4184-acbd-0ab3138f7d03 tempest-VolumesListAdminTestJSON-1893521726 None] Lock "cinder-22c63382-de97-4d9a-8589-91cb02df3377-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:11:39 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-39ca7139-7f50-4184-acbd-0ab3138f7d03 tempest-VolumesListAdminTestJSON-1893521726 None] Acquiring lock "cinder-quobyte-22c63382-de97-4d9a-8589-91cb02df3377" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:11:39 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-39ca7139-7f50-4184-acbd-0ab3138f7d03 tempest-VolumesListAdminTestJSON-1893521726 None] Lock "cinder-quobyte-22c63382-de97-4d9a-8589-91cb02df3377" acquired by "delete_volume" :: waited 0.020s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:11:39 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57278ac-70a4-45ca-b8f7-38c4ae4e580b]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:11:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-39ca7139-7f50-4184-acbd-0ab3138f7d03 tempest-VolumesListAdminTestJSON-1893521726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-22c63382-de97-4d9a-8589-91cb02df3377 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:39 devstack sudo[89161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-22c63382-de97-4d9a-8589-91cb02df3377 Sep 23 00:11:39 devstack sudo[89161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:40 devstack sudo[89161]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-39ca7139-7f50-4184-acbd-0ab3138f7d03 tempest-VolumesListAdminTestJSON-1893521726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-22c63382-de97-4d9a-8589-91cb02df3377" returned: 0 in 0.453s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-39ca7139-7f50-4184-acbd-0ab3138f7d03 tempest-VolumesListAdminTestJSON-1893521726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-22c63382-de97-4d9a-8589-91cb02df3377 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:40 devstack sudo[89166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-22c63382-de97-4d9a-8589-91cb02df3377 Sep 23 00:11:40 devstack sudo[89166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:40 devstack sudo[89166]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-39ca7139-7f50-4184-acbd-0ab3138f7d03 tempest-VolumesListAdminTestJSON-1893521726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-22c63382-de97-4d9a-8589-91cb02df3377" returned: 0 in 0.376s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:40 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-39ca7139-7f50-4184-acbd-0ab3138f7d03 tempest-VolumesListAdminTestJSON-1893521726 None] Lock "cinder-quobyte-22c63382-de97-4d9a-8589-91cb02df3377" released by "delete_volume" :: held 0.878s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:11:40 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-39ca7139-7f50-4184-acbd-0ab3138f7d03 tempest-VolumesListAdminTestJSON-1893521726 None] Created reservations ['83da4273-254d-4084-9f7b-a18f0ac0d6de', 'bc6f7b94-c0ae-4538-bee7-f5335fab8cd2', '9ca700cc-90e9-467e-8faf-80e71e0b20ac', '74b8726b-9c6c-4be9-9dc7-d86f8711bdfb'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:11:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-39ca7139-7f50-4184-acbd-0ab3138f7d03 tempest-VolumesListAdminTestJSON-1893521726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:11:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-39ca7139-7f50-4184-acbd-0ab3138f7d03 tempest-VolumesListAdminTestJSON-1893521726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:11:40 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-39ca7139-7f50-4184-acbd-0ab3138f7d03 tempest-VolumesListAdminTestJSON-1893521726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:11:40 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-39ca7139-7f50-4184-acbd-0ab3138f7d03 tempest-VolumesListAdminTestJSON-1893521726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:11:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-39ca7139-7f50-4184-acbd-0ab3138f7d03 tempest-VolumesListAdminTestJSON-1893521726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:11:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-39ca7139-7f50-4184-acbd-0ab3138f7d03 tempest-VolumesListAdminTestJSON-1893521726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:40 devstack sudo[89169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:11:40 devstack sudo[89169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:41 devstack sudo[89169]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-39ca7139-7f50-4184-acbd-0ab3138f7d03 tempest-VolumesListAdminTestJSON-1893521726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.301s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:41 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-39ca7139-7f50-4184-acbd-0ab3138f7d03 tempest-VolumesListAdminTestJSON-1893521726 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:11:41 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-39ca7139-7f50-4184-acbd-0ab3138f7d03 tempest-VolumesListAdminTestJSON-1893521726 None] Deleted volume successfully. Sep 23 00:11:41 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-39ca7139-7f50-4184-acbd-0ab3138f7d03 tempest-VolumesListAdminTestJSON-1893521726 None] Lock "cinder-22c63382-de97-4d9a-8589-91cb02df3377-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:11:42 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8a3564a1-b765-4cb6-be5d-f417fc25967a tempest-VolumesListAdminTestJSON-1893521726 None] Acquiring lock "cinder-bd394fb0-5168-478d-a753-24922c9f24a8-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:11:42 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8a3564a1-b765-4cb6-be5d-f417fc25967a tempest-VolumesListAdminTestJSON-1893521726 None] Lock "cinder-bd394fb0-5168-478d-a753-24922c9f24a8-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:11:42 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8a3564a1-b765-4cb6-be5d-f417fc25967a tempest-VolumesListAdminTestJSON-1893521726 None] Acquiring lock "cinder-quobyte-bd394fb0-5168-478d-a753-24922c9f24a8" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:11:42 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8a3564a1-b765-4cb6-be5d-f417fc25967a tempest-VolumesListAdminTestJSON-1893521726 None] Lock "cinder-quobyte-bd394fb0-5168-478d-a753-24922c9f24a8" acquired by "delete_volume" :: waited 0.034s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:11:42 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d00abc7-71db-4006-a9df-2e0a37c5879b]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:11:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8a3564a1-b765-4cb6-be5d-f417fc25967a tempest-VolumesListAdminTestJSON-1893521726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-bd394fb0-5168-478d-a753-24922c9f24a8 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:42 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-589632c3-45b8-4d0a-8a3e-b4943febaa34 tempest-TaggedAttachmentsTest-1355663750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:11:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-589632c3-45b8-4d0a-8a3e-b4943febaa34 tempest-TaggedAttachmentsTest-1355663750 None] Flow 'volume_create_manager' (8d3726c7-c3be-4586-a441-8dc0e5994437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:11:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-589632c3-45b8-4d0a-8a3e-b4943febaa34 tempest-TaggedAttachmentsTest-1355663750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88af03c5-aaf6-4657-bb09-27854a57394f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:42 devstack sudo[89172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-bd394fb0-5168-478d-a753-24922c9f24a8 Sep 23 00:11:42 devstack sudo[89172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-589632c3-45b8-4d0a-8a3e-b4943febaa34 tempest-TaggedAttachmentsTest-1355663750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88af03c5-aaf6-4657-bb09-27854a57394f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:11:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-187989909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee5f8098-ea07-47e1-be5e-061305b68ffe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64a875cdbabc485886786c1532d164c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:11:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:11:42Z,use_quota=True,user_id='387ace40b80d41fe8caad34fcac987fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-589632c3-45b8-4d0a-8a3e-b4943febaa34 tempest-TaggedAttachmentsTest-1355663750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (740743da-113e-4753-ad83-5b295195dd3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-589632c3-45b8-4d0a-8a3e-b4943febaa34 tempest-TaggedAttachmentsTest-1355663750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (740743da-113e-4753-ad83-5b295195dd3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-589632c3-45b8-4d0a-8a3e-b4943febaa34 tempest-TaggedAttachmentsTest-1355663750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e94645fd-d0e4-4358-afa5-f14757b07b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-589632c3-45b8-4d0a-8a3e-b4943febaa34 tempest-TaggedAttachmentsTest-1355663750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e94645fd-d0e4-4358-afa5-f14757b07b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee5f8098-ea07-47e1-be5e-061305b68ffe', 'volume_name': 'volume-ee5f8098-ea07-47e1-be5e-061305b68ffe', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-589632c3-45b8-4d0a-8a3e-b4943febaa34 tempest-TaggedAttachmentsTest-1355663750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f37a11a-4ff6-4a47-913e-9829a0139ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-589632c3-45b8-4d0a-8a3e-b4943febaa34 tempest-TaggedAttachmentsTest-1355663750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f37a11a-4ff6-4a47-913e-9829a0139ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-589632c3-45b8-4d0a-8a3e-b4943febaa34 tempest-TaggedAttachmentsTest-1355663750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d548133-1df5-4eea-bf36-5faac11a1222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:42 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-589632c3-45b8-4d0a-8a3e-b4943febaa34 tempest-TaggedAttachmentsTest-1355663750 None] Volume ee5f8098-ea07-47e1-be5e-061305b68ffe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee5f8098-ea07-47e1-be5e-061305b68ffe', 'volume_size': 1} Sep 23 00:11:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-589632c3-45b8-4d0a-8a3e-b4943febaa34 tempest-TaggedAttachmentsTest-1355663750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:11:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-589632c3-45b8-4d0a-8a3e-b4943febaa34 tempest-TaggedAttachmentsTest-1355663750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:11:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-589632c3-45b8-4d0a-8a3e-b4943febaa34 tempest-TaggedAttachmentsTest-1355663750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:11:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-187989909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee5f8098-ea07-47e1-be5e-061305b68ffe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64a875cdbabc485886786c1532d164c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:11:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:11:42Z,use_quota=True,user_id='387ace40b80d41fe8caad34fcac987fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:11:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-589632c3-45b8-4d0a-8a3e-b4943febaa34 tempest-TaggedAttachmentsTest-1355663750 None] Creating volume ee5f8098-ea07-47e1-be5e-061305b68ffe {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:11:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-589632c3-45b8-4d0a-8a3e-b4943febaa34 tempest-TaggedAttachmentsTest-1355663750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:11:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-589632c3-45b8-4d0a-8a3e-b4943febaa34 tempest-TaggedAttachmentsTest-1355663750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:11:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-589632c3-45b8-4d0a-8a3e-b4943febaa34 tempest-TaggedAttachmentsTest-1355663750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:11:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-589632c3-45b8-4d0a-8a3e-b4943febaa34 tempest-TaggedAttachmentsTest-1355663750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:11:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-589632c3-45b8-4d0a-8a3e-b4943febaa34 tempest-TaggedAttachmentsTest-1355663750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:11:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-589632c3-45b8-4d0a-8a3e-b4943febaa34 tempest-TaggedAttachmentsTest-1355663750 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:11:42 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-589632c3-45b8-4d0a-8a3e-b4943febaa34 tempest-TaggedAttachmentsTest-1355663750 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:11:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-589632c3-45b8-4d0a-8a3e-b4943febaa34 tempest-TaggedAttachmentsTest-1355663750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ee5f8098-ea07-47e1-be5e-061305b68ffe 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:42 devstack sudo[89174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ee5f8098-ea07-47e1-be5e-061305b68ffe 1073741824 Sep 23 00:11:42 devstack sudo[89174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:42 devstack sudo[89172]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8a3564a1-b765-4cb6-be5d-f417fc25967a tempest-VolumesListAdminTestJSON-1893521726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-bd394fb0-5168-478d-a753-24922c9f24a8" returned: 0 in 0.649s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8a3564a1-b765-4cb6-be5d-f417fc25967a tempest-VolumesListAdminTestJSON-1893521726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-bd394fb0-5168-478d-a753-24922c9f24a8 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:42 devstack sudo[89181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-bd394fb0-5168-478d-a753-24922c9f24a8 Sep 23 00:11:42 devstack sudo[89181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:43 devstack sudo[89174]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-589632c3-45b8-4d0a-8a3e-b4943febaa34 tempest-TaggedAttachmentsTest-1355663750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ee5f8098-ea07-47e1-be5e-061305b68ffe 1073741824" returned: 0 in 0.720s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:43 devstack sudo[89181]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8a3564a1-b765-4cb6-be5d-f417fc25967a tempest-VolumesListAdminTestJSON-1893521726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-bd394fb0-5168-478d-a753-24922c9f24a8" returned: 0 in 0.411s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:43 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8a3564a1-b765-4cb6-be5d-f417fc25967a tempest-VolumesListAdminTestJSON-1893521726 None] Lock "cinder-quobyte-bd394fb0-5168-478d-a753-24922c9f24a8" released by "delete_volume" :: held 1.160s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:11:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-589632c3-45b8-4d0a-8a3e-b4943febaa34 tempest-TaggedAttachmentsTest-1355663750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ee5f8098-ea07-47e1-be5e-061305b68ffe {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:43 devstack sudo[89185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ee5f8098-ea07-47e1-be5e-061305b68ffe Sep 23 00:11:43 devstack sudo[89185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:43 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-8a3564a1-b765-4cb6-be5d-f417fc25967a tempest-VolumesListAdminTestJSON-1893521726 None] Created reservations ['1f5fa93c-0891-48b0-9e91-9dc126926016', 'a54c9d67-2b98-4a13-af2e-c4ea700f70f5', 'a9d92b96-8ea3-4477-9352-1bb061356802', '0d460419-07e5-438c-9c2a-18c4e6748c88'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:11:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8a3564a1-b765-4cb6-be5d-f417fc25967a tempest-VolumesListAdminTestJSON-1893521726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:11:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8a3564a1-b765-4cb6-be5d-f417fc25967a tempest-VolumesListAdminTestJSON-1893521726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:11:43 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-8a3564a1-b765-4cb6-be5d-f417fc25967a tempest-VolumesListAdminTestJSON-1893521726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:11:43 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-8a3564a1-b765-4cb6-be5d-f417fc25967a tempest-VolumesListAdminTestJSON-1893521726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:11:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8a3564a1-b765-4cb6-be5d-f417fc25967a tempest-VolumesListAdminTestJSON-1893521726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:11:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8a3564a1-b765-4cb6-be5d-f417fc25967a tempest-VolumesListAdminTestJSON-1893521726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:43 devstack sudo[89188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:11:43 devstack sudo[89188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:43 devstack sudo[89185]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-589632c3-45b8-4d0a-8a3e-b4943febaa34 tempest-TaggedAttachmentsTest-1355663750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ee5f8098-ea07-47e1-be5e-061305b68ffe" returned: 0 in 0.294s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:43 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-589632c3-45b8-4d0a-8a3e-b4943febaa34 tempest-TaggedAttachmentsTest-1355663750 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:11:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-589632c3-45b8-4d0a-8a3e-b4943febaa34 tempest-TaggedAttachmentsTest-1355663750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:11:43 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-589632c3-45b8-4d0a-8a3e-b4943febaa34 tempest-TaggedAttachmentsTest-1355663750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d548133-1df5-4eea-bf36-5faac11a1222) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee5f8098-ea07-47e1-be5e-061305b68ffe', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:43 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-589632c3-45b8-4d0a-8a3e-b4943febaa34 tempest-TaggedAttachmentsTest-1355663750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (227d6287-a9c2-4d9b-8570-3f8163d656c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:43 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-589632c3-45b8-4d0a-8a3e-b4943febaa34 tempest-TaggedAttachmentsTest-1355663750 None] Volume volume-ee5f8098-ea07-47e1-be5e-061305b68ffe (ee5f8098-ea07-47e1-be5e-061305b68ffe): created successfully Sep 23 00:11:43 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-589632c3-45b8-4d0a-8a3e-b4943febaa34 tempest-TaggedAttachmentsTest-1355663750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (227d6287-a9c2-4d9b-8570-3f8163d656c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:43 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-589632c3-45b8-4d0a-8a3e-b4943febaa34 tempest-TaggedAttachmentsTest-1355663750 None] Flow 'volume_create_manager' (8d3726c7-c3be-4586-a441-8dc0e5994437) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:11:43 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-589632c3-45b8-4d0a-8a3e-b4943febaa34 tempest-TaggedAttachmentsTest-1355663750 None] Created volume successfully. Sep 23 00:11:43 devstack sudo[89188]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8a3564a1-b765-4cb6-be5d-f417fc25967a tempest-VolumesListAdminTestJSON-1893521726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.358s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:43 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-8a3564a1-b765-4cb6-be5d-f417fc25967a tempest-VolumesListAdminTestJSON-1893521726 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:11:44 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-8a3564a1-b765-4cb6-be5d-f417fc25967a tempest-VolumesListAdminTestJSON-1893521726 None] Deleted volume successfully. Sep 23 00:11:44 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8a3564a1-b765-4cb6-be5d-f417fc25967a tempest-VolumesListAdminTestJSON-1893521726 None] Lock "cinder-bd394fb0-5168-478d-a753-24922c9f24a8-delete_volume" released by "delete_volume" :: held 1.968s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:11:53 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=63,cinder:UPDATE=83,cinder:DELETE=6,cinder:INSERT=17 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:11:54 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:UPDATE=73,cinder:SELECT=59,cinder:INSERT=19,cinder:DELETE=8 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:11:57 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-4dd3038b-0e2c-43f4-8753-2edc2566faff req-1c9eea2a-bb55-4b96-ae55-ce47506934f7 tempest-AttachVolumeNegativeTest-86753276 None] Terminate volume connection completed successfully. Sep 23 00:11:57 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-4dd3038b-0e2c-43f4-8753-2edc2566faff req-1c9eea2a-bb55-4b96-ae55-ce47506934f7 tempest-AttachVolumeNegativeTest-86753276 None] Deleting attachment afc7978d-3d4a-46a6-8124-38f2c6fece34. {{(pid=86591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:12:00 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d22bc47-41c2-418c-b5e8-2f743113d055 tempest-SnapshotMetadataTestJSON-396608567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:12:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5d22bc47-41c2-418c-b5e8-2f743113d055 tempest-SnapshotMetadataTestJSON-396608567 None] Flow 'volume_create_manager' (04457a4b-8794-4224-a973-226cc8e6f0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:12:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5d22bc47-41c2-418c-b5e8-2f743113d055 tempest-SnapshotMetadataTestJSON-396608567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76539a09-0e68-4ef3-813b-3ca271ab22e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5d22bc47-41c2-418c-b5e8-2f743113d055 tempest-SnapshotMetadataTestJSON-396608567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76539a09-0e68-4ef3-813b-3ca271ab22e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:12:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2133146555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce1f95bc-6606-4930-86ec-e84de6a5e470,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6204f4f112ae422ebc4e5984dfbe7bd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:12:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:12:01Z,use_quota=True,user_id='0ac0a29d3d7b421ab25301da3ff0ff11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5d22bc47-41c2-418c-b5e8-2f743113d055 tempest-SnapshotMetadataTestJSON-396608567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f016d86-de6e-458e-b7ac-0d3f719e01b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5d22bc47-41c2-418c-b5e8-2f743113d055 tempest-SnapshotMetadataTestJSON-396608567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f016d86-de6e-458e-b7ac-0d3f719e01b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5d22bc47-41c2-418c-b5e8-2f743113d055 tempest-SnapshotMetadataTestJSON-396608567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae25fd43-24e7-4185-aa74-09978a990ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5d22bc47-41c2-418c-b5e8-2f743113d055 tempest-SnapshotMetadataTestJSON-396608567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae25fd43-24e7-4185-aa74-09978a990ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce1f95bc-6606-4930-86ec-e84de6a5e470', 'volume_name': 'volume-ce1f95bc-6606-4930-86ec-e84de6a5e470', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5d22bc47-41c2-418c-b5e8-2f743113d055 tempest-SnapshotMetadataTestJSON-396608567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bda2781a-cbca-48a2-b6d0-e464aa208167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5d22bc47-41c2-418c-b5e8-2f743113d055 tempest-SnapshotMetadataTestJSON-396608567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bda2781a-cbca-48a2-b6d0-e464aa208167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5d22bc47-41c2-418c-b5e8-2f743113d055 tempest-SnapshotMetadataTestJSON-396608567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0000d24-01f5-40a6-bc05-77659994d9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:00 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-5d22bc47-41c2-418c-b5e8-2f743113d055 tempest-SnapshotMetadataTestJSON-396608567 None] Volume ce1f95bc-6606-4930-86ec-e84de6a5e470: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce1f95bc-6606-4930-86ec-e84de6a5e470', 'volume_size': 1} Sep 23 00:12:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5d22bc47-41c2-418c-b5e8-2f743113d055 tempest-SnapshotMetadataTestJSON-396608567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:12:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5d22bc47-41c2-418c-b5e8-2f743113d055 tempest-SnapshotMetadataTestJSON-396608567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:12:00 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5d22bc47-41c2-418c-b5e8-2f743113d055 tempest-SnapshotMetadataTestJSON-396608567 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:12:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2133146555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce1f95bc-6606-4930-86ec-e84de6a5e470,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6204f4f112ae422ebc4e5984dfbe7bd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:12:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:12:01Z,use_quota=True,user_id='0ac0a29d3d7b421ab25301da3ff0ff11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:12:00 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-5d22bc47-41c2-418c-b5e8-2f743113d055 tempest-SnapshotMetadataTestJSON-396608567 None] Creating volume ce1f95bc-6606-4930-86ec-e84de6a5e470 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:12:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5d22bc47-41c2-418c-b5e8-2f743113d055 tempest-SnapshotMetadataTestJSON-396608567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:12:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5d22bc47-41c2-418c-b5e8-2f743113d055 tempest-SnapshotMetadataTestJSON-396608567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:12:00 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5d22bc47-41c2-418c-b5e8-2f743113d055 tempest-SnapshotMetadataTestJSON-396608567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:12:00 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5d22bc47-41c2-418c-b5e8-2f743113d055 tempest-SnapshotMetadataTestJSON-396608567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:12:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5d22bc47-41c2-418c-b5e8-2f743113d055 tempest-SnapshotMetadataTestJSON-396608567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:12:00 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5d22bc47-41c2-418c-b5e8-2f743113d055 tempest-SnapshotMetadataTestJSON-396608567 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:12:00 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-5d22bc47-41c2-418c-b5e8-2f743113d055 tempest-SnapshotMetadataTestJSON-396608567 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:12:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5d22bc47-41c2-418c-b5e8-2f743113d055 tempest-SnapshotMetadataTestJSON-396608567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ce1f95bc-6606-4930-86ec-e84de6a5e470 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:00 devstack sudo[89348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ce1f95bc-6606-4930-86ec-e84de6a5e470 1073741824 Sep 23 00:12:00 devstack sudo[89348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:01 devstack sudo[89348]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5d22bc47-41c2-418c-b5e8-2f743113d055 tempest-SnapshotMetadataTestJSON-396608567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ce1f95bc-6606-4930-86ec-e84de6a5e470 1073741824" returned: 0 in 0.745s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5d22bc47-41c2-418c-b5e8-2f743113d055 tempest-SnapshotMetadataTestJSON-396608567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ce1f95bc-6606-4930-86ec-e84de6a5e470 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:01 devstack sudo[89363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ce1f95bc-6606-4930-86ec-e84de6a5e470 Sep 23 00:12:01 devstack sudo[89363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:02 devstack sudo[89363]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5d22bc47-41c2-418c-b5e8-2f743113d055 tempest-SnapshotMetadataTestJSON-396608567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ce1f95bc-6606-4930-86ec-e84de6a5e470" returned: 0 in 0.501s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:02 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5d22bc47-41c2-418c-b5e8-2f743113d055 tempest-SnapshotMetadataTestJSON-396608567 None] <== create_volume: return (1328ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:12:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5d22bc47-41c2-418c-b5e8-2f743113d055 tempest-SnapshotMetadataTestJSON-396608567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.331s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:12:02 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5d22bc47-41c2-418c-b5e8-2f743113d055 tempest-SnapshotMetadataTestJSON-396608567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0000d24-01f5-40a6-bc05-77659994d9b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce1f95bc-6606-4930-86ec-e84de6a5e470', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:02 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5d22bc47-41c2-418c-b5e8-2f743113d055 tempest-SnapshotMetadataTestJSON-396608567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a02c8096-fff7-46e9-afdc-62307c207e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:02 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-5d22bc47-41c2-418c-b5e8-2f743113d055 tempest-SnapshotMetadataTestJSON-396608567 None] Volume volume-ce1f95bc-6606-4930-86ec-e84de6a5e470 (ce1f95bc-6606-4930-86ec-e84de6a5e470): created successfully Sep 23 00:12:02 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5d22bc47-41c2-418c-b5e8-2f743113d055 tempest-SnapshotMetadataTestJSON-396608567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a02c8096-fff7-46e9-afdc-62307c207e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:02 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5d22bc47-41c2-418c-b5e8-2f743113d055 tempest-SnapshotMetadataTestJSON-396608567 None] Flow 'volume_create_manager' (04457a4b-8794-4224-a973-226cc8e6f0be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:12:02 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-5d22bc47-41c2-418c-b5e8-2f743113d055 tempest-SnapshotMetadataTestJSON-396608567 None] Created volume successfully. Sep 23 00:12:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4e43dd38-d3a5-43bb-9eeb-cf1300c84a76 tempest-SnapshotMetadataTestJSON-396608567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:12:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4e43dd38-d3a5-43bb-9eeb-cf1300c84a76 tempest-SnapshotMetadataTestJSON-396608567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:12:03 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-4e43dd38-d3a5-43bb-9eeb-cf1300c84a76 tempest-SnapshotMetadataTestJSON-396608567 None] Creating offline snapshot 50573c35-0183-40da-b07f-13821f8dbb17 of volume ce1f95bc-6606-4930-86ec-e84de6a5e470 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:12:03 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c58dc4-f11e-4aca-9539-a977dccaff67]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:12:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4e43dd38-d3a5-43bb-9eeb-cf1300c84a76 tempest-SnapshotMetadataTestJSON-396608567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ce1f95bc-6606-4930-86ec-e84de6a5e470 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:04 devstack sudo[89467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ce1f95bc-6606-4930-86ec-e84de6a5e470 Sep 23 00:12:04 devstack sudo[89467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:04 devstack sudo[89467]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4e43dd38-d3a5-43bb-9eeb-cf1300c84a76 tempest-SnapshotMetadataTestJSON-396608567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ce1f95bc-6606-4930-86ec-e84de6a5e470" returned: 0 in 1.112s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4e43dd38-d3a5-43bb-9eeb-cf1300c84a76 tempest-SnapshotMetadataTestJSON-396608567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ce1f95bc-6606-4930-86ec-e84de6a5e470,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ce1f95bc-6606-4930-86ec-e84de6a5e470.50573c35-0183-40da-b07f-13821f8dbb17 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:04 devstack sudo[89487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ce1f95bc-6606-4930-86ec-e84de6a5e470,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ce1f95bc-6606-4930-86ec-e84de6a5e470.50573c35-0183-40da-b07f-13821f8dbb17 1G Sep 23 00:12:04 devstack sudo[89487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:05 devstack sudo[89487]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4e43dd38-d3a5-43bb-9eeb-cf1300c84a76 tempest-SnapshotMetadataTestJSON-396608567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ce1f95bc-6606-4930-86ec-e84de6a5e470,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ce1f95bc-6606-4930-86ec-e84de6a5e470.50573c35-0183-40da-b07f-13821f8dbb17 1G" returned: 0 in 0.986s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4e43dd38-d3a5-43bb-9eeb-cf1300c84a76 tempest-SnapshotMetadataTestJSON-396608567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce1f95bc-6606-4930-86ec-e84de6a5e470 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ce1f95bc-6606-4930-86ec-e84de6a5e470.50573c35-0183-40da-b07f-13821f8dbb17 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:05 devstack sudo[89498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce1f95bc-6606-4930-86ec-e84de6a5e470 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ce1f95bc-6606-4930-86ec-e84de6a5e470.50573c35-0183-40da-b07f-13821f8dbb17 Sep 23 00:12:05 devstack sudo[89498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:06 devstack sudo[89498]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4e43dd38-d3a5-43bb-9eeb-cf1300c84a76 tempest-SnapshotMetadataTestJSON-396608567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce1f95bc-6606-4930-86ec-e84de6a5e470 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ce1f95bc-6606-4930-86ec-e84de6a5e470.50573c35-0183-40da-b07f-13821f8dbb17" returned: 0 in 0.851s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:06 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-4e43dd38-d3a5-43bb-9eeb-cf1300c84a76 tempest-SnapshotMetadataTestJSON-396608567 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ce1f95bc-6606-4930-86ec-e84de6a5e470.50573c35-0183-40da-b07f-13821f8dbb17 is being set with open permissions: ugo+rw Sep 23 00:12:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4e43dd38-d3a5-43bb-9eeb-cf1300c84a76 tempest-SnapshotMetadataTestJSON-396608567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ce1f95bc-6606-4930-86ec-e84de6a5e470.50573c35-0183-40da-b07f-13821f8dbb17 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:06 devstack sudo[89510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ce1f95bc-6606-4930-86ec-e84de6a5e470.50573c35-0183-40da-b07f-13821f8dbb17 Sep 23 00:12:06 devstack sudo[89510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:07 devstack sudo[89510]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4e43dd38-d3a5-43bb-9eeb-cf1300c84a76 tempest-SnapshotMetadataTestJSON-396608567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ce1f95bc-6606-4930-86ec-e84de6a5e470.50573c35-0183-40da-b07f-13821f8dbb17" returned: 0 in 1.249s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4e43dd38-d3a5-43bb-9eeb-cf1300c84a76 tempest-SnapshotMetadataTestJSON-396608567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ce1f95bc-6606-4930-86ec-e84de6a5e470.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:08 devstack sudo[89517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ce1f95bc-6606-4930-86ec-e84de6a5e470.info Sep 23 00:12:08 devstack sudo[89517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:09 devstack sudo[89517]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4e43dd38-d3a5-43bb-9eeb-cf1300c84a76 tempest-SnapshotMetadataTestJSON-396608567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ce1f95bc-6606-4930-86ec-e84de6a5e470.info" returned: 0 in 0.803s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:09 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-4e43dd38-d3a5-43bb-9eeb-cf1300c84a76 tempest-SnapshotMetadataTestJSON-396608567 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ce1f95bc-6606-4930-86ec-e84de6a5e470.info is being set with open permissions: ugo+rw Sep 23 00:12:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4e43dd38-d3a5-43bb-9eeb-cf1300c84a76 tempest-SnapshotMetadataTestJSON-396608567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ce1f95bc-6606-4930-86ec-e84de6a5e470.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:09 devstack sudo[89529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ce1f95bc-6606-4930-86ec-e84de6a5e470.info Sep 23 00:12:09 devstack sudo[89529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:09 devstack sudo[89529]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4e43dd38-d3a5-43bb-9eeb-cf1300c84a76 tempest-SnapshotMetadataTestJSON-396608567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ce1f95bc-6606-4930-86ec-e84de6a5e470.info" returned: 0 in 0.927s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4e43dd38-d3a5-43bb-9eeb-cf1300c84a76 tempest-SnapshotMetadataTestJSON-396608567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.480s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:12:10 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-4e43dd38-d3a5-43bb-9eeb-cf1300c84a76 tempest-SnapshotMetadataTestJSON-396608567 None] Create snapshot completed successfully Sep 23 00:12:13 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9fb6a42e-48a8-4aa7-ac25-7257acb5afa7 tempest-SnapshotMetadataTestJSON-396608567 None] Acquiring lock "cinder-50573c35-0183-40da-b07f-13821f8dbb17-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:12:13 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9fb6a42e-48a8-4aa7-ac25-7257acb5afa7 tempest-SnapshotMetadataTestJSON-396608567 None] Lock "cinder-50573c35-0183-40da-b07f-13821f8dbb17-delete_snapshot" acquired by "delete_snapshot" :: waited 0.060s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:12:13 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9fb6a42e-48a8-4aa7-ac25-7257acb5afa7 tempest-SnapshotMetadataTestJSON-396608567 None] Acquiring lock "cinder-quobyte-ce1f95bc-6606-4930-86ec-e84de6a5e470" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:12:13 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9fb6a42e-48a8-4aa7-ac25-7257acb5afa7 tempest-SnapshotMetadataTestJSON-396608567 None] Lock "cinder-quobyte-ce1f95bc-6606-4930-86ec-e84de6a5e470" acquired by "delete_snapshot" :: waited 0.080s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:12:13 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9fb6a42e-48a8-4aa7-ac25-7257acb5afa7 tempest-SnapshotMetadataTestJSON-396608567 None] Acquiring lock "cinder-quobyte-50573c35-0183-40da-b07f-13821f8dbb17" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:12:13 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9fb6a42e-48a8-4aa7-ac25-7257acb5afa7 tempest-SnapshotMetadataTestJSON-396608567 None] Lock "cinder-quobyte-50573c35-0183-40da-b07f-13821f8dbb17" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:12:13 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-9fb6a42e-48a8-4aa7-ac25-7257acb5afa7 tempest-SnapshotMetadataTestJSON-396608567 None] Deleting offline snapshot 50573c35-0183-40da-b07f-13821f8dbb17 of volume ce1f95bc-6606-4930-86ec-e84de6a5e470 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:12:13 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-9fb6a42e-48a8-4aa7-ac25-7257acb5afa7 tempest-SnapshotMetadataTestJSON-396608567 None] snapshot_file for this snap is: volume-ce1f95bc-6606-4930-86ec-e84de6a5e470.50573c35-0183-40da-b07f-13821f8dbb17 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:12:13 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[77085a23-75ae-41b0-918b-3d0061d16ef0]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:12:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9fb6a42e-48a8-4aa7-ac25-7257acb5afa7 tempest-SnapshotMetadataTestJSON-396608567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ce1f95bc-6606-4930-86ec-e84de6a5e470.50573c35-0183-40da-b07f-13821f8dbb17 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:13 devstack sudo[89602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ce1f95bc-6606-4930-86ec-e84de6a5e470.50573c35-0183-40da-b07f-13821f8dbb17 Sep 23 00:12:13 devstack sudo[89602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:14 devstack sudo[89602]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9fb6a42e-48a8-4aa7-ac25-7257acb5afa7 tempest-SnapshotMetadataTestJSON-396608567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ce1f95bc-6606-4930-86ec-e84de6a5e470.50573c35-0183-40da-b07f-13821f8dbb17" returned: 0 in 0.766s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:14 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-9fb6a42e-48a8-4aa7-ac25-7257acb5afa7 tempest-SnapshotMetadataTestJSON-396608567 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce1f95bc-6606-4930-86ec-e84de6a5e470(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:12:14 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[676921be-ad6a-458f-87ba-54b9a227a355]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:12:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9fb6a42e-48a8-4aa7-ac25-7257acb5afa7 tempest-SnapshotMetadataTestJSON-396608567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ce1f95bc-6606-4930-86ec-e84de6a5e470 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:15 devstack sudo[89607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ce1f95bc-6606-4930-86ec-e84de6a5e470 Sep 23 00:12:15 devstack sudo[89607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:15 devstack sudo[89607]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9fb6a42e-48a8-4aa7-ac25-7257acb5afa7 tempest-SnapshotMetadataTestJSON-396608567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ce1f95bc-6606-4930-86ec-e84de6a5e470" returned: 0 in 1.239s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9fb6a42e-48a8-4aa7-ac25-7257acb5afa7 tempest-SnapshotMetadataTestJSON-396608567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ce1f95bc-6606-4930-86ec-e84de6a5e470.50573c35-0183-40da-b07f-13821f8dbb17 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:15 devstack sudo[89624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ce1f95bc-6606-4930-86ec-e84de6a5e470.50573c35-0183-40da-b07f-13821f8dbb17 Sep 23 00:12:15 devstack sudo[89624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:16 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:12:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:12:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:12:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:12:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:12:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:12:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:16 devstack sudo[89624]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9fb6a42e-48a8-4aa7-ac25-7257acb5afa7 tempest-SnapshotMetadataTestJSON-396608567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ce1f95bc-6606-4930-86ec-e84de6a5e470.50573c35-0183-40da-b07f-13821f8dbb17" returned: 0 in 0.917s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9fb6a42e-48a8-4aa7-ac25-7257acb5afa7 tempest-SnapshotMetadataTestJSON-396608567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ce1f95bc-6606-4930-86ec-e84de6a5e470.50573c35-0183-40da-b07f-13821f8dbb17 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:16 devstack sudo[89651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:12:16 devstack sudo[89651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:16 devstack sudo[89655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ce1f95bc-6606-4930-86ec-e84de6a5e470.50573c35-0183-40da-b07f-13821f8dbb17 Sep 23 00:12:16 devstack sudo[89655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:17 devstack sudo[89655]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9fb6a42e-48a8-4aa7-ac25-7257acb5afa7 tempest-SnapshotMetadataTestJSON-396608567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ce1f95bc-6606-4930-86ec-e84de6a5e470.50573c35-0183-40da-b07f-13821f8dbb17" returned: 0 in 0.707s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:17 devstack sudo[89651]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.868s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:17 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:12:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9fb6a42e-48a8-4aa7-ac25-7257acb5afa7 tempest-SnapshotMetadataTestJSON-396608567 None] Lock "cinder-quobyte-50573c35-0183-40da-b07f-13821f8dbb17" released by "_delete_snapshot" :: held 3.926s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:12:17 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running periodic task VolumeManager._thread_info {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:12:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] thread count: 8 {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:12:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] thread info: [<_MainThread(MainThread, started 135440660459648)>, , , , , , , ] {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:12:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9fb6a42e-48a8-4aa7-ac25-7257acb5afa7 tempest-SnapshotMetadataTestJSON-396608567 None] Lock "cinder-quobyte-ce1f95bc-6606-4930-86ec-e84de6a5e470" released by "delete_snapshot" :: held 3.992s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:12:17 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-9fb6a42e-48a8-4aa7-ac25-7257acb5afa7 tempest-SnapshotMetadataTestJSON-396608567 None] Created reservations ['c5d2326b-8dbd-4e4a-b4d9-1e121ffcfd89', 'b175ef72-f010-4869-b015-6c9c79d3aa5a', '7d893231-a2a9-4d17-a9d5-f26151e65d14', '521e012f-f344-45af-9ec6-53c632b0b38a'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:12:17 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-9fb6a42e-48a8-4aa7-ac25-7257acb5afa7 tempest-SnapshotMetadataTestJSON-396608567 None] Delete snapshot completed successfully. Sep 23 00:12:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9fb6a42e-48a8-4aa7-ac25-7257acb5afa7 tempest-SnapshotMetadataTestJSON-396608567 None] Lock "cinder-50573c35-0183-40da-b07f-13821f8dbb17-delete_snapshot" released by "delete_snapshot" :: held 4.378s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:12:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-870cfaec-b43e-452b-a16b-8c79132f0618 tempest-SnapshotMetadataTestJSON-396608567 None] Acquiring lock "cinder-ce1f95bc-6606-4930-86ec-e84de6a5e470-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:12:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-870cfaec-b43e-452b-a16b-8c79132f0618 tempest-SnapshotMetadataTestJSON-396608567 None] Lock "cinder-ce1f95bc-6606-4930-86ec-e84de6a5e470-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:12:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-870cfaec-b43e-452b-a16b-8c79132f0618 tempest-SnapshotMetadataTestJSON-396608567 None] Acquiring lock "cinder-quobyte-ce1f95bc-6606-4930-86ec-e84de6a5e470" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:12:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-870cfaec-b43e-452b-a16b-8c79132f0618 tempest-SnapshotMetadataTestJSON-396608567 None] Lock "cinder-quobyte-ce1f95bc-6606-4930-86ec-e84de6a5e470" acquired by "delete_volume" :: waited 0.058s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:12:18 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fdc4525-352c-4221-8567-e750b798e341]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:12:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-870cfaec-b43e-452b-a16b-8c79132f0618 tempest-SnapshotMetadataTestJSON-396608567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ce1f95bc-6606-4930-86ec-e84de6a5e470 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:18 devstack sudo[89661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ce1f95bc-6606-4930-86ec-e84de6a5e470 Sep 23 00:12:18 devstack sudo[89661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:19 devstack sudo[89661]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-870cfaec-b43e-452b-a16b-8c79132f0618 tempest-SnapshotMetadataTestJSON-396608567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ce1f95bc-6606-4930-86ec-e84de6a5e470" returned: 0 in 1.110s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-870cfaec-b43e-452b-a16b-8c79132f0618 tempest-SnapshotMetadataTestJSON-396608567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ce1f95bc-6606-4930-86ec-e84de6a5e470 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:19 devstack sudo[89667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ce1f95bc-6606-4930-86ec-e84de6a5e470 Sep 23 00:12:19 devstack sudo[89667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:20 devstack sudo[89667]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-870cfaec-b43e-452b-a16b-8c79132f0618 tempest-SnapshotMetadataTestJSON-396608567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ce1f95bc-6606-4930-86ec-e84de6a5e470" returned: 0 in 0.798s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:20 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-870cfaec-b43e-452b-a16b-8c79132f0618 tempest-SnapshotMetadataTestJSON-396608567 None] Lock "cinder-quobyte-ce1f95bc-6606-4930-86ec-e84de6a5e470" released by "delete_volume" :: held 2.026s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:12:20 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-870cfaec-b43e-452b-a16b-8c79132f0618 tempest-SnapshotMetadataTestJSON-396608567 None] Created reservations ['87cd1126-04cc-4b0b-80b5-34b343668744', '81931e04-c98b-46c2-84b1-9963bde8f6d4', '0cb039ab-1471-4846-82e4-b4b88fbd4533', '23eddb2a-5fc8-48f3-8589-d26d991ad1b9'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:12:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-870cfaec-b43e-452b-a16b-8c79132f0618 tempest-SnapshotMetadataTestJSON-396608567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:12:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-870cfaec-b43e-452b-a16b-8c79132f0618 tempest-SnapshotMetadataTestJSON-396608567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:12:20 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-870cfaec-b43e-452b-a16b-8c79132f0618 tempest-SnapshotMetadataTestJSON-396608567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:12:20 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-870cfaec-b43e-452b-a16b-8c79132f0618 tempest-SnapshotMetadataTestJSON-396608567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:12:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-870cfaec-b43e-452b-a16b-8c79132f0618 tempest-SnapshotMetadataTestJSON-396608567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:12:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-870cfaec-b43e-452b-a16b-8c79132f0618 tempest-SnapshotMetadataTestJSON-396608567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:21 devstack sudo[89672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:12:21 devstack sudo[89672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:21 devstack sudo[89672]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-870cfaec-b43e-452b-a16b-8c79132f0618 tempest-SnapshotMetadataTestJSON-396608567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.879s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:21 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-870cfaec-b43e-452b-a16b-8c79132f0618 tempest-SnapshotMetadataTestJSON-396608567 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:12:21 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-870cfaec-b43e-452b-a16b-8c79132f0618 tempest-SnapshotMetadataTestJSON-396608567 None] Deleted volume successfully. Sep 23 00:12:21 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-870cfaec-b43e-452b-a16b-8c79132f0618 tempest-SnapshotMetadataTestJSON-396608567 None] Lock "cinder-ce1f95bc-6606-4930-86ec-e84de6a5e470-delete_volume" released by "delete_volume" :: held 3.601s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:12:23 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-023fbd31-2d90-47ee-a292-d8b06e433d2d tempest-ServerRescueNegativeTestJSON-1460221086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:12:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-023fbd31-2d90-47ee-a292-d8b06e433d2d tempest-ServerRescueNegativeTestJSON-1460221086 None] Flow 'volume_create_manager' (585b898a-26c9-4ac3-983a-d9009acab05b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:12:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-023fbd31-2d90-47ee-a292-d8b06e433d2d tempest-ServerRescueNegativeTestJSON-1460221086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fa9cb53-b417-48ee-9c52-27805bb72999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-023fbd31-2d90-47ee-a292-d8b06e433d2d tempest-ServerRescueNegativeTestJSON-1460221086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fa9cb53-b417-48ee-9c52-27805bb72999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1738219219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad890a2b-8d78-45ce-95cc-a6c720e6f0c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69f3a99f3d9c4993a73ba9cd0e1c9fe9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:12:24Z,use_quota=True,user_id='d9e3904c1ccb451ea342512626291e6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-023fbd31-2d90-47ee-a292-d8b06e433d2d tempest-ServerRescueNegativeTestJSON-1460221086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3963660-ea7c-4a79-9004-cba720e7cfab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-023fbd31-2d90-47ee-a292-d8b06e433d2d tempest-ServerRescueNegativeTestJSON-1460221086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3963660-ea7c-4a79-9004-cba720e7cfab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-023fbd31-2d90-47ee-a292-d8b06e433d2d tempest-ServerRescueNegativeTestJSON-1460221086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f07167e-b2b8-46fe-a692-abc94dc3e3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-023fbd31-2d90-47ee-a292-d8b06e433d2d tempest-ServerRescueNegativeTestJSON-1460221086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f07167e-b2b8-46fe-a692-abc94dc3e3de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad890a2b-8d78-45ce-95cc-a6c720e6f0c8', 'volume_name': 'volume-ad890a2b-8d78-45ce-95cc-a6c720e6f0c8', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-023fbd31-2d90-47ee-a292-d8b06e433d2d tempest-ServerRescueNegativeTestJSON-1460221086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a645c07a-faf5-4dc8-9ae5-633afe18f320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-023fbd31-2d90-47ee-a292-d8b06e433d2d tempest-ServerRescueNegativeTestJSON-1460221086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a645c07a-faf5-4dc8-9ae5-633afe18f320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-023fbd31-2d90-47ee-a292-d8b06e433d2d tempest-ServerRescueNegativeTestJSON-1460221086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (094b055f-d3d0-45ff-a26b-affa7a579c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:24 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-023fbd31-2d90-47ee-a292-d8b06e433d2d tempest-ServerRescueNegativeTestJSON-1460221086 None] Volume ad890a2b-8d78-45ce-95cc-a6c720e6f0c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad890a2b-8d78-45ce-95cc-a6c720e6f0c8', 'volume_size': 1} Sep 23 00:12:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-023fbd31-2d90-47ee-a292-d8b06e433d2d tempest-ServerRescueNegativeTestJSON-1460221086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:12:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-023fbd31-2d90-47ee-a292-d8b06e433d2d tempest-ServerRescueNegativeTestJSON-1460221086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:12:24 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-023fbd31-2d90-47ee-a292-d8b06e433d2d tempest-ServerRescueNegativeTestJSON-1460221086 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1738219219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad890a2b-8d78-45ce-95cc-a6c720e6f0c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69f3a99f3d9c4993a73ba9cd0e1c9fe9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:12:24Z,use_quota=True,user_id='d9e3904c1ccb451ea342512626291e6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:12:24 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-023fbd31-2d90-47ee-a292-d8b06e433d2d tempest-ServerRescueNegativeTestJSON-1460221086 None] Creating volume ad890a2b-8d78-45ce-95cc-a6c720e6f0c8 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:12:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-023fbd31-2d90-47ee-a292-d8b06e433d2d tempest-ServerRescueNegativeTestJSON-1460221086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:12:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-023fbd31-2d90-47ee-a292-d8b06e433d2d tempest-ServerRescueNegativeTestJSON-1460221086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:12:24 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-023fbd31-2d90-47ee-a292-d8b06e433d2d tempest-ServerRescueNegativeTestJSON-1460221086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:12:24 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-023fbd31-2d90-47ee-a292-d8b06e433d2d tempest-ServerRescueNegativeTestJSON-1460221086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:12:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-023fbd31-2d90-47ee-a292-d8b06e433d2d tempest-ServerRescueNegativeTestJSON-1460221086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:12:24 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-023fbd31-2d90-47ee-a292-d8b06e433d2d tempest-ServerRescueNegativeTestJSON-1460221086 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:12:24 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-023fbd31-2d90-47ee-a292-d8b06e433d2d tempest-ServerRescueNegativeTestJSON-1460221086 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:12:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-023fbd31-2d90-47ee-a292-d8b06e433d2d tempest-ServerRescueNegativeTestJSON-1460221086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ad890a2b-8d78-45ce-95cc-a6c720e6f0c8 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:24 devstack sudo[89679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ad890a2b-8d78-45ce-95cc-a6c720e6f0c8 1073741824 Sep 23 00:12:24 devstack sudo[89679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:25 devstack sudo[89679]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-023fbd31-2d90-47ee-a292-d8b06e433d2d tempest-ServerRescueNegativeTestJSON-1460221086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ad890a2b-8d78-45ce-95cc-a6c720e6f0c8 1073741824" returned: 0 in 1.236s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-023fbd31-2d90-47ee-a292-d8b06e433d2d tempest-ServerRescueNegativeTestJSON-1460221086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ad890a2b-8d78-45ce-95cc-a6c720e6f0c8 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:25 devstack sudo[89711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ad890a2b-8d78-45ce-95cc-a6c720e6f0c8 Sep 23 00:12:25 devstack sudo[89711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:26 devstack sudo[89711]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-023fbd31-2d90-47ee-a292-d8b06e433d2d tempest-ServerRescueNegativeTestJSON-1460221086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ad890a2b-8d78-45ce-95cc-a6c720e6f0c8" returned: 0 in 0.734s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:26 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-023fbd31-2d90-47ee-a292-d8b06e433d2d tempest-ServerRescueNegativeTestJSON-1460221086 None] <== create_volume: return (2113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:12:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-023fbd31-2d90-47ee-a292-d8b06e433d2d tempest-ServerRescueNegativeTestJSON-1460221086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.120s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:12:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-023fbd31-2d90-47ee-a292-d8b06e433d2d tempest-ServerRescueNegativeTestJSON-1460221086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (094b055f-d3d0-45ff-a26b-affa7a579c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad890a2b-8d78-45ce-95cc-a6c720e6f0c8', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-023fbd31-2d90-47ee-a292-d8b06e433d2d tempest-ServerRescueNegativeTestJSON-1460221086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b564572-9248-455b-9b5a-cafa03e109bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:26 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-023fbd31-2d90-47ee-a292-d8b06e433d2d tempest-ServerRescueNegativeTestJSON-1460221086 None] Volume volume-ad890a2b-8d78-45ce-95cc-a6c720e6f0c8 (ad890a2b-8d78-45ce-95cc-a6c720e6f0c8): created successfully Sep 23 00:12:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-023fbd31-2d90-47ee-a292-d8b06e433d2d tempest-ServerRescueNegativeTestJSON-1460221086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b564572-9248-455b-9b5a-cafa03e109bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-023fbd31-2d90-47ee-a292-d8b06e433d2d tempest-ServerRescueNegativeTestJSON-1460221086 None] Flow 'volume_create_manager' (585b898a-26c9-4ac3-983a-d9009acab05b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:12:26 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-023fbd31-2d90-47ee-a292-d8b06e433d2d tempest-ServerRescueNegativeTestJSON-1460221086 None] Created volume successfully. Sep 23 00:12:36 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=20,cinder:UPDATE=19,cinder:INSERT=6,cinder:DELETE=2 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:12:36 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=18,cinder:UPDATE=23,cinder:DELETE=2,cinder:INSERT=5 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:12:36 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-468ecac7-2a9b-49c7-8e3a-3c4e42cf7b88 tempest-VolumesTransfersTest-2103863827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:12:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-468ecac7-2a9b-49c7-8e3a-3c4e42cf7b88 tempest-VolumesTransfersTest-2103863827 None] Flow 'volume_create_manager' (1bc23435-e9ff-443d-9501-81b668ccceb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:12:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-468ecac7-2a9b-49c7-8e3a-3c4e42cf7b88 tempest-VolumesTransfersTest-2103863827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (912031a0-e97b-4a8f-b35a-79c3b091dd86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-468ecac7-2a9b-49c7-8e3a-3c4e42cf7b88 tempest-VolumesTransfersTest-2103863827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (912031a0-e97b-4a8f-b35a-79c3b091dd86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:12:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2034648803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12e9eb5e-4209-43bf-9e35-34a40d03ab9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81a79352273241bd980aadbefe2abaf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:12:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:12:37Z,use_quota=True,user_id='173a1ef5c87c49918b9289160dff4a99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-468ecac7-2a9b-49c7-8e3a-3c4e42cf7b88 tempest-VolumesTransfersTest-2103863827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (994ea8d6-0307-4574-8a94-f1e37039268a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-468ecac7-2a9b-49c7-8e3a-3c4e42cf7b88 tempest-VolumesTransfersTest-2103863827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (994ea8d6-0307-4574-8a94-f1e37039268a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-468ecac7-2a9b-49c7-8e3a-3c4e42cf7b88 tempest-VolumesTransfersTest-2103863827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d2d0d86-b422-4b42-ae21-a49e8ef3c029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-468ecac7-2a9b-49c7-8e3a-3c4e42cf7b88 tempest-VolumesTransfersTest-2103863827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d2d0d86-b422-4b42-ae21-a49e8ef3c029) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12e9eb5e-4209-43bf-9e35-34a40d03ab9d', 'volume_name': 'volume-12e9eb5e-4209-43bf-9e35-34a40d03ab9d', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-468ecac7-2a9b-49c7-8e3a-3c4e42cf7b88 tempest-VolumesTransfersTest-2103863827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79549e9c-ced7-4d90-a5a6-c5f4eb7938fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-468ecac7-2a9b-49c7-8e3a-3c4e42cf7b88 tempest-VolumesTransfersTest-2103863827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79549e9c-ced7-4d90-a5a6-c5f4eb7938fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-468ecac7-2a9b-49c7-8e3a-3c4e42cf7b88 tempest-VolumesTransfersTest-2103863827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fae35c5a-562a-4b15-a34b-1f5766ecdf5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:37 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-468ecac7-2a9b-49c7-8e3a-3c4e42cf7b88 tempest-VolumesTransfersTest-2103863827 None] Volume 12e9eb5e-4209-43bf-9e35-34a40d03ab9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12e9eb5e-4209-43bf-9e35-34a40d03ab9d', 'volume_size': 1} Sep 23 00:12:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-468ecac7-2a9b-49c7-8e3a-3c4e42cf7b88 tempest-VolumesTransfersTest-2103863827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:12:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-468ecac7-2a9b-49c7-8e3a-3c4e42cf7b88 tempest-VolumesTransfersTest-2103863827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:12:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-468ecac7-2a9b-49c7-8e3a-3c4e42cf7b88 tempest-VolumesTransfersTest-2103863827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:12:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2034648803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12e9eb5e-4209-43bf-9e35-34a40d03ab9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81a79352273241bd980aadbefe2abaf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:12:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:12:37Z,use_quota=True,user_id='173a1ef5c87c49918b9289160dff4a99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:12:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-468ecac7-2a9b-49c7-8e3a-3c4e42cf7b88 tempest-VolumesTransfersTest-2103863827 None] Creating volume 12e9eb5e-4209-43bf-9e35-34a40d03ab9d {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:12:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-468ecac7-2a9b-49c7-8e3a-3c4e42cf7b88 tempest-VolumesTransfersTest-2103863827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:12:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-468ecac7-2a9b-49c7-8e3a-3c4e42cf7b88 tempest-VolumesTransfersTest-2103863827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:12:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-468ecac7-2a9b-49c7-8e3a-3c4e42cf7b88 tempest-VolumesTransfersTest-2103863827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:12:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-468ecac7-2a9b-49c7-8e3a-3c4e42cf7b88 tempest-VolumesTransfersTest-2103863827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:12:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-468ecac7-2a9b-49c7-8e3a-3c4e42cf7b88 tempest-VolumesTransfersTest-2103863827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:12:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-468ecac7-2a9b-49c7-8e3a-3c4e42cf7b88 tempest-VolumesTransfersTest-2103863827 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:12:37 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-468ecac7-2a9b-49c7-8e3a-3c4e42cf7b88 tempest-VolumesTransfersTest-2103863827 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:12:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-468ecac7-2a9b-49c7-8e3a-3c4e42cf7b88 tempest-VolumesTransfersTest-2103863827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-12e9eb5e-4209-43bf-9e35-34a40d03ab9d 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:37 devstack sudo[89865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-12e9eb5e-4209-43bf-9e35-34a40d03ab9d 1073741824 Sep 23 00:12:37 devstack sudo[89865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:38 devstack sudo[89865]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-468ecac7-2a9b-49c7-8e3a-3c4e42cf7b88 tempest-VolumesTransfersTest-2103863827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-12e9eb5e-4209-43bf-9e35-34a40d03ab9d 1073741824" returned: 0 in 1.707s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-468ecac7-2a9b-49c7-8e3a-3c4e42cf7b88 tempest-VolumesTransfersTest-2103863827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-12e9eb5e-4209-43bf-9e35-34a40d03ab9d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:38 devstack sudo[89875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-12e9eb5e-4209-43bf-9e35-34a40d03ab9d Sep 23 00:12:38 devstack sudo[89875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:39 devstack sudo[89875]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-468ecac7-2a9b-49c7-8e3a-3c4e42cf7b88 tempest-VolumesTransfersTest-2103863827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-12e9eb5e-4209-43bf-9e35-34a40d03ab9d" returned: 0 in 0.558s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:39 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-468ecac7-2a9b-49c7-8e3a-3c4e42cf7b88 tempest-VolumesTransfersTest-2103863827 None] <== create_volume: return (2371ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:12:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-468ecac7-2a9b-49c7-8e3a-3c4e42cf7b88 tempest-VolumesTransfersTest-2103863827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.386s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:12:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-468ecac7-2a9b-49c7-8e3a-3c4e42cf7b88 tempest-VolumesTransfersTest-2103863827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fae35c5a-562a-4b15-a34b-1f5766ecdf5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12e9eb5e-4209-43bf-9e35-34a40d03ab9d', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-468ecac7-2a9b-49c7-8e3a-3c4e42cf7b88 tempest-VolumesTransfersTest-2103863827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89ed2f32-8e15-4a2e-b110-371c0c9b3368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:39 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-468ecac7-2a9b-49c7-8e3a-3c4e42cf7b88 tempest-VolumesTransfersTest-2103863827 None] Volume volume-12e9eb5e-4209-43bf-9e35-34a40d03ab9d (12e9eb5e-4209-43bf-9e35-34a40d03ab9d): created successfully Sep 23 00:12:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-468ecac7-2a9b-49c7-8e3a-3c4e42cf7b88 tempest-VolumesTransfersTest-2103863827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89ed2f32-8e15-4a2e-b110-371c0c9b3368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-468ecac7-2a9b-49c7-8e3a-3c4e42cf7b88 tempest-VolumesTransfersTest-2103863827 None] Flow 'volume_create_manager' (1bc23435-e9ff-443d-9501-81b668ccceb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:12:39 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-468ecac7-2a9b-49c7-8e3a-3c4e42cf7b88 tempest-VolumesTransfersTest-2103863827 None] Created volume successfully. Sep 23 00:12:41 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-d2951a73-a4ae-4628-8a25-061e5ba568be tempest-VolumesTransfersTest-369241042 None] Transfer volume completed successfully. Sep 23 00:12:43 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-981b833d-f51b-40e9-98d5-7dfc330c284e tempest-VolumesTransfersTest-447189268 None] Acquiring lock "cinder-12e9eb5e-4209-43bf-9e35-34a40d03ab9d-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:12:43 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-981b833d-f51b-40e9-98d5-7dfc330c284e tempest-VolumesTransfersTest-447189268 None] Lock "cinder-12e9eb5e-4209-43bf-9e35-34a40d03ab9d-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:12:43 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-981b833d-f51b-40e9-98d5-7dfc330c284e tempest-VolumesTransfersTest-447189268 None] Acquiring lock "cinder-quobyte-12e9eb5e-4209-43bf-9e35-34a40d03ab9d" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:12:43 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-981b833d-f51b-40e9-98d5-7dfc330c284e tempest-VolumesTransfersTest-447189268 None] Lock "cinder-quobyte-12e9eb5e-4209-43bf-9e35-34a40d03ab9d" acquired by "delete_volume" :: waited 0.030s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:12:43 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[634f6b69-07fa-4611-8c78-bd49544d6daa]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:12:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-981b833d-f51b-40e9-98d5-7dfc330c284e tempest-VolumesTransfersTest-447189268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-12e9eb5e-4209-43bf-9e35-34a40d03ab9d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:43 devstack sudo[89928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-12e9eb5e-4209-43bf-9e35-34a40d03ab9d Sep 23 00:12:43 devstack sudo[89928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:43 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6574ad5b-be49-413f-8629-ae987c161835 tempest-ServerRescueNegativeTestJSON-1460221086 None] Acquiring lock "cinder-ad890a2b-8d78-45ce-95cc-a6c720e6f0c8-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:12:43 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6574ad5b-be49-413f-8629-ae987c161835 tempest-ServerRescueNegativeTestJSON-1460221086 None] Lock "cinder-ad890a2b-8d78-45ce-95cc-a6c720e6f0c8-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:12:43 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6574ad5b-be49-413f-8629-ae987c161835 tempest-ServerRescueNegativeTestJSON-1460221086 None] Acquiring lock "cinder-quobyte-ad890a2b-8d78-45ce-95cc-a6c720e6f0c8" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:12:43 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6574ad5b-be49-413f-8629-ae987c161835 tempest-ServerRescueNegativeTestJSON-1460221086 None] Lock "cinder-quobyte-ad890a2b-8d78-45ce-95cc-a6c720e6f0c8" acquired by "delete_volume" :: waited 0.035s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:12:43 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cdbb887-07c8-443a-8e07-8d5c65dc6d53]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:12:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6574ad5b-be49-413f-8629-ae987c161835 tempest-ServerRescueNegativeTestJSON-1460221086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ad890a2b-8d78-45ce-95cc-a6c720e6f0c8 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:44 devstack sudo[89930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ad890a2b-8d78-45ce-95cc-a6c720e6f0c8 Sep 23 00:12:44 devstack sudo[89930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:44 devstack sudo[89928]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-981b833d-f51b-40e9-98d5-7dfc330c284e tempest-VolumesTransfersTest-447189268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-12e9eb5e-4209-43bf-9e35-34a40d03ab9d" returned: 0 in 1.134s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-981b833d-f51b-40e9-98d5-7dfc330c284e tempest-VolumesTransfersTest-447189268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-12e9eb5e-4209-43bf-9e35-34a40d03ab9d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:44 devstack sudo[89935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-12e9eb5e-4209-43bf-9e35-34a40d03ab9d Sep 23 00:12:44 devstack sudo[89935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:44 devstack sudo[89930]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6574ad5b-be49-413f-8629-ae987c161835 tempest-ServerRescueNegativeTestJSON-1460221086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ad890a2b-8d78-45ce-95cc-a6c720e6f0c8" returned: 0 in 0.763s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6574ad5b-be49-413f-8629-ae987c161835 tempest-ServerRescueNegativeTestJSON-1460221086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ad890a2b-8d78-45ce-95cc-a6c720e6f0c8 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:44 devstack sudo[89940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ad890a2b-8d78-45ce-95cc-a6c720e6f0c8 Sep 23 00:12:44 devstack sudo[89940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:44 devstack sudo[89935]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-981b833d-f51b-40e9-98d5-7dfc330c284e tempest-VolumesTransfersTest-447189268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-12e9eb5e-4209-43bf-9e35-34a40d03ab9d" returned: 0 in 0.466s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:44 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-981b833d-f51b-40e9-98d5-7dfc330c284e tempest-VolumesTransfersTest-447189268 None] Lock "cinder-quobyte-12e9eb5e-4209-43bf-9e35-34a40d03ab9d" released by "delete_volume" :: held 1.707s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:12:45 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-981b833d-f51b-40e9-98d5-7dfc330c284e tempest-VolumesTransfersTest-447189268 None] Created reservations ['9c2d3337-e81b-4f31-8c1f-8bc397a1eb92', '14cc8bc0-8aa3-4170-af3f-2e709871726b', '7e2886e2-c3f5-43e4-b6e8-15267a6c8898', '0cac15f3-2efe-40ad-8438-0e2fa3573967'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:12:45 devstack sudo[89940]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6574ad5b-be49-413f-8629-ae987c161835 tempest-ServerRescueNegativeTestJSON-1460221086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ad890a2b-8d78-45ce-95cc-a6c720e6f0c8" returned: 0 in 0.339s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:45 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6574ad5b-be49-413f-8629-ae987c161835 tempest-ServerRescueNegativeTestJSON-1460221086 None] Lock "cinder-quobyte-ad890a2b-8d78-45ce-95cc-a6c720e6f0c8" released by "delete_volume" :: held 1.230s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:12:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-981b833d-f51b-40e9-98d5-7dfc330c284e tempest-VolumesTransfersTest-447189268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:12:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-981b833d-f51b-40e9-98d5-7dfc330c284e tempest-VolumesTransfersTest-447189268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:12:45 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-981b833d-f51b-40e9-98d5-7dfc330c284e tempest-VolumesTransfersTest-447189268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:12:45 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-981b833d-f51b-40e9-98d5-7dfc330c284e tempest-VolumesTransfersTest-447189268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:12:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-981b833d-f51b-40e9-98d5-7dfc330c284e tempest-VolumesTransfersTest-447189268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:12:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-981b833d-f51b-40e9-98d5-7dfc330c284e tempest-VolumesTransfersTest-447189268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:45 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-6574ad5b-be49-413f-8629-ae987c161835 tempest-ServerRescueNegativeTestJSON-1460221086 None] Created reservations ['0465648b-50d3-45ea-8ba3-2ae77a6a903d', '2c03f715-a6fb-41d6-a2b9-1528b02b4767', 'fed65831-1233-4200-80d2-1e5f1114f509', '58c537df-3d7e-4990-9312-70952e629cb3'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:12:45 devstack sudo[89944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:12:45 devstack sudo[89944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6574ad5b-be49-413f-8629-ae987c161835 tempest-ServerRescueNegativeTestJSON-1460221086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:12:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6574ad5b-be49-413f-8629-ae987c161835 tempest-ServerRescueNegativeTestJSON-1460221086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:12:45 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6574ad5b-be49-413f-8629-ae987c161835 tempest-ServerRescueNegativeTestJSON-1460221086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:12:45 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6574ad5b-be49-413f-8629-ae987c161835 tempest-ServerRescueNegativeTestJSON-1460221086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:12:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6574ad5b-be49-413f-8629-ae987c161835 tempest-ServerRescueNegativeTestJSON-1460221086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:12:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6574ad5b-be49-413f-8629-ae987c161835 tempest-ServerRescueNegativeTestJSON-1460221086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:45 devstack sudo[89946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:12:45 devstack sudo[89946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:45 devstack sudo[89944]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:45 devstack sudo[89946]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6574ad5b-be49-413f-8629-ae987c161835 tempest-ServerRescueNegativeTestJSON-1460221086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.352s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-981b833d-f51b-40e9-98d5-7dfc330c284e tempest-VolumesTransfersTest-447189268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.543s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:45 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-6574ad5b-be49-413f-8629-ae987c161835 tempest-ServerRescueNegativeTestJSON-1460221086 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:12:45 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-981b833d-f51b-40e9-98d5-7dfc330c284e tempest-VolumesTransfersTest-447189268 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:12:45 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-6574ad5b-be49-413f-8629-ae987c161835 tempest-ServerRescueNegativeTestJSON-1460221086 None] Deleted volume successfully. Sep 23 00:12:45 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6574ad5b-be49-413f-8629-ae987c161835 tempest-ServerRescueNegativeTestJSON-1460221086 None] Lock "cinder-ad890a2b-8d78-45ce-95cc-a6c720e6f0c8-delete_volume" released by "delete_volume" :: held 2.094s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:12:45 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-981b833d-f51b-40e9-98d5-7dfc330c284e tempest-VolumesTransfersTest-447189268 None] Deleted volume successfully. Sep 23 00:12:45 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-981b833d-f51b-40e9-98d5-7dfc330c284e tempest-VolumesTransfersTest-447189268 None] Lock "cinder-12e9eb5e-4209-43bf-9e35-34a40d03ab9d-delete_volume" released by "delete_volume" :: held 2.781s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:12:46 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b974a2b-34b8-4616-b4d1-b4c7e264caac tempest-VolumesTransfersTest-2103863827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:12:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4b974a2b-34b8-4616-b4d1-b4c7e264caac tempest-VolumesTransfersTest-2103863827 None] Flow 'volume_create_manager' (d3e7175f-76dd-4dc2-b208-e6a0bd3833a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:12:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4b974a2b-34b8-4616-b4d1-b4c7e264caac tempest-VolumesTransfersTest-2103863827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e3fa8a4-1d87-4805-9262-4df025d08482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4b974a2b-34b8-4616-b4d1-b4c7e264caac tempest-VolumesTransfersTest-2103863827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e3fa8a4-1d87-4805-9262-4df025d08482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-287985175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4b37ed7-7135-4739-bd49-95481d0655ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81a79352273241bd980aadbefe2abaf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:12:46Z,use_quota=True,user_id='173a1ef5c87c49918b9289160dff4a99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4b974a2b-34b8-4616-b4d1-b4c7e264caac tempest-VolumesTransfersTest-2103863827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (929b350d-b864-45dd-a738-4d1aaaebe3d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4b974a2b-34b8-4616-b4d1-b4c7e264caac tempest-VolumesTransfersTest-2103863827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (929b350d-b864-45dd-a738-4d1aaaebe3d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4b974a2b-34b8-4616-b4d1-b4c7e264caac tempest-VolumesTransfersTest-2103863827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1580e338-4326-47ee-8fd2-01770c3631c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4b974a2b-34b8-4616-b4d1-b4c7e264caac tempest-VolumesTransfersTest-2103863827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1580e338-4326-47ee-8fd2-01770c3631c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4b37ed7-7135-4739-bd49-95481d0655ab', 'volume_name': 'volume-f4b37ed7-7135-4739-bd49-95481d0655ab', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4b974a2b-34b8-4616-b4d1-b4c7e264caac tempest-VolumesTransfersTest-2103863827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19b7297b-e815-45ca-ba89-045002497d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4b974a2b-34b8-4616-b4d1-b4c7e264caac tempest-VolumesTransfersTest-2103863827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19b7297b-e815-45ca-ba89-045002497d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4b974a2b-34b8-4616-b4d1-b4c7e264caac tempest-VolumesTransfersTest-2103863827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e08d1ff-ac9c-4325-a0dc-5f8a1dfbd7e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:46 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-4b974a2b-34b8-4616-b4d1-b4c7e264caac tempest-VolumesTransfersTest-2103863827 None] Volume f4b37ed7-7135-4739-bd49-95481d0655ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4b37ed7-7135-4739-bd49-95481d0655ab', 'volume_size': 1} Sep 23 00:12:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4b974a2b-34b8-4616-b4d1-b4c7e264caac tempest-VolumesTransfersTest-2103863827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:12:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4b974a2b-34b8-4616-b4d1-b4c7e264caac tempest-VolumesTransfersTest-2103863827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:12:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4b974a2b-34b8-4616-b4d1-b4c7e264caac tempest-VolumesTransfersTest-2103863827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-287985175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4b37ed7-7135-4739-bd49-95481d0655ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81a79352273241bd980aadbefe2abaf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:12:46Z,use_quota=True,user_id='173a1ef5c87c49918b9289160dff4a99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:12:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-4b974a2b-34b8-4616-b4d1-b4c7e264caac tempest-VolumesTransfersTest-2103863827 None] Creating volume f4b37ed7-7135-4739-bd49-95481d0655ab {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:12:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4b974a2b-34b8-4616-b4d1-b4c7e264caac tempest-VolumesTransfersTest-2103863827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:12:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4b974a2b-34b8-4616-b4d1-b4c7e264caac tempest-VolumesTransfersTest-2103863827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:12:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4b974a2b-34b8-4616-b4d1-b4c7e264caac tempest-VolumesTransfersTest-2103863827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:12:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4b974a2b-34b8-4616-b4d1-b4c7e264caac tempest-VolumesTransfersTest-2103863827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:12:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4b974a2b-34b8-4616-b4d1-b4c7e264caac tempest-VolumesTransfersTest-2103863827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:12:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4b974a2b-34b8-4616-b4d1-b4c7e264caac tempest-VolumesTransfersTest-2103863827 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:12:46 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-4b974a2b-34b8-4616-b4d1-b4c7e264caac tempest-VolumesTransfersTest-2103863827 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:12:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4b974a2b-34b8-4616-b4d1-b4c7e264caac tempest-VolumesTransfersTest-2103863827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f4b37ed7-7135-4739-bd49-95481d0655ab 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:46 devstack sudo[89952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f4b37ed7-7135-4739-bd49-95481d0655ab 1073741824 Sep 23 00:12:46 devstack sudo[89952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:47 devstack sudo[89952]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4b974a2b-34b8-4616-b4d1-b4c7e264caac tempest-VolumesTransfersTest-2103863827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f4b37ed7-7135-4739-bd49-95481d0655ab 1073741824" returned: 0 in 1.098s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4b974a2b-34b8-4616-b4d1-b4c7e264caac tempest-VolumesTransfersTest-2103863827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f4b37ed7-7135-4739-bd49-95481d0655ab {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:47 devstack sudo[89985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f4b37ed7-7135-4739-bd49-95481d0655ab Sep 23 00:12:47 devstack sudo[89985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:48 devstack sudo[89985]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4b974a2b-34b8-4616-b4d1-b4c7e264caac tempest-VolumesTransfersTest-2103863827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f4b37ed7-7135-4739-bd49-95481d0655ab" returned: 0 in 0.425s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:48 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4b974a2b-34b8-4616-b4d1-b4c7e264caac tempest-VolumesTransfersTest-2103863827 None] <== create_volume: return (1606ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:12:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4b974a2b-34b8-4616-b4d1-b4c7e264caac tempest-VolumesTransfersTest-2103863827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.618s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:12:48 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4b974a2b-34b8-4616-b4d1-b4c7e264caac tempest-VolumesTransfersTest-2103863827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e08d1ff-ac9c-4325-a0dc-5f8a1dfbd7e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4b37ed7-7135-4739-bd49-95481d0655ab', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:48 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4b974a2b-34b8-4616-b4d1-b4c7e264caac tempest-VolumesTransfersTest-2103863827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (546eaf23-37ae-4616-b5de-38c4185ff834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:48 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-4b974a2b-34b8-4616-b4d1-b4c7e264caac tempest-VolumesTransfersTest-2103863827 None] Volume volume-f4b37ed7-7135-4739-bd49-95481d0655ab (f4b37ed7-7135-4739-bd49-95481d0655ab): created successfully Sep 23 00:12:48 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4b974a2b-34b8-4616-b4d1-b4c7e264caac tempest-VolumesTransfersTest-2103863827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (546eaf23-37ae-4616-b5de-38c4185ff834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:48 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4b974a2b-34b8-4616-b4d1-b4c7e264caac tempest-VolumesTransfersTest-2103863827 None] Flow 'volume_create_manager' (d3e7175f-76dd-4dc2-b208-e6a0bd3833a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:12:48 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-4b974a2b-34b8-4616-b4d1-b4c7e264caac tempest-VolumesTransfersTest-2103863827 None] Created volume successfully. Sep 23 00:12:49 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-25a4acdd-1836-46a0-b569-408146c10484 tempest-VolumesTransfersTest-447189268 None] Acquiring lock "cinder-f4b37ed7-7135-4739-bd49-95481d0655ab-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:12:49 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-25a4acdd-1836-46a0-b569-408146c10484 tempest-VolumesTransfersTest-447189268 None] Lock "cinder-f4b37ed7-7135-4739-bd49-95481d0655ab-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:12:49 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-25a4acdd-1836-46a0-b569-408146c10484 tempest-VolumesTransfersTest-447189268 None] Acquiring lock "cinder-quobyte-f4b37ed7-7135-4739-bd49-95481d0655ab" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:12:49 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-25a4acdd-1836-46a0-b569-408146c10484 tempest-VolumesTransfersTest-447189268 None] Lock "cinder-quobyte-f4b37ed7-7135-4739-bd49-95481d0655ab" acquired by "delete_volume" :: waited 0.026s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:12:49 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[227780cb-835b-4b36-8e60-dd3ce7f428ba]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:12:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-25a4acdd-1836-46a0-b569-408146c10484 tempest-VolumesTransfersTest-447189268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f4b37ed7-7135-4739-bd49-95481d0655ab {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:49 devstack sudo[89991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f4b37ed7-7135-4739-bd49-95481d0655ab Sep 23 00:12:49 devstack sudo[89991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:50 devstack sudo[89991]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-25a4acdd-1836-46a0-b569-408146c10484 tempest-VolumesTransfersTest-447189268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f4b37ed7-7135-4739-bd49-95481d0655ab" returned: 0 in 0.672s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-25a4acdd-1836-46a0-b569-408146c10484 tempest-VolumesTransfersTest-447189268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f4b37ed7-7135-4739-bd49-95481d0655ab {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:50 devstack sudo[89996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f4b37ed7-7135-4739-bd49-95481d0655ab Sep 23 00:12:50 devstack sudo[89996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:50 devstack sudo[89996]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-25a4acdd-1836-46a0-b569-408146c10484 tempest-VolumesTransfersTest-447189268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f4b37ed7-7135-4739-bd49-95481d0655ab" returned: 0 in 0.495s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:50 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-25a4acdd-1836-46a0-b569-408146c10484 tempest-VolumesTransfersTest-447189268 None] Lock "cinder-quobyte-f4b37ed7-7135-4739-bd49-95481d0655ab" released by "delete_volume" :: held 1.232s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:12:50 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-25a4acdd-1836-46a0-b569-408146c10484 tempest-VolumesTransfersTest-447189268 None] Created reservations ['118a1974-7ec1-407f-a31d-fe64eebed9c6', '852a0ac0-895c-4156-963a-7ba1a87dddfe', '7779b819-e24e-494d-93f8-ca24e40c728f', '90cc03d0-e01a-4c34-b440-4e11fcc9e49a'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:12:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-25a4acdd-1836-46a0-b569-408146c10484 tempest-VolumesTransfersTest-447189268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:12:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-25a4acdd-1836-46a0-b569-408146c10484 tempest-VolumesTransfersTest-447189268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:12:50 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-25a4acdd-1836-46a0-b569-408146c10484 tempest-VolumesTransfersTest-447189268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:12:50 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-25a4acdd-1836-46a0-b569-408146c10484 tempest-VolumesTransfersTest-447189268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:12:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-25a4acdd-1836-46a0-b569-408146c10484 tempest-VolumesTransfersTest-447189268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:12:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-25a4acdd-1836-46a0-b569-408146c10484 tempest-VolumesTransfersTest-447189268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:50 devstack sudo[90000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:12:50 devstack sudo[90000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:51 devstack sudo[90000]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-25a4acdd-1836-46a0-b569-408146c10484 tempest-VolumesTransfersTest-447189268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.303s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:51 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-25a4acdd-1836-46a0-b569-408146c10484 tempest-VolumesTransfersTest-447189268 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:12:51 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-25a4acdd-1836-46a0-b569-408146c10484 tempest-VolumesTransfersTest-447189268 None] Deleted volume successfully. Sep 23 00:12:51 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-25a4acdd-1836-46a0-b569-408146c10484 tempest-VolumesTransfersTest-447189268 None] Lock "cinder-f4b37ed7-7135-4739-bd49-95481d0655ab-delete_volume" released by "delete_volume" :: held 1.854s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:13:01 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-30a26b5a-9ab2-400f-ba79-02b53d1ea578 tempest-VolumesCloneTest-9936986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:13:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-30a26b5a-9ab2-400f-ba79-02b53d1ea578 tempest-VolumesCloneTest-9936986 None] Flow 'volume_create_manager' (444ae97c-ab1f-4f05-a51d-df58e9db6fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:13:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-30a26b5a-9ab2-400f-ba79-02b53d1ea578 tempest-VolumesCloneTest-9936986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69bc0b83-6102-45d2-9406-ceca306b82e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-30a26b5a-9ab2-400f-ba79-02b53d1ea578 tempest-VolumesCloneTest-9936986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69bc0b83-6102-45d2-9406-ceca306b82e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:13:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-700199926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=185bf163-f528-484c-acc1-92dc16eaf5d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6c1a41462c24258a50fe523be1080f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:13:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:13:01Z,use_quota=True,user_id='5183dce5bb5a43e0835901b7b0a065c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-30a26b5a-9ab2-400f-ba79-02b53d1ea578 tempest-VolumesCloneTest-9936986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f72f2b75-a140-4ef9-a174-9b1ebc374cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-30a26b5a-9ab2-400f-ba79-02b53d1ea578 tempest-VolumesCloneTest-9936986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f72f2b75-a140-4ef9-a174-9b1ebc374cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-30a26b5a-9ab2-400f-ba79-02b53d1ea578 tempest-VolumesCloneTest-9936986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c93c0202-4da4-415f-b7e6-756cc7c4201b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-30a26b5a-9ab2-400f-ba79-02b53d1ea578 tempest-VolumesCloneTest-9936986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c93c0202-4da4-415f-b7e6-756cc7c4201b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '185bf163-f528-484c-acc1-92dc16eaf5d5', 'volume_name': 'volume-185bf163-f528-484c-acc1-92dc16eaf5d5', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-30a26b5a-9ab2-400f-ba79-02b53d1ea578 tempest-VolumesCloneTest-9936986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8885f726-888a-48fe-8c80-1c7447347573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-30a26b5a-9ab2-400f-ba79-02b53d1ea578 tempest-VolumesCloneTest-9936986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8885f726-888a-48fe-8c80-1c7447347573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-30a26b5a-9ab2-400f-ba79-02b53d1ea578 tempest-VolumesCloneTest-9936986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d13d6dea-ae3d-423a-addc-011c74e9a7a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:01 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-30a26b5a-9ab2-400f-ba79-02b53d1ea578 tempest-VolumesCloneTest-9936986 None] Volume 185bf163-f528-484c-acc1-92dc16eaf5d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-185bf163-f528-484c-acc1-92dc16eaf5d5', 'volume_size': 1} Sep 23 00:13:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-30a26b5a-9ab2-400f-ba79-02b53d1ea578 tempest-VolumesCloneTest-9936986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:13:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-30a26b5a-9ab2-400f-ba79-02b53d1ea578 tempest-VolumesCloneTest-9936986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:13:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-30a26b5a-9ab2-400f-ba79-02b53d1ea578 tempest-VolumesCloneTest-9936986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:13:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-700199926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=185bf163-f528-484c-acc1-92dc16eaf5d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6c1a41462c24258a50fe523be1080f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:13:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:13:01Z,use_quota=True,user_id='5183dce5bb5a43e0835901b7b0a065c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:13:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-30a26b5a-9ab2-400f-ba79-02b53d1ea578 tempest-VolumesCloneTest-9936986 None] Creating volume 185bf163-f528-484c-acc1-92dc16eaf5d5 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:13:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-30a26b5a-9ab2-400f-ba79-02b53d1ea578 tempest-VolumesCloneTest-9936986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:13:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-30a26b5a-9ab2-400f-ba79-02b53d1ea578 tempest-VolumesCloneTest-9936986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:13:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-30a26b5a-9ab2-400f-ba79-02b53d1ea578 tempest-VolumesCloneTest-9936986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:13:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-30a26b5a-9ab2-400f-ba79-02b53d1ea578 tempest-VolumesCloneTest-9936986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:13:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-30a26b5a-9ab2-400f-ba79-02b53d1ea578 tempest-VolumesCloneTest-9936986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:13:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-30a26b5a-9ab2-400f-ba79-02b53d1ea578 tempest-VolumesCloneTest-9936986 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:13:01 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-30a26b5a-9ab2-400f-ba79-02b53d1ea578 tempest-VolumesCloneTest-9936986 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:13:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-30a26b5a-9ab2-400f-ba79-02b53d1ea578 tempest-VolumesCloneTest-9936986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-185bf163-f528-484c-acc1-92dc16eaf5d5 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:01 devstack sudo[90118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-185bf163-f528-484c-acc1-92dc16eaf5d5 1073741824 Sep 23 00:13:01 devstack sudo[90118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:02 devstack sudo[90118]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-30a26b5a-9ab2-400f-ba79-02b53d1ea578 tempest-VolumesCloneTest-9936986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-185bf163-f528-484c-acc1-92dc16eaf5d5 1073741824" returned: 0 in 0.612s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-30a26b5a-9ab2-400f-ba79-02b53d1ea578 tempest-VolumesCloneTest-9936986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-185bf163-f528-484c-acc1-92dc16eaf5d5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:02 devstack sudo[90125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-185bf163-f528-484c-acc1-92dc16eaf5d5 Sep 23 00:13:02 devstack sudo[90125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:02 devstack sudo[90125]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-30a26b5a-9ab2-400f-ba79-02b53d1ea578 tempest-VolumesCloneTest-9936986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-185bf163-f528-484c-acc1-92dc16eaf5d5" returned: 0 in 0.428s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:02 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-30a26b5a-9ab2-400f-ba79-02b53d1ea578 tempest-VolumesCloneTest-9936986 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:13:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-30a26b5a-9ab2-400f-ba79-02b53d1ea578 tempest-VolumesCloneTest-9936986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:13:02 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-30a26b5a-9ab2-400f-ba79-02b53d1ea578 tempest-VolumesCloneTest-9936986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d13d6dea-ae3d-423a-addc-011c74e9a7a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-185bf163-f528-484c-acc1-92dc16eaf5d5', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:02 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-30a26b5a-9ab2-400f-ba79-02b53d1ea578 tempest-VolumesCloneTest-9936986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c89b612-9ab5-4b85-9a23-8ac0dafbdff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:02 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-30a26b5a-9ab2-400f-ba79-02b53d1ea578 tempest-VolumesCloneTest-9936986 None] Volume volume-185bf163-f528-484c-acc1-92dc16eaf5d5 (185bf163-f528-484c-acc1-92dc16eaf5d5): created successfully Sep 23 00:13:02 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-30a26b5a-9ab2-400f-ba79-02b53d1ea578 tempest-VolumesCloneTest-9936986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c89b612-9ab5-4b85-9a23-8ac0dafbdff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:02 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-30a26b5a-9ab2-400f-ba79-02b53d1ea578 tempest-VolumesCloneTest-9936986 None] Flow 'volume_create_manager' (444ae97c-ab1f-4f05-a51d-df58e9db6fbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:13:02 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-30a26b5a-9ab2-400f-ba79-02b53d1ea578 tempest-VolumesCloneTest-9936986 None] Created volume successfully. Sep 23 00:13:05 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:13:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] Flow 'volume_create_manager' (12ba4b08-7eb1-4015-aaf0-aa043b3d422c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:13:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (712c7977-87ce-4e95-a035-50b183c89f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (712c7977-87ce-4e95-a035-50b183c89f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:13:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1815957985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=254756af-9995-4263-911d-68482993dfc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6c1a41462c24258a50fe523be1080f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:13:05Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=185bf163-f528-484c-acc1-92dc16eaf5d5,status='creating',terminated_at=None,updated_at=2026-09-22T22:13:05Z,use_quota=True,user_id='5183dce5bb5a43e0835901b7b0a065c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20ed0a7d-5232-4ccb-a5c0-c04af34974ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20ed0a7d-5232-4ccb-a5c0-c04af34974ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3f52275-a956-4a67-81ce-483d4ee9eda3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3f52275-a956-4a67-81ce-483d4ee9eda3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '254756af-9995-4263-911d-68482993dfc6', 'volume_name': 'volume-254756af-9995-4263-911d-68482993dfc6', 'volume_size': 2, 'source_volid': '185bf163-f528-484c-acc1-92dc16eaf5d5', 'source_volstatus': 'available'}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db5584e7-4eb0-430d-94aa-34d05490f8df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db5584e7-4eb0-430d-94aa-34d05490f8df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49db7dec-c97c-42f8-a193-90a039c69a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:05 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] Volume 254756af-9995-4263-911d-68482993dfc6: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-254756af-9995-4263-911d-68482993dfc6', 'volume_size': 2, 'source_volid': '185bf163-f528-484c-acc1-92dc16eaf5d5', 'source_volstatus': 'available'} Sep 23 00:13:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:13:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:13:05 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] Cloning volume 185bf163-f528-484c-acc1-92dc16eaf5d5 to volume 254756af-9995-4263-911d-68482993dfc6 Sep 23 00:13:05 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] Creating offline snapshot b4d28c11-1681-40fa-99a0-ee7413615df2 of volume 185bf163-f528-484c-acc1-92dc16eaf5d5 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:13:05 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bed9538-9502-4042-96de-b6817ec4bfaa]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:13:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-185bf163-f528-484c-acc1-92dc16eaf5d5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-65aa4e5b-00c4-4fb1-a27b-74bb431af5f0 req-4e696adc-70e4-4b53-bcd4-c228536cafe4 tempest-TaggedAttachmentsTest-1355663750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:13:05 devstack sudo[90193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-185bf163-f528-484c-acc1-92dc16eaf5d5 Sep 23 00:13:05 devstack sudo[90193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:05 devstack sudo[90193]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-185bf163-f528-484c-acc1-92dc16eaf5d5" returned: 0 in 0.593s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-185bf163-f528-484c-acc1-92dc16eaf5d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-185bf163-f528-484c-acc1-92dc16eaf5d5.b4d28c11-1681-40fa-99a0-ee7413615df2 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:06 devstack sudo[90199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-185bf163-f528-484c-acc1-92dc16eaf5d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-185bf163-f528-484c-acc1-92dc16eaf5d5.b4d28c11-1681-40fa-99a0-ee7413615df2 1G Sep 23 00:13:06 devstack sudo[90199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:06 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ca8f0f2-72d4-4347-8553-d91355f49c80 tempest-AttachVolumeNegativeTest-86753276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:13:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8ca8f0f2-72d4-4347-8553-d91355f49c80 tempest-AttachVolumeNegativeTest-86753276 None] Flow 'volume_create_manager' (24949214-1b32-4222-a44f-111c71d2ab59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:13:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8ca8f0f2-72d4-4347-8553-d91355f49c80 tempest-AttachVolumeNegativeTest-86753276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2b04c34-4b48-4032-b9f0-dab51485d445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8ca8f0f2-72d4-4347-8553-d91355f49c80 tempest-AttachVolumeNegativeTest-86753276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2b04c34-4b48-4032-b9f0-dab51485d445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:13:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1270853133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a70ad0f-0902-438a-ad08-5d3a000cc951,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf852d90769e4bda8c3bcaf3abc9cdde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:13:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:13:06Z,use_quota=True,user_id='d38946cf23d046538a65564ac3e17d4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8ca8f0f2-72d4-4347-8553-d91355f49c80 tempest-AttachVolumeNegativeTest-86753276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b26f3494-9560-44d8-a774-e23f25d05d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8ca8f0f2-72d4-4347-8553-d91355f49c80 tempest-AttachVolumeNegativeTest-86753276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b26f3494-9560-44d8-a774-e23f25d05d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8ca8f0f2-72d4-4347-8553-d91355f49c80 tempest-AttachVolumeNegativeTest-86753276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d252d733-d248-475a-8a4d-397af5afd72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8ca8f0f2-72d4-4347-8553-d91355f49c80 tempest-AttachVolumeNegativeTest-86753276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d252d733-d248-475a-8a4d-397af5afd72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a70ad0f-0902-438a-ad08-5d3a000cc951', 'volume_name': 'volume-2a70ad0f-0902-438a-ad08-5d3a000cc951', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8ca8f0f2-72d4-4347-8553-d91355f49c80 tempest-AttachVolumeNegativeTest-86753276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11463d1e-ea7e-42ed-bed5-83af2ede45c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8ca8f0f2-72d4-4347-8553-d91355f49c80 tempest-AttachVolumeNegativeTest-86753276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11463d1e-ea7e-42ed-bed5-83af2ede45c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8ca8f0f2-72d4-4347-8553-d91355f49c80 tempest-AttachVolumeNegativeTest-86753276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ef3112f-f67f-48a9-bead-87041460ee27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:06 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-8ca8f0f2-72d4-4347-8553-d91355f49c80 tempest-AttachVolumeNegativeTest-86753276 None] Volume 2a70ad0f-0902-438a-ad08-5d3a000cc951: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a70ad0f-0902-438a-ad08-5d3a000cc951', 'volume_size': 1} Sep 23 00:13:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8ca8f0f2-72d4-4347-8553-d91355f49c80 tempest-AttachVolumeNegativeTest-86753276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:13:06 devstack sudo[90199]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-185bf163-f528-484c-acc1-92dc16eaf5d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-185bf163-f528-484c-acc1-92dc16eaf5d5.b4d28c11-1681-40fa-99a0-ee7413615df2 1G" returned: 0 in 0.575s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-185bf163-f528-484c-acc1-92dc16eaf5d5 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-185bf163-f528-484c-acc1-92dc16eaf5d5.b4d28c11-1681-40fa-99a0-ee7413615df2 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:06 devstack sudo[90206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-185bf163-f528-484c-acc1-92dc16eaf5d5 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-185bf163-f528-484c-acc1-92dc16eaf5d5.b4d28c11-1681-40fa-99a0-ee7413615df2 Sep 23 00:13:06 devstack sudo[90206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:06 devstack sudo[90206]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-185bf163-f528-484c-acc1-92dc16eaf5d5 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-185bf163-f528-484c-acc1-92dc16eaf5d5.b4d28c11-1681-40fa-99a0-ee7413615df2" returned: 0 in 0.413s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:06 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-185bf163-f528-484c-acc1-92dc16eaf5d5.b4d28c11-1681-40fa-99a0-ee7413615df2 is being set with open permissions: ugo+rw Sep 23 00:13:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-185bf163-f528-484c-acc1-92dc16eaf5d5.b4d28c11-1681-40fa-99a0-ee7413615df2 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:06 devstack sudo[90212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-185bf163-f528-484c-acc1-92dc16eaf5d5.b4d28c11-1681-40fa-99a0-ee7413615df2 Sep 23 00:13:06 devstack sudo[90212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:07 devstack sudo[90212]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-185bf163-f528-484c-acc1-92dc16eaf5d5.b4d28c11-1681-40fa-99a0-ee7413615df2" returned: 0 in 0.334s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-185bf163-f528-484c-acc1-92dc16eaf5d5.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:07 devstack sudo[90215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-185bf163-f528-484c-acc1-92dc16eaf5d5.info Sep 23 00:13:07 devstack sudo[90215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:07 devstack sudo[90215]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-185bf163-f528-484c-acc1-92dc16eaf5d5.info" returned: 0 in 0.344s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:07 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-185bf163-f528-484c-acc1-92dc16eaf5d5.info is being set with open permissions: ugo+rw Sep 23 00:13:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-185bf163-f528-484c-acc1-92dc16eaf5d5.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:07 devstack sudo[90218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-185bf163-f528-484c-acc1-92dc16eaf5d5.info Sep 23 00:13:07 devstack sudo[90218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:08 devstack sudo[90218]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-185bf163-f528-484c-acc1-92dc16eaf5d5.info" returned: 0 in 0.385s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:08 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] Acquiring lock "cinder-quobyte-254756af-9995-4263-911d-68482993dfc6" by "_copy_volume_from_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:13:08 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] Lock "cinder-quobyte-254756af-9995-4263-911d-68482993dfc6" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:13:08 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] snapshot: b4d28c11-1681-40fa-99a0-ee7413615df2, volume: 254756af-9995-4263-911d-68482993dfc6, {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:13:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:13:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:13:08 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:13:08 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:13:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:13:08 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1493b43-49e4-47ec-bde0-f95f96f634bb]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:13:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-185bf163-f528-484c-acc1-92dc16eaf5d5.b4d28c11-1681-40fa-99a0-ee7413615df2 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:08 devstack sudo[90221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-185bf163-f528-484c-acc1-92dc16eaf5d5.b4d28c11-1681-40fa-99a0-ee7413615df2 Sep 23 00:13:08 devstack sudo[90221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:08 devstack sudo[90221]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-185bf163-f528-484c-acc1-92dc16eaf5d5.b4d28c11-1681-40fa-99a0-ee7413615df2" returned: 0 in 0.496s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:08 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-185bf163-f528-484c-acc1-92dc16eaf5d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:13:08 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[251de254-edca-45fc-84bd-2ad3ec764901]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:13:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-185bf163-f528-484c-acc1-92dc16eaf5d5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:08 devstack sudo[90227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-185bf163-f528-484c-acc1-92dc16eaf5d5 Sep 23 00:13:08 devstack sudo[90227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:09 devstack sudo[90227]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-185bf163-f528-484c-acc1-92dc16eaf5d5" returned: 0 in 0.496s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:09 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-185bf163-f528-484c-acc1-92dc16eaf5d5 {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:13:09 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] Creating direct copy from snapshot {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:13:09 devstack cinder-volume[86591]: DEBUG cinder.utils [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] Path /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-254756af-9995-4263-911d-68482993dfc6 not found in is_blk_device check {{(pid=86591) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:13:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-185bf163-f528-484c-acc1-92dc16eaf5d5 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-254756af-9995-4263-911d-68482993dfc6 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:09 devstack sudo[90238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-185bf163-f528-484c-acc1-92dc16eaf5d5 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-254756af-9995-4263-911d-68482993dfc6 Sep 23 00:13:09 devstack sudo[90238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:16 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:UPDATE=33,cinder:SELECT=28,cinder:INSERT=6,cinder:DELETE=3 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:13:16 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:13:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:13:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:13:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:13:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:13:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:13:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:16 devstack sudo[90266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:13:16 devstack sudo[90266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:16 devstack sudo[90238]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-185bf163-f528-484c-acc1-92dc16eaf5d5 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-254756af-9995-4263-911d-68482993dfc6" returned: 0 in 7.668s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:16 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] Image conversion details: src /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-185bf163-f528-484c-acc1-92dc16eaf5d5, size 1024.00 MB, duration 7.67 sec, destination /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-254756af-9995-4263-911d-68482993dfc6 {{(pid=86591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:13:16 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] Converted 1024.00 MB image at 133.49 MB/s Sep 23 00:13:16 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-254756af-9995-4263-911d-68482993dfc6 is being set with open permissions: ugo+rw Sep 23 00:13:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-254756af-9995-4263-911d-68482993dfc6 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:16 devstack sudo[90268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-254756af-9995-4263-911d-68482993dfc6 Sep 23 00:13:16 devstack sudo[90268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:17 devstack sudo[90266]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.413s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:17 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:13:17 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running periodic task VolumeManager._thread_info {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:13:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] thread count: 9 {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:13:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] thread info: [<_MainThread(MainThread, started 135440660459648)>, , , , , , , , ] {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:13:17 devstack sudo[90268]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-254756af-9995-4263-911d-68482993dfc6" returned: 0 in 0.430s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:17 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=28,cinder:UPDATE=37,cinder:DELETE=3,cinder:INSERT=11 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:13:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] Lock "cinder-quobyte-254756af-9995-4263-911d-68482993dfc6" released by "_copy_volume_from_snapshot" :: held 9.218s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:13:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] Acquiring lock "cinder-quobyte-b4d28c11-1681-40fa-99a0-ee7413615df2" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:13:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] Lock "cinder-quobyte-b4d28c11-1681-40fa-99a0-ee7413615df2" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:13:17 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] Deleting offline snapshot b4d28c11-1681-40fa-99a0-ee7413615df2 of volume 185bf163-f528-484c-acc1-92dc16eaf5d5 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:13:17 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] snapshot_file for this snap is: volume-185bf163-f528-484c-acc1-92dc16eaf5d5.b4d28c11-1681-40fa-99a0-ee7413615df2 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:13:17 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[83617a25-6dde-4484-963a-eec08ce4c927]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:13:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-185bf163-f528-484c-acc1-92dc16eaf5d5.b4d28c11-1681-40fa-99a0-ee7413615df2 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:17 devstack sudo[90272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-185bf163-f528-484c-acc1-92dc16eaf5d5.b4d28c11-1681-40fa-99a0-ee7413615df2 Sep 23 00:13:17 devstack sudo[90272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:17 devstack sudo[90272]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-185bf163-f528-484c-acc1-92dc16eaf5d5.b4d28c11-1681-40fa-99a0-ee7413615df2" returned: 0 in 0.556s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:17 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-185bf163-f528-484c-acc1-92dc16eaf5d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:13:18 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a31762-5ec9-4316-8cc5-26035b030eb8]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:13:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-185bf163-f528-484c-acc1-92dc16eaf5d5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:18 devstack sudo[90277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-185bf163-f528-484c-acc1-92dc16eaf5d5 Sep 23 00:13:18 devstack sudo[90277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:18 devstack sudo[90277]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-185bf163-f528-484c-acc1-92dc16eaf5d5" returned: 0 in 0.737s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-185bf163-f528-484c-acc1-92dc16eaf5d5.b4d28c11-1681-40fa-99a0-ee7413615df2 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:18 devstack sudo[90283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-185bf163-f528-484c-acc1-92dc16eaf5d5.b4d28c11-1681-40fa-99a0-ee7413615df2 Sep 23 00:13:18 devstack sudo[90283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:19 devstack sudo[90283]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-185bf163-f528-484c-acc1-92dc16eaf5d5.b4d28c11-1681-40fa-99a0-ee7413615df2" returned: 0 in 0.495s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-185bf163-f528-484c-acc1-92dc16eaf5d5.b4d28c11-1681-40fa-99a0-ee7413615df2 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:19 devstack sudo[90288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-185bf163-f528-484c-acc1-92dc16eaf5d5.b4d28c11-1681-40fa-99a0-ee7413615df2 Sep 23 00:13:19 devstack sudo[90288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:19 devstack sudo[90288]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-185bf163-f528-484c-acc1-92dc16eaf5d5.b4d28c11-1681-40fa-99a0-ee7413615df2" returned: 0 in 0.392s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] Lock "cinder-quobyte-b4d28c11-1681-40fa-99a0-ee7413615df2" released by "_delete_snapshot" :: held 2.331s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:13:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.534s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:13:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-65aa4e5b-00c4-4fb1-a27b-74bb431af5f0 req-4e696adc-70e4-4b53-bcd4-c228536cafe4 tempest-TaggedAttachmentsTest-1355663750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 14.274s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:13:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49db7dec-c97c-42f8-a193-90a039c69a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-254756af-9995-4263-911d-68482993dfc6', 'volume_size': 2, 'source_volid': '185bf163-f528-484c-acc1-92dc16eaf5d5', 'source_volstatus': 'available'}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (403b88e0-ecff-421b-8bf7-967059ece9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-65aa4e5b-00c4-4fb1-a27b-74bb431af5f0 req-4e696adc-70e4-4b53-bcd4-c228536cafe4 tempest-TaggedAttachmentsTest-1355663750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.047s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:13:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8ca8f0f2-72d4-4347-8553-d91355f49c80 tempest-AttachVolumeNegativeTest-86753276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.627s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:13:19 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-8ca8f0f2-72d4-4347-8553-d91355f49c80 tempest-AttachVolumeNegativeTest-86753276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:13:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1270853133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a70ad0f-0902-438a-ad08-5d3a000cc951,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf852d90769e4bda8c3bcaf3abc9cdde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:13:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:13:06Z,use_quota=True,user_id='d38946cf23d046538a65564ac3e17d4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:13:19 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-8ca8f0f2-72d4-4347-8553-d91355f49c80 tempest-AttachVolumeNegativeTest-86753276 None] Creating volume 2a70ad0f-0902-438a-ad08-5d3a000cc951 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:13:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8ca8f0f2-72d4-4347-8553-d91355f49c80 tempest-AttachVolumeNegativeTest-86753276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:13:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8ca8f0f2-72d4-4347-8553-d91355f49c80 tempest-AttachVolumeNegativeTest-86753276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:13:19 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-8ca8f0f2-72d4-4347-8553-d91355f49c80 tempest-AttachVolumeNegativeTest-86753276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:13:19 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-8ca8f0f2-72d4-4347-8553-d91355f49c80 tempest-AttachVolumeNegativeTest-86753276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:13:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8ca8f0f2-72d4-4347-8553-d91355f49c80 tempest-AttachVolumeNegativeTest-86753276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:13:19 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-8ca8f0f2-72d4-4347-8553-d91355f49c80 tempest-AttachVolumeNegativeTest-86753276 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:13:19 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-8ca8f0f2-72d4-4347-8553-d91355f49c80 tempest-AttachVolumeNegativeTest-86753276 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:13:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8ca8f0f2-72d4-4347-8553-d91355f49c80 tempest-AttachVolumeNegativeTest-86753276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2a70ad0f-0902-438a-ad08-5d3a000cc951 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:19 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] Volume volume-254756af-9995-4263-911d-68482993dfc6 (254756af-9995-4263-911d-68482993dfc6): created successfully Sep 23 00:13:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (403b88e0-ecff-421b-8bf7-967059ece9ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:19 devstack sudo[90291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2a70ad0f-0902-438a-ad08-5d3a000cc951 1073741824 Sep 23 00:13:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] Flow 'volume_create_manager' (12ba4b08-7eb1-4015-aaf0-aa043b3d422c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:13:19 devstack sudo[90291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-65aa4e5b-00c4-4fb1-a27b-74bb431af5f0 req-4e696adc-70e4-4b53-bcd4-c228536cafe4 tempest-TaggedAttachmentsTest-1355663750 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974', 'name': 'volume-ee5f8098-ea07-47e1-be5e-061305b68ffe', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4967519d-dffe-4cd7-8790-155b33511d62', 'enforce_multipath': True} {{(pid=86591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:13:19 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-98b3904f-c358-4bbf-8b58-a21e3778a849 tempest-VolumesCloneTest-9936986 None] Created volume successfully. Sep 23 00:13:20 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-65aa4e5b-00c4-4fb1-a27b-74bb431af5f0 req-4e696adc-70e4-4b53-bcd4-c228536cafe4 tempest-TaggedAttachmentsTest-1355663750 None] attachment_update completed successfully. Sep 23 00:13:20 devstack sudo[90291]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8ca8f0f2-72d4-4347-8553-d91355f49c80 tempest-AttachVolumeNegativeTest-86753276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2a70ad0f-0902-438a-ad08-5d3a000cc951 1073741824" returned: 0 in 0.774s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8ca8f0f2-72d4-4347-8553-d91355f49c80 tempest-AttachVolumeNegativeTest-86753276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2a70ad0f-0902-438a-ad08-5d3a000cc951 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:20 devstack sudo[90709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2a70ad0f-0902-438a-ad08-5d3a000cc951 Sep 23 00:13:20 devstack sudo[90709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:21 devstack sudo[90709]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8ca8f0f2-72d4-4347-8553-d91355f49c80 tempest-AttachVolumeNegativeTest-86753276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2a70ad0f-0902-438a-ad08-5d3a000cc951" returned: 0 in 0.531s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:21 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-8ca8f0f2-72d4-4347-8553-d91355f49c80 tempest-AttachVolumeNegativeTest-86753276 None] <== create_volume: return (1404ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:13:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8ca8f0f2-72d4-4347-8553-d91355f49c80 tempest-AttachVolumeNegativeTest-86753276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.410s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:13:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8ca8f0f2-72d4-4347-8553-d91355f49c80 tempest-AttachVolumeNegativeTest-86753276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ef3112f-f67f-48a9-bead-87041460ee27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a70ad0f-0902-438a-ad08-5d3a000cc951', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8ca8f0f2-72d4-4347-8553-d91355f49c80 tempest-AttachVolumeNegativeTest-86753276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f791735-fcce-4293-9aad-87ea74caec8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:21 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-fd333d97-062a-454a-8216-ecbeef10a41d tempest-VolumesCloneTest-9936986 None] Acquiring lock "cinder-254756af-9995-4263-911d-68482993dfc6-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:13:21 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-8ca8f0f2-72d4-4347-8553-d91355f49c80 tempest-AttachVolumeNegativeTest-86753276 None] Volume volume-2a70ad0f-0902-438a-ad08-5d3a000cc951 (2a70ad0f-0902-438a-ad08-5d3a000cc951): created successfully Sep 23 00:13:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8ca8f0f2-72d4-4347-8553-d91355f49c80 tempest-AttachVolumeNegativeTest-86753276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f791735-fcce-4293-9aad-87ea74caec8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8ca8f0f2-72d4-4347-8553-d91355f49c80 tempest-AttachVolumeNegativeTest-86753276 None] Flow 'volume_create_manager' (24949214-1b32-4222-a44f-111c71d2ab59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:13:21 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-fd333d97-062a-454a-8216-ecbeef10a41d tempest-VolumesCloneTest-9936986 None] Lock "cinder-254756af-9995-4263-911d-68482993dfc6-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:13:21 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-8ca8f0f2-72d4-4347-8553-d91355f49c80 tempest-AttachVolumeNegativeTest-86753276 None] Created volume successfully. Sep 23 00:13:21 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-fd333d97-062a-454a-8216-ecbeef10a41d tempest-VolumesCloneTest-9936986 None] Acquiring lock "cinder-quobyte-254756af-9995-4263-911d-68482993dfc6" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:13:21 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-fd333d97-062a-454a-8216-ecbeef10a41d tempest-VolumesCloneTest-9936986 None] Lock "cinder-quobyte-254756af-9995-4263-911d-68482993dfc6" acquired by "delete_volume" :: waited 0.023s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:13:21 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[51fccd64-0d36-424b-905d-f218a027b9fc]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:13:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fd333d97-062a-454a-8216-ecbeef10a41d tempest-VolumesCloneTest-9936986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-254756af-9995-4263-911d-68482993dfc6 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:21 devstack sudo[90712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-254756af-9995-4263-911d-68482993dfc6 Sep 23 00:13:21 devstack sudo[90712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:22 devstack sudo[90712]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fd333d97-062a-454a-8216-ecbeef10a41d tempest-VolumesCloneTest-9936986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-254756af-9995-4263-911d-68482993dfc6" returned: 0 in 0.537s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fd333d97-062a-454a-8216-ecbeef10a41d tempest-VolumesCloneTest-9936986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-254756af-9995-4263-911d-68482993dfc6 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:22 devstack sudo[90721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-254756af-9995-4263-911d-68482993dfc6 Sep 23 00:13:22 devstack sudo[90721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:22 devstack sudo[90721]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fd333d97-062a-454a-8216-ecbeef10a41d tempest-VolumesCloneTest-9936986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-254756af-9995-4263-911d-68482993dfc6" returned: 0 in 0.380s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:22 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-fd333d97-062a-454a-8216-ecbeef10a41d tempest-VolumesCloneTest-9936986 None] Lock "cinder-quobyte-254756af-9995-4263-911d-68482993dfc6" released by "delete_volume" :: held 0.981s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:13:22 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-fd333d97-062a-454a-8216-ecbeef10a41d tempest-VolumesCloneTest-9936986 None] Created reservations ['6ea02e35-f4ac-462b-9904-d634ab0f0bdd', '12c3f91f-253e-4cb3-aefb-4895536460e8', 'b09a9ad7-62cf-4fb6-bd47-e25e618ecaf2', '4e791bae-d53d-4088-a98b-772a0b561553'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:13:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-fd333d97-062a-454a-8216-ecbeef10a41d tempest-VolumesCloneTest-9936986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:13:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-fd333d97-062a-454a-8216-ecbeef10a41d tempest-VolumesCloneTest-9936986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:13:22 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-fd333d97-062a-454a-8216-ecbeef10a41d tempest-VolumesCloneTest-9936986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:13:22 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-fd333d97-062a-454a-8216-ecbeef10a41d tempest-VolumesCloneTest-9936986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:13:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-fd333d97-062a-454a-8216-ecbeef10a41d tempest-VolumesCloneTest-9936986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:13:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fd333d97-062a-454a-8216-ecbeef10a41d tempest-VolumesCloneTest-9936986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:22 devstack sudo[90737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:13:22 devstack sudo[90737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-2f28a17f-feb7-48d4-a379-7cf5f948ccc1 req-62c786c1-04ff-4ad2-9f87-d23edbb67f07 tempest-AttachVolumeNegativeTest-86753276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:13:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-2f28a17f-feb7-48d4-a379-7cf5f948ccc1 req-62c786c1-04ff-4ad2-9f87-d23edbb67f07 tempest-AttachVolumeNegativeTest-86753276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:13:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-2f28a17f-feb7-48d4-a379-7cf5f948ccc1 req-62c786c1-04ff-4ad2-9f87-d23edbb67f07 tempest-AttachVolumeNegativeTest-86753276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:13:22 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-2f28a17f-feb7-48d4-a379-7cf5f948ccc1 req-62c786c1-04ff-4ad2-9f87-d23edbb67f07 tempest-AttachVolumeNegativeTest-86753276 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974', 'name': 'volume-2a70ad0f-0902-438a-ad08-5d3a000cc951', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ff4f3343-2bf3-453a-8221-8dc3ffe046eb', 'enforce_multipath': True} {{(pid=86591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:13:22 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-2f28a17f-feb7-48d4-a379-7cf5f948ccc1 req-62c786c1-04ff-4ad2-9f87-d23edbb67f07 tempest-AttachVolumeNegativeTest-86753276 None] attachment_update completed successfully. Sep 23 00:13:23 devstack sudo[90737]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fd333d97-062a-454a-8216-ecbeef10a41d tempest-VolumesCloneTest-9936986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.437s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:23 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-fd333d97-062a-454a-8216-ecbeef10a41d tempest-VolumesCloneTest-9936986 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:13:23 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-fd333d97-062a-454a-8216-ecbeef10a41d tempest-VolumesCloneTest-9936986 None] Deleted volume successfully. Sep 23 00:13:23 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-fd333d97-062a-454a-8216-ecbeef10a41d tempest-VolumesCloneTest-9936986 None] Lock "cinder-254756af-9995-4263-911d-68482993dfc6-delete_volume" released by "delete_volume" :: held 1.761s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:13:23 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5e764728-f06e-4c3b-9265-c3a178e72aa6 tempest-VolumesCloneTest-9936986 None] Acquiring lock "cinder-185bf163-f528-484c-acc1-92dc16eaf5d5-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:13:23 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5e764728-f06e-4c3b-9265-c3a178e72aa6 tempest-VolumesCloneTest-9936986 None] Lock "cinder-185bf163-f528-484c-acc1-92dc16eaf5d5-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:13:23 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5e764728-f06e-4c3b-9265-c3a178e72aa6 tempest-VolumesCloneTest-9936986 None] Acquiring lock "cinder-quobyte-185bf163-f528-484c-acc1-92dc16eaf5d5" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:13:23 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5e764728-f06e-4c3b-9265-c3a178e72aa6 tempest-VolumesCloneTest-9936986 None] Lock "cinder-quobyte-185bf163-f528-484c-acc1-92dc16eaf5d5" acquired by "delete_volume" :: waited 0.022s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:13:23 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8bc574-8c88-4106-8dd0-ea067782830c]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:13:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5e764728-f06e-4c3b-9265-c3a178e72aa6 tempest-VolumesCloneTest-9936986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-185bf163-f528-484c-acc1-92dc16eaf5d5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:23 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-777ad764-d074-4ebe-a5b3-2ee9f9d6582e req-d2710e43-9a69-45b0-9d04-f89b4beb1d2f tempest-TaggedAttachmentsTest-1355663750 None] Terminate volume connection completed successfully. Sep 23 00:13:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-777ad764-d074-4ebe-a5b3-2ee9f9d6582e req-d2710e43-9a69-45b0-9d04-f89b4beb1d2f tempest-TaggedAttachmentsTest-1355663750 None] Deleting attachment 4967519d-dffe-4cd7-8790-155b33511d62. {{(pid=86591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:13:24 devstack sudo[90745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-185bf163-f528-484c-acc1-92dc16eaf5d5 Sep 23 00:13:24 devstack sudo[90745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:24 devstack sudo[90745]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5e764728-f06e-4c3b-9265-c3a178e72aa6 tempest-VolumesCloneTest-9936986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-185bf163-f528-484c-acc1-92dc16eaf5d5" returned: 0 in 0.484s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5e764728-f06e-4c3b-9265-c3a178e72aa6 tempest-VolumesCloneTest-9936986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-185bf163-f528-484c-acc1-92dc16eaf5d5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:24 devstack sudo[90750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-185bf163-f528-484c-acc1-92dc16eaf5d5 Sep 23 00:13:24 devstack sudo[90750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:24 devstack sudo[90750]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5e764728-f06e-4c3b-9265-c3a178e72aa6 tempest-VolumesCloneTest-9936986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-185bf163-f528-484c-acc1-92dc16eaf5d5" returned: 0 in 0.454s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:24 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5e764728-f06e-4c3b-9265-c3a178e72aa6 tempest-VolumesCloneTest-9936986 None] Lock "cinder-quobyte-185bf163-f528-484c-acc1-92dc16eaf5d5" released by "delete_volume" :: held 1.053s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:13:25 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-5e764728-f06e-4c3b-9265-c3a178e72aa6 tempest-VolumesCloneTest-9936986 None] Created reservations ['a9d9a69b-4d83-4ac4-9754-33111f754f1e', '671a58b8-cac3-44cc-9212-e30de2544e9f', '588f62d2-80bc-44a2-b8de-5ca268052995', '63a432b7-dee9-45c6-b52a-8ce7a97e31f1'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:13:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5e764728-f06e-4c3b-9265-c3a178e72aa6 tempest-VolumesCloneTest-9936986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:13:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5e764728-f06e-4c3b-9265-c3a178e72aa6 tempest-VolumesCloneTest-9936986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:13:25 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5e764728-f06e-4c3b-9265-c3a178e72aa6 tempest-VolumesCloneTest-9936986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:13:25 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5e764728-f06e-4c3b-9265-c3a178e72aa6 tempest-VolumesCloneTest-9936986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:13:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5e764728-f06e-4c3b-9265-c3a178e72aa6 tempest-VolumesCloneTest-9936986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:13:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5e764728-f06e-4c3b-9265-c3a178e72aa6 tempest-VolumesCloneTest-9936986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:25 devstack sudo[90766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:13:25 devstack sudo[90766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:25 devstack sudo[90766]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5e764728-f06e-4c3b-9265-c3a178e72aa6 tempest-VolumesCloneTest-9936986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.651s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:25 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-5e764728-f06e-4c3b-9265-c3a178e72aa6 tempest-VolumesCloneTest-9936986 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:13:25 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-5e764728-f06e-4c3b-9265-c3a178e72aa6 tempest-VolumesCloneTest-9936986 None] Deleted volume successfully. Sep 23 00:13:25 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5e764728-f06e-4c3b-9265-c3a178e72aa6 tempest-VolumesCloneTest-9936986 None] Lock "cinder-185bf163-f528-484c-acc1-92dc16eaf5d5-delete_volume" released by "delete_volume" :: held 2.151s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:13:26 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-a1b508e3-f4d9-4b92-88f6-15f0438e7ab8 req-4245411f-fa42-4763-8bd9-adabe1dd9530 tempest-AttachVolumeNegativeTest-86753276 None] Terminate volume connection completed successfully. Sep 23 00:13:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-a1b508e3-f4d9-4b92-88f6-15f0438e7ab8 req-4245411f-fa42-4763-8bd9-adabe1dd9530 tempest-AttachVolumeNegativeTest-86753276 None] Deleting attachment ff4f3343-2bf3-453a-8221-8dc3ffe046eb. {{(pid=86591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:13:33 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f1ad9aa-a848-4fce-9c7b-da1d52a83b43 tempest-VolumesCloneNegativeTest-1777583193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:13:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0f1ad9aa-a848-4fce-9c7b-da1d52a83b43 tempest-VolumesCloneNegativeTest-1777583193 None] Flow 'volume_create_manager' (2196a513-8595-4e6d-abcc-ccab6018feed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:13:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0f1ad9aa-a848-4fce-9c7b-da1d52a83b43 tempest-VolumesCloneNegativeTest-1777583193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (304744ee-cb62-4203-b939-3364a46dadf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0f1ad9aa-a848-4fce-9c7b-da1d52a83b43 tempest-VolumesCloneNegativeTest-1777583193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (304744ee-cb62-4203-b939-3364a46dadf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:13:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1018563655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f60965a5-56bf-48bf-af80-cf8e02b98f06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='106843284ed148ed89679d4c84bb0696',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:13:33Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:13:33Z,use_quota=True,user_id='f0a174de64e64940a3a1545d2468f09c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0f1ad9aa-a848-4fce-9c7b-da1d52a83b43 tempest-VolumesCloneNegativeTest-1777583193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (097164d5-8188-4938-b695-8f1377c083cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0f1ad9aa-a848-4fce-9c7b-da1d52a83b43 tempest-VolumesCloneNegativeTest-1777583193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (097164d5-8188-4938-b695-8f1377c083cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0f1ad9aa-a848-4fce-9c7b-da1d52a83b43 tempest-VolumesCloneNegativeTest-1777583193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b53fbd9d-48e4-4ca2-ab2f-78b8c35db726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0f1ad9aa-a848-4fce-9c7b-da1d52a83b43 tempest-VolumesCloneNegativeTest-1777583193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b53fbd9d-48e4-4ca2-ab2f-78b8c35db726) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f60965a5-56bf-48bf-af80-cf8e02b98f06', 'volume_name': 'volume-f60965a5-56bf-48bf-af80-cf8e02b98f06', 'volume_size': 2}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0f1ad9aa-a848-4fce-9c7b-da1d52a83b43 tempest-VolumesCloneNegativeTest-1777583193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02718919-01e9-486a-9ec4-c21fff1e9bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0f1ad9aa-a848-4fce-9c7b-da1d52a83b43 tempest-VolumesCloneNegativeTest-1777583193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02718919-01e9-486a-9ec4-c21fff1e9bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0f1ad9aa-a848-4fce-9c7b-da1d52a83b43 tempest-VolumesCloneNegativeTest-1777583193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2f1df36-e3dc-4986-ba66-71747dfcc07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:33 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-0f1ad9aa-a848-4fce-9c7b-da1d52a83b43 tempest-VolumesCloneNegativeTest-1777583193 None] Volume f60965a5-56bf-48bf-af80-cf8e02b98f06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f60965a5-56bf-48bf-af80-cf8e02b98f06', 'volume_size': 2} Sep 23 00:13:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0f1ad9aa-a848-4fce-9c7b-da1d52a83b43 tempest-VolumesCloneNegativeTest-1777583193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:13:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0f1ad9aa-a848-4fce-9c7b-da1d52a83b43 tempest-VolumesCloneNegativeTest-1777583193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:13:33 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0f1ad9aa-a848-4fce-9c7b-da1d52a83b43 tempest-VolumesCloneNegativeTest-1777583193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:13:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1018563655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f60965a5-56bf-48bf-af80-cf8e02b98f06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='106843284ed148ed89679d4c84bb0696',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:13:33Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:13:33Z,use_quota=True,user_id='f0a174de64e64940a3a1545d2468f09c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:13:33 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-0f1ad9aa-a848-4fce-9c7b-da1d52a83b43 tempest-VolumesCloneNegativeTest-1777583193 None] Creating volume f60965a5-56bf-48bf-af80-cf8e02b98f06 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:13:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0f1ad9aa-a848-4fce-9c7b-da1d52a83b43 tempest-VolumesCloneNegativeTest-1777583193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:13:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0f1ad9aa-a848-4fce-9c7b-da1d52a83b43 tempest-VolumesCloneNegativeTest-1777583193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:13:33 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0f1ad9aa-a848-4fce-9c7b-da1d52a83b43 tempest-VolumesCloneNegativeTest-1777583193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:13:33 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0f1ad9aa-a848-4fce-9c7b-da1d52a83b43 tempest-VolumesCloneNegativeTest-1777583193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:13:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0f1ad9aa-a848-4fce-9c7b-da1d52a83b43 tempest-VolumesCloneNegativeTest-1777583193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:13:33 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0f1ad9aa-a848-4fce-9c7b-da1d52a83b43 tempest-VolumesCloneNegativeTest-1777583193 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:13:33 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-0f1ad9aa-a848-4fce-9c7b-da1d52a83b43 tempest-VolumesCloneNegativeTest-1777583193 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:13:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0f1ad9aa-a848-4fce-9c7b-da1d52a83b43 tempest-VolumesCloneNegativeTest-1777583193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f60965a5-56bf-48bf-af80-cf8e02b98f06 2147483648 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:33 devstack sudo[90882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f60965a5-56bf-48bf-af80-cf8e02b98f06 2147483648 Sep 23 00:13:33 devstack sudo[90882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:34 devstack sudo[90882]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0f1ad9aa-a848-4fce-9c7b-da1d52a83b43 tempest-VolumesCloneNegativeTest-1777583193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f60965a5-56bf-48bf-af80-cf8e02b98f06 2147483648" returned: 0 in 0.604s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0f1ad9aa-a848-4fce-9c7b-da1d52a83b43 tempest-VolumesCloneNegativeTest-1777583193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f60965a5-56bf-48bf-af80-cf8e02b98f06 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:34 devstack sudo[90889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f60965a5-56bf-48bf-af80-cf8e02b98f06 Sep 23 00:13:34 devstack sudo[90889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:34 devstack sudo[90889]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0f1ad9aa-a848-4fce-9c7b-da1d52a83b43 tempest-VolumesCloneNegativeTest-1777583193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f60965a5-56bf-48bf-af80-cf8e02b98f06" returned: 0 in 0.312s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:34 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0f1ad9aa-a848-4fce-9c7b-da1d52a83b43 tempest-VolumesCloneNegativeTest-1777583193 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:13:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0f1ad9aa-a848-4fce-9c7b-da1d52a83b43 tempest-VolumesCloneNegativeTest-1777583193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:13:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0f1ad9aa-a848-4fce-9c7b-da1d52a83b43 tempest-VolumesCloneNegativeTest-1777583193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2f1df36-e3dc-4986-ba66-71747dfcc07e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f60965a5-56bf-48bf-af80-cf8e02b98f06', 'volume_size': 2}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0f1ad9aa-a848-4fce-9c7b-da1d52a83b43 tempest-VolumesCloneNegativeTest-1777583193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9833a101-dc99-48aa-ab1c-0a485d78f71d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:34 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-0f1ad9aa-a848-4fce-9c7b-da1d52a83b43 tempest-VolumesCloneNegativeTest-1777583193 None] Volume volume-f60965a5-56bf-48bf-af80-cf8e02b98f06 (f60965a5-56bf-48bf-af80-cf8e02b98f06): created successfully Sep 23 00:13:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0f1ad9aa-a848-4fce-9c7b-da1d52a83b43 tempest-VolumesCloneNegativeTest-1777583193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9833a101-dc99-48aa-ab1c-0a485d78f71d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0f1ad9aa-a848-4fce-9c7b-da1d52a83b43 tempest-VolumesCloneNegativeTest-1777583193 None] Flow 'volume_create_manager' (2196a513-8595-4e6d-abcc-ccab6018feed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:13:34 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-0f1ad9aa-a848-4fce-9c7b-da1d52a83b43 tempest-VolumesCloneNegativeTest-1777583193 None] Created volume successfully. Sep 23 00:13:35 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-cd7db328-010f-4ce8-86ce-6558837f6cde tempest-VolumesCloneNegativeTest-1777583193 None] Acquiring lock "cinder-f60965a5-56bf-48bf-af80-cf8e02b98f06-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:13:35 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-cd7db328-010f-4ce8-86ce-6558837f6cde tempest-VolumesCloneNegativeTest-1777583193 None] Lock "cinder-f60965a5-56bf-48bf-af80-cf8e02b98f06-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:13:36 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-cd7db328-010f-4ce8-86ce-6558837f6cde tempest-VolumesCloneNegativeTest-1777583193 None] Acquiring lock "cinder-quobyte-f60965a5-56bf-48bf-af80-cf8e02b98f06" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:13:36 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-cd7db328-010f-4ce8-86ce-6558837f6cde tempest-VolumesCloneNegativeTest-1777583193 None] Lock "cinder-quobyte-f60965a5-56bf-48bf-af80-cf8e02b98f06" acquired by "delete_volume" :: waited 0.039s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:13:36 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f778d5-5752-4f86-84ef-84e3a178b690]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:13:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cd7db328-010f-4ce8-86ce-6558837f6cde tempest-VolumesCloneNegativeTest-1777583193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f60965a5-56bf-48bf-af80-cf8e02b98f06 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:36 devstack sudo[90953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f60965a5-56bf-48bf-af80-cf8e02b98f06 Sep 23 00:13:36 devstack sudo[90953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:36 devstack sudo[90953]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cd7db328-010f-4ce8-86ce-6558837f6cde tempest-VolumesCloneNegativeTest-1777583193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f60965a5-56bf-48bf-af80-cf8e02b98f06" returned: 0 in 0.707s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cd7db328-010f-4ce8-86ce-6558837f6cde tempest-VolumesCloneNegativeTest-1777583193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f60965a5-56bf-48bf-af80-cf8e02b98f06 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:36 devstack sudo[90965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f60965a5-56bf-48bf-af80-cf8e02b98f06 Sep 23 00:13:36 devstack sudo[90965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:37 devstack sudo[90965]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cd7db328-010f-4ce8-86ce-6558837f6cde tempest-VolumesCloneNegativeTest-1777583193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f60965a5-56bf-48bf-af80-cf8e02b98f06" returned: 0 in 0.516s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:37 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-cd7db328-010f-4ce8-86ce-6558837f6cde tempest-VolumesCloneNegativeTest-1777583193 None] Lock "cinder-quobyte-f60965a5-56bf-48bf-af80-cf8e02b98f06" released by "delete_volume" :: held 1.398s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:13:37 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-cd7db328-010f-4ce8-86ce-6558837f6cde tempest-VolumesCloneNegativeTest-1777583193 None] Created reservations ['6db398dd-b704-4357-a09f-84377d65ca07', '2677fe1b-9316-49d7-85f8-0cc607365fc8', '3d431176-6ab6-4724-a90a-fd0a4fae412f', '0abf582d-2672-477a-99b6-da2a594fda80'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:13:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-cd7db328-010f-4ce8-86ce-6558837f6cde tempest-VolumesCloneNegativeTest-1777583193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:13:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-cd7db328-010f-4ce8-86ce-6558837f6cde tempest-VolumesCloneNegativeTest-1777583193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:13:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-cd7db328-010f-4ce8-86ce-6558837f6cde tempest-VolumesCloneNegativeTest-1777583193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:13:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-cd7db328-010f-4ce8-86ce-6558837f6cde tempest-VolumesCloneNegativeTest-1777583193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:13:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-cd7db328-010f-4ce8-86ce-6558837f6cde tempest-VolumesCloneNegativeTest-1777583193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:13:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cd7db328-010f-4ce8-86ce-6558837f6cde tempest-VolumesCloneNegativeTest-1777583193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:37 devstack sudo[90972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:13:37 devstack sudo[90972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:38 devstack sudo[90972]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cd7db328-010f-4ce8-86ce-6558837f6cde tempest-VolumesCloneNegativeTest-1777583193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.387s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:38 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-cd7db328-010f-4ce8-86ce-6558837f6cde tempest-VolumesCloneNegativeTest-1777583193 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:13:38 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-cd7db328-010f-4ce8-86ce-6558837f6cde tempest-VolumesCloneNegativeTest-1777583193 None] Deleted volume successfully. Sep 23 00:13:38 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-cd7db328-010f-4ce8-86ce-6558837f6cde tempest-VolumesCloneNegativeTest-1777583193 None] Lock "cinder-f60965a5-56bf-48bf-af80-cf8e02b98f06-delete_volume" released by "delete_volume" :: held 2.360s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:13:41 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-138e56e0-bfba-4e09-bcfd-61aa4e7fc4b2 tempest-TaggedAttachmentsTest-1355663750 None] Acquiring lock "cinder-ee5f8098-ea07-47e1-be5e-061305b68ffe-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:13:41 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-138e56e0-bfba-4e09-bcfd-61aa4e7fc4b2 tempest-TaggedAttachmentsTest-1355663750 None] Lock "cinder-ee5f8098-ea07-47e1-be5e-061305b68ffe-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:13:41 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-138e56e0-bfba-4e09-bcfd-61aa4e7fc4b2 tempest-TaggedAttachmentsTest-1355663750 None] Acquiring lock "cinder-quobyte-ee5f8098-ea07-47e1-be5e-061305b68ffe" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:13:41 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-138e56e0-bfba-4e09-bcfd-61aa4e7fc4b2 tempest-TaggedAttachmentsTest-1355663750 None] Lock "cinder-quobyte-ee5f8098-ea07-47e1-be5e-061305b68ffe" acquired by "delete_volume" :: waited 0.021s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:13:41 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac209abd-6f09-4177-ac4d-e1af728efb9b]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:13:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-138e56e0-bfba-4e09-bcfd-61aa4e7fc4b2 tempest-TaggedAttachmentsTest-1355663750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ee5f8098-ea07-47e1-be5e-061305b68ffe {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:41 devstack sudo[90978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ee5f8098-ea07-47e1-be5e-061305b68ffe Sep 23 00:13:41 devstack sudo[90978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:42 devstack sudo[90978]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-138e56e0-bfba-4e09-bcfd-61aa4e7fc4b2 tempest-TaggedAttachmentsTest-1355663750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ee5f8098-ea07-47e1-be5e-061305b68ffe" returned: 0 in 0.821s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-138e56e0-bfba-4e09-bcfd-61aa4e7fc4b2 tempest-TaggedAttachmentsTest-1355663750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ee5f8098-ea07-47e1-be5e-061305b68ffe {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:42 devstack sudo[90986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ee5f8098-ea07-47e1-be5e-061305b68ffe Sep 23 00:13:42 devstack sudo[90986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:42 devstack sudo[90986]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-138e56e0-bfba-4e09-bcfd-61aa4e7fc4b2 tempest-TaggedAttachmentsTest-1355663750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ee5f8098-ea07-47e1-be5e-061305b68ffe" returned: 0 in 0.610s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:42 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-138e56e0-bfba-4e09-bcfd-61aa4e7fc4b2 tempest-TaggedAttachmentsTest-1355663750 None] Lock "cinder-quobyte-ee5f8098-ea07-47e1-be5e-061305b68ffe" released by "delete_volume" :: held 1.548s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:13:43 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-138e56e0-bfba-4e09-bcfd-61aa4e7fc4b2 tempest-TaggedAttachmentsTest-1355663750 None] Created reservations ['2d7fc23a-e615-4564-8fbb-f89f92cb14b4', '0910a6e3-1e29-4f3d-9ae5-d1e4e3ee0d50', '0a78347b-0d35-41b5-bac5-b347edfcabba', 'a7ac426c-288f-40ba-a1ae-3ba8de085009'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:13:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-138e56e0-bfba-4e09-bcfd-61aa4e7fc4b2 tempest-TaggedAttachmentsTest-1355663750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:13:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-138e56e0-bfba-4e09-bcfd-61aa4e7fc4b2 tempest-TaggedAttachmentsTest-1355663750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:13:43 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-138e56e0-bfba-4e09-bcfd-61aa4e7fc4b2 tempest-TaggedAttachmentsTest-1355663750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:13:43 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-138e56e0-bfba-4e09-bcfd-61aa4e7fc4b2 tempest-TaggedAttachmentsTest-1355663750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:13:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-138e56e0-bfba-4e09-bcfd-61aa4e7fc4b2 tempest-TaggedAttachmentsTest-1355663750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:13:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-138e56e0-bfba-4e09-bcfd-61aa4e7fc4b2 tempest-TaggedAttachmentsTest-1355663750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:43 devstack sudo[90992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:13:43 devstack sudo[90992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:43 devstack sudo[90992]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-138e56e0-bfba-4e09-bcfd-61aa4e7fc4b2 tempest-TaggedAttachmentsTest-1355663750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.544s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:43 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-138e56e0-bfba-4e09-bcfd-61aa4e7fc4b2 tempest-TaggedAttachmentsTest-1355663750 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:13:43 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-138e56e0-bfba-4e09-bcfd-61aa4e7fc4b2 tempest-TaggedAttachmentsTest-1355663750 None] Deleted volume successfully. Sep 23 00:13:43 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-138e56e0-bfba-4e09-bcfd-61aa4e7fc4b2 tempest-TaggedAttachmentsTest-1355663750 None] Lock "cinder-ee5f8098-ea07-47e1-be5e-061305b68ffe-delete_volume" released by "delete_volume" :: held 2.663s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:13:45 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-70897a72-821d-45df-9415-d853ec685eb6 tempest-VolumesGetTest-1069786405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:13:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-70897a72-821d-45df-9415-d853ec685eb6 tempest-VolumesGetTest-1069786405 None] Flow 'volume_create_manager' (edfcba37-b484-417d-a0aa-a9d34ae7d75e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:13:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-70897a72-821d-45df-9415-d853ec685eb6 tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2a02c36-b15c-4119-aee1-c8930734081f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-70897a72-821d-45df-9415-d853ec685eb6 tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2a02c36-b15c-4119-aee1-c8930734081f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:13:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1822209941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b83880a-4b5b-4933-8ef8-f8dfe83b3015,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2b528bf3790f4fd9a5eb0149c75a54a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:13:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:13:45Z,use_quota=True,user_id='be3a418f8b7f41e5af0877c2b3e37eec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-70897a72-821d-45df-9415-d853ec685eb6 tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29e11b23-f50f-488e-bfc0-189189b27cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-70897a72-821d-45df-9415-d853ec685eb6 tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29e11b23-f50f-488e-bfc0-189189b27cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-70897a72-821d-45df-9415-d853ec685eb6 tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f90fd626-4908-4d3d-8c52-08cfde572f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-70897a72-821d-45df-9415-d853ec685eb6 tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f90fd626-4908-4d3d-8c52-08cfde572f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b83880a-4b5b-4933-8ef8-f8dfe83b3015', 'volume_name': 'volume-7b83880a-4b5b-4933-8ef8-f8dfe83b3015', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-70897a72-821d-45df-9415-d853ec685eb6 tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66ea669b-e19e-4157-bf37-95018111524e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-70897a72-821d-45df-9415-d853ec685eb6 tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66ea669b-e19e-4157-bf37-95018111524e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-70897a72-821d-45df-9415-d853ec685eb6 tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a40ef81-98a3-496b-b3c9-d7087d031d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:45 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-70897a72-821d-45df-9415-d853ec685eb6 tempest-VolumesGetTest-1069786405 None] Volume 7b83880a-4b5b-4933-8ef8-f8dfe83b3015: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b83880a-4b5b-4933-8ef8-f8dfe83b3015', 'volume_size': 1} Sep 23 00:13:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-70897a72-821d-45df-9415-d853ec685eb6 tempest-VolumesGetTest-1069786405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:13:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-70897a72-821d-45df-9415-d853ec685eb6 tempest-VolumesGetTest-1069786405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:13:45 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-70897a72-821d-45df-9415-d853ec685eb6 tempest-VolumesGetTest-1069786405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:13:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1822209941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b83880a-4b5b-4933-8ef8-f8dfe83b3015,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2b528bf3790f4fd9a5eb0149c75a54a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:13:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:13:45Z,use_quota=True,user_id='be3a418f8b7f41e5af0877c2b3e37eec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:13:45 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-70897a72-821d-45df-9415-d853ec685eb6 tempest-VolumesGetTest-1069786405 None] Creating volume 7b83880a-4b5b-4933-8ef8-f8dfe83b3015 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:13:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-70897a72-821d-45df-9415-d853ec685eb6 tempest-VolumesGetTest-1069786405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:13:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-70897a72-821d-45df-9415-d853ec685eb6 tempest-VolumesGetTest-1069786405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:13:45 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-70897a72-821d-45df-9415-d853ec685eb6 tempest-VolumesGetTest-1069786405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:13:45 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-70897a72-821d-45df-9415-d853ec685eb6 tempest-VolumesGetTest-1069786405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:13:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-70897a72-821d-45df-9415-d853ec685eb6 tempest-VolumesGetTest-1069786405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:13:45 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-70897a72-821d-45df-9415-d853ec685eb6 tempest-VolumesGetTest-1069786405 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:13:45 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-70897a72-821d-45df-9415-d853ec685eb6 tempest-VolumesGetTest-1069786405 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:13:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-70897a72-821d-45df-9415-d853ec685eb6 tempest-VolumesGetTest-1069786405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7b83880a-4b5b-4933-8ef8-f8dfe83b3015 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:45 devstack sudo[91013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7b83880a-4b5b-4933-8ef8-f8dfe83b3015 1073741824 Sep 23 00:13:45 devstack sudo[91013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:46 devstack sudo[91013]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-70897a72-821d-45df-9415-d853ec685eb6 tempest-VolumesGetTest-1069786405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7b83880a-4b5b-4933-8ef8-f8dfe83b3015 1073741824" returned: 0 in 0.663s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-70897a72-821d-45df-9415-d853ec685eb6 tempest-VolumesGetTest-1069786405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7b83880a-4b5b-4933-8ef8-f8dfe83b3015 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:46 devstack sudo[91021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7b83880a-4b5b-4933-8ef8-f8dfe83b3015 Sep 23 00:13:46 devstack sudo[91021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:46 devstack sudo[91021]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-70897a72-821d-45df-9415-d853ec685eb6 tempest-VolumesGetTest-1069786405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7b83880a-4b5b-4933-8ef8-f8dfe83b3015" returned: 0 in 0.543s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-70897a72-821d-45df-9415-d853ec685eb6 tempest-VolumesGetTest-1069786405 None] <== create_volume: return (1283ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:13:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-70897a72-821d-45df-9415-d853ec685eb6 tempest-VolumesGetTest-1069786405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.287s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:13:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-70897a72-821d-45df-9415-d853ec685eb6 tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a40ef81-98a3-496b-b3c9-d7087d031d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b83880a-4b5b-4933-8ef8-f8dfe83b3015', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-70897a72-821d-45df-9415-d853ec685eb6 tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (193fd123-79fa-40bc-8d15-4473b1a7598e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:47 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-70897a72-821d-45df-9415-d853ec685eb6 tempest-VolumesGetTest-1069786405 None] Volume volume-7b83880a-4b5b-4933-8ef8-f8dfe83b3015 (7b83880a-4b5b-4933-8ef8-f8dfe83b3015): created successfully Sep 23 00:13:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-70897a72-821d-45df-9415-d853ec685eb6 tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (193fd123-79fa-40bc-8d15-4473b1a7598e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-70897a72-821d-45df-9415-d853ec685eb6 tempest-VolumesGetTest-1069786405 None] Flow 'volume_create_manager' (edfcba37-b484-417d-a0aa-a9d34ae7d75e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:13:47 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-70897a72-821d-45df-9415-d853ec685eb6 tempest-VolumesGetTest-1069786405 None] Created volume successfully. Sep 23 00:13:48 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-40278bce-bb27-4d2a-b0d0-e5c197d0c77a tempest-VolumesGetTest-1069786405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:13:48 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-40278bce-bb27-4d2a-b0d0-e5c197d0c77a tempest-VolumesGetTest-1069786405 None] Flow 'volume_create_manager' (b2878659-f8ed-44d0-94b2-a860278b2cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:13:48 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-40278bce-bb27-4d2a-b0d0-e5c197d0c77a tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ebceaf5-5e32-4573-af28-d79992fb7594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:48 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-40278bce-bb27-4d2a-b0d0-e5c197d0c77a tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ebceaf5-5e32-4573-af28-d79992fb7594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:13:48Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1840194478',display_name='tempest-VolumesGetTest-Volume-837570175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0046a674-27e5-4376-85a9-7d159a194b14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b528bf3790f4fd9a5eb0149c75a54a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:13:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:13:49Z,use_quota=True,user_id='be3a418f8b7f41e5af0877c2b3e37eec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:48 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-40278bce-bb27-4d2a-b0d0-e5c197d0c77a tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4941ab67-e516-4abd-b756-e7a145cc12ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:48 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-40278bce-bb27-4d2a-b0d0-e5c197d0c77a tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4941ab67-e516-4abd-b756-e7a145cc12ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:48 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-40278bce-bb27-4d2a-b0d0-e5c197d0c77a tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91495b50-fbc7-4893-970a-272c4ac696ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:48 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-40278bce-bb27-4d2a-b0d0-e5c197d0c77a tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91495b50-fbc7-4893-970a-272c4ac696ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0046a674-27e5-4376-85a9-7d159a194b14', 'volume_name': 'volume-0046a674-27e5-4376-85a9-7d159a194b14', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:48 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-40278bce-bb27-4d2a-b0d0-e5c197d0c77a tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2baad19-fc3f-44ae-9054-e192b9655d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:48 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-40278bce-bb27-4d2a-b0d0-e5c197d0c77a tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2baad19-fc3f-44ae-9054-e192b9655d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:48 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-40278bce-bb27-4d2a-b0d0-e5c197d0c77a tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f26e9d53-add1-4347-a4cc-913f2d134c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:48 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-40278bce-bb27-4d2a-b0d0-e5c197d0c77a tempest-VolumesGetTest-1069786405 None] Volume 0046a674-27e5-4376-85a9-7d159a194b14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0046a674-27e5-4376-85a9-7d159a194b14', 'volume_size': 1} Sep 23 00:13:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-40278bce-bb27-4d2a-b0d0-e5c197d0c77a tempest-VolumesGetTest-1069786405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:13:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-40278bce-bb27-4d2a-b0d0-e5c197d0c77a tempest-VolumesGetTest-1069786405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:13:48 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-40278bce-bb27-4d2a-b0d0-e5c197d0c77a tempest-VolumesGetTest-1069786405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:13:48Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1840194478',display_name='tempest-VolumesGetTest-Volume-837570175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0046a674-27e5-4376-85a9-7d159a194b14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b528bf3790f4fd9a5eb0149c75a54a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:13:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:13:49Z,use_quota=True,user_id='be3a418f8b7f41e5af0877c2b3e37eec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:13:48 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-40278bce-bb27-4d2a-b0d0-e5c197d0c77a tempest-VolumesGetTest-1069786405 None] Creating volume 0046a674-27e5-4376-85a9-7d159a194b14 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:13:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-40278bce-bb27-4d2a-b0d0-e5c197d0c77a tempest-VolumesGetTest-1069786405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:13:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-40278bce-bb27-4d2a-b0d0-e5c197d0c77a tempest-VolumesGetTest-1069786405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:13:48 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-40278bce-bb27-4d2a-b0d0-e5c197d0c77a tempest-VolumesGetTest-1069786405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:13:48 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-40278bce-bb27-4d2a-b0d0-e5c197d0c77a tempest-VolumesGetTest-1069786405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:13:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-40278bce-bb27-4d2a-b0d0-e5c197d0c77a tempest-VolumesGetTest-1069786405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:13:48 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-40278bce-bb27-4d2a-b0d0-e5c197d0c77a tempest-VolumesGetTest-1069786405 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:13:48 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-40278bce-bb27-4d2a-b0d0-e5c197d0c77a tempest-VolumesGetTest-1069786405 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:13:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-40278bce-bb27-4d2a-b0d0-e5c197d0c77a tempest-VolumesGetTest-1069786405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-0046a674-27e5-4376-85a9-7d159a194b14 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:48 devstack sudo[91026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-0046a674-27e5-4376-85a9-7d159a194b14 1073741824 Sep 23 00:13:48 devstack sudo[91026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:49 devstack sudo[91026]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-40278bce-bb27-4d2a-b0d0-e5c197d0c77a tempest-VolumesGetTest-1069786405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-0046a674-27e5-4376-85a9-7d159a194b14 1073741824" returned: 0 in 0.598s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-40278bce-bb27-4d2a-b0d0-e5c197d0c77a tempest-VolumesGetTest-1069786405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-0046a674-27e5-4376-85a9-7d159a194b14 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:49 devstack sudo[91032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-0046a674-27e5-4376-85a9-7d159a194b14 Sep 23 00:13:49 devstack sudo[91032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:50 devstack sudo[91032]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-40278bce-bb27-4d2a-b0d0-e5c197d0c77a tempest-VolumesGetTest-1069786405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-0046a674-27e5-4376-85a9-7d159a194b14" returned: 0 in 0.494s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:50 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-40278bce-bb27-4d2a-b0d0-e5c197d0c77a tempest-VolumesGetTest-1069786405 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:13:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-40278bce-bb27-4d2a-b0d0-e5c197d0c77a tempest-VolumesGetTest-1069786405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:13:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-40278bce-bb27-4d2a-b0d0-e5c197d0c77a tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f26e9d53-add1-4347-a4cc-913f2d134c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0046a674-27e5-4376-85a9-7d159a194b14', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-40278bce-bb27-4d2a-b0d0-e5c197d0c77a tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc91bb25-e54c-44ac-a5cd-6707274aefbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:50 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-40278bce-bb27-4d2a-b0d0-e5c197d0c77a tempest-VolumesGetTest-1069786405 None] Volume volume-0046a674-27e5-4376-85a9-7d159a194b14 (0046a674-27e5-4376-85a9-7d159a194b14): created successfully Sep 23 00:13:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-40278bce-bb27-4d2a-b0d0-e5c197d0c77a tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc91bb25-e54c-44ac-a5cd-6707274aefbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-40278bce-bb27-4d2a-b0d0-e5c197d0c77a tempest-VolumesGetTest-1069786405 None] Flow 'volume_create_manager' (b2878659-f8ed-44d0-94b2-a860278b2cc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:13:50 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-40278bce-bb27-4d2a-b0d0-e5c197d0c77a tempest-VolumesGetTest-1069786405 None] Created volume successfully. Sep 23 00:13:51 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-3fbf3b93-7a4e-4f14-af09-c0d3fc70c8f3 tempest-VolumesGetTest-1069786405 None] Acquiring lock "cinder-0046a674-27e5-4376-85a9-7d159a194b14-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:13:51 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-3fbf3b93-7a4e-4f14-af09-c0d3fc70c8f3 tempest-VolumesGetTest-1069786405 None] Lock "cinder-0046a674-27e5-4376-85a9-7d159a194b14-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:13:51 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-3fbf3b93-7a4e-4f14-af09-c0d3fc70c8f3 tempest-VolumesGetTest-1069786405 None] Acquiring lock "cinder-quobyte-0046a674-27e5-4376-85a9-7d159a194b14" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:13:51 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-3fbf3b93-7a4e-4f14-af09-c0d3fc70c8f3 tempest-VolumesGetTest-1069786405 None] Lock "cinder-quobyte-0046a674-27e5-4376-85a9-7d159a194b14" acquired by "delete_volume" :: waited 0.027s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:13:51 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[092a59da-bb02-414e-83c7-424df8832505]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:13:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3fbf3b93-7a4e-4f14-af09-c0d3fc70c8f3 tempest-VolumesGetTest-1069786405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-0046a674-27e5-4376-85a9-7d159a194b14 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:51 devstack sudo[91159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-0046a674-27e5-4376-85a9-7d159a194b14 Sep 23 00:13:51 devstack sudo[91159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:52 devstack sudo[91159]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3fbf3b93-7a4e-4f14-af09-c0d3fc70c8f3 tempest-VolumesGetTest-1069786405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-0046a674-27e5-4376-85a9-7d159a194b14" returned: 0 in 0.821s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3fbf3b93-7a4e-4f14-af09-c0d3fc70c8f3 tempest-VolumesGetTest-1069786405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-0046a674-27e5-4376-85a9-7d159a194b14 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:52 devstack sudo[91170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-0046a674-27e5-4376-85a9-7d159a194b14 Sep 23 00:13:52 devstack sudo[91170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:52 devstack sudo[91170]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3fbf3b93-7a4e-4f14-af09-c0d3fc70c8f3 tempest-VolumesGetTest-1069786405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-0046a674-27e5-4376-85a9-7d159a194b14" returned: 0 in 0.584s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:53 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-3fbf3b93-7a4e-4f14-af09-c0d3fc70c8f3 tempest-VolumesGetTest-1069786405 None] Lock "cinder-quobyte-0046a674-27e5-4376-85a9-7d159a194b14" released by "delete_volume" :: held 1.541s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:13:53 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-3fbf3b93-7a4e-4f14-af09-c0d3fc70c8f3 tempest-VolumesGetTest-1069786405 None] Created reservations ['f3fa40d9-440d-4d7a-9c8e-9a47cdfee0cd', 'f38d5d12-9126-4ba6-8af6-878f1e627d0d', 'd0c8dcdb-41ae-418d-b5e6-3b344fafb97f', '7185b5da-eb1f-45d7-8388-f65a9cce3ff0'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:13:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-3fbf3b93-7a4e-4f14-af09-c0d3fc70c8f3 tempest-VolumesGetTest-1069786405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:13:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-3fbf3b93-7a4e-4f14-af09-c0d3fc70c8f3 tempest-VolumesGetTest-1069786405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:13:53 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-3fbf3b93-7a4e-4f14-af09-c0d3fc70c8f3 tempest-VolumesGetTest-1069786405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:13:53 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-3fbf3b93-7a4e-4f14-af09-c0d3fc70c8f3 tempest-VolumesGetTest-1069786405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:13:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-3fbf3b93-7a4e-4f14-af09-c0d3fc70c8f3 tempest-VolumesGetTest-1069786405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:13:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3fbf3b93-7a4e-4f14-af09-c0d3fc70c8f3 tempest-VolumesGetTest-1069786405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:53 devstack sudo[91192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:13:53 devstack sudo[91192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:53 devstack sudo[91192]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3fbf3b93-7a4e-4f14-af09-c0d3fc70c8f3 tempest-VolumesGetTest-1069786405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.557s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:53 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-3fbf3b93-7a4e-4f14-af09-c0d3fc70c8f3 tempest-VolumesGetTest-1069786405 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:13:53 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-3fbf3b93-7a4e-4f14-af09-c0d3fc70c8f3 tempest-VolumesGetTest-1069786405 None] Deleted volume successfully. Sep 23 00:13:53 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-3fbf3b93-7a4e-4f14-af09-c0d3fc70c8f3 tempest-VolumesGetTest-1069786405 None] Lock "cinder-0046a674-27e5-4376-85a9-7d159a194b14-delete_volume" released by "delete_volume" :: held 2.615s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:13:54 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e7d66718-4730-4254-a859-76af4ecfeb23 tempest-VolumesGetTest-1069786405 None] Acquiring lock "cinder-7b83880a-4b5b-4933-8ef8-f8dfe83b3015-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:13:54 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e7d66718-4730-4254-a859-76af4ecfeb23 tempest-VolumesGetTest-1069786405 None] Lock "cinder-7b83880a-4b5b-4933-8ef8-f8dfe83b3015-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:13:54 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e7d66718-4730-4254-a859-76af4ecfeb23 tempest-VolumesGetTest-1069786405 None] Acquiring lock "cinder-quobyte-7b83880a-4b5b-4933-8ef8-f8dfe83b3015" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:13:54 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e7d66718-4730-4254-a859-76af4ecfeb23 tempest-VolumesGetTest-1069786405 None] Lock "cinder-quobyte-7b83880a-4b5b-4933-8ef8-f8dfe83b3015" acquired by "delete_volume" :: waited 0.026s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:13:54 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[12dbdcfd-4158-4dc0-8457-369f2c04f5c7]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:13:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e7d66718-4730-4254-a859-76af4ecfeb23 tempest-VolumesGetTest-1069786405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7b83880a-4b5b-4933-8ef8-f8dfe83b3015 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:54 devstack sudo[91197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7b83880a-4b5b-4933-8ef8-f8dfe83b3015 Sep 23 00:13:54 devstack sudo[91197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:54 devstack sudo[91197]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e7d66718-4730-4254-a859-76af4ecfeb23 tempest-VolumesGetTest-1069786405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7b83880a-4b5b-4933-8ef8-f8dfe83b3015" returned: 0 in 0.514s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e7d66718-4730-4254-a859-76af4ecfeb23 tempest-VolumesGetTest-1069786405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7b83880a-4b5b-4933-8ef8-f8dfe83b3015 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:54 devstack sudo[91202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7b83880a-4b5b-4933-8ef8-f8dfe83b3015 Sep 23 00:13:54 devstack sudo[91202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:55 devstack sudo[91202]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e7d66718-4730-4254-a859-76af4ecfeb23 tempest-VolumesGetTest-1069786405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7b83880a-4b5b-4933-8ef8-f8dfe83b3015" returned: 0 in 0.460s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:55 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e7d66718-4730-4254-a859-76af4ecfeb23 tempest-VolumesGetTest-1069786405 None] Lock "cinder-quobyte-7b83880a-4b5b-4933-8ef8-f8dfe83b3015" released by "delete_volume" :: held 1.053s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:13:55 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-e7d66718-4730-4254-a859-76af4ecfeb23 tempest-VolumesGetTest-1069786405 None] Created reservations ['d4ec8238-c32d-44dd-8faf-1d4a07b1d008', 'bcce1976-646f-4e8e-b955-53f19bca4b63', '7be933e2-5c8e-40be-b82d-cf24fcdfb7da', '0d7d5cf1-66bb-4761-b381-8cdadff1aafc'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:13:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e7d66718-4730-4254-a859-76af4ecfeb23 tempest-VolumesGetTest-1069786405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:13:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e7d66718-4730-4254-a859-76af4ecfeb23 tempest-VolumesGetTest-1069786405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:13:55 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e7d66718-4730-4254-a859-76af4ecfeb23 tempest-VolumesGetTest-1069786405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:13:55 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e7d66718-4730-4254-a859-76af4ecfeb23 tempest-VolumesGetTest-1069786405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:13:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e7d66718-4730-4254-a859-76af4ecfeb23 tempest-VolumesGetTest-1069786405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:13:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e7d66718-4730-4254-a859-76af4ecfeb23 tempest-VolumesGetTest-1069786405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:55 devstack sudo[91205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:13:55 devstack sudo[91205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:55 devstack sudo[91205]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e7d66718-4730-4254-a859-76af4ecfeb23 tempest-VolumesGetTest-1069786405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.328s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:55 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-e7d66718-4730-4254-a859-76af4ecfeb23 tempest-VolumesGetTest-1069786405 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:13:55 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-e7d66718-4730-4254-a859-76af4ecfeb23 tempest-VolumesGetTest-1069786405 None] Deleted volume successfully. Sep 23 00:13:55 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e7d66718-4730-4254-a859-76af4ecfeb23 tempest-VolumesGetTest-1069786405 None] Lock "cinder-7b83880a-4b5b-4933-8ef8-f8dfe83b3015-delete_volume" released by "delete_volume" :: held 1.844s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:13:57 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-81b4e867-5772-4f0b-a0f2-17313fbae60f tempest-VolumesGetTest-1069786405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:13:57 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-81b4e867-5772-4f0b-a0f2-17313fbae60f tempest-VolumesGetTest-1069786405 None] Flow 'volume_create_manager' (b9c5aabd-9179-4bc8-a332-4afa774c969e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:13:57 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-81b4e867-5772-4f0b-a0f2-17313fbae60f tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6853d4d-548e-420f-beea-aec4a51f627a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:57 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-81b4e867-5772-4f0b-a0f2-17313fbae60f tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6853d4d-548e-420f-beea-aec4a51f627a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:13:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1766194051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c188c3af-037c-4372-81d4-452cff015807,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b528bf3790f4fd9a5eb0149c75a54a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:13:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:13:57Z,use_quota=True,user_id='be3a418f8b7f41e5af0877c2b3e37eec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:57 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-81b4e867-5772-4f0b-a0f2-17313fbae60f tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68a7bd84-ec90-4dc5-9dc8-f3d055d7ac71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:57 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-81b4e867-5772-4f0b-a0f2-17313fbae60f tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68a7bd84-ec90-4dc5-9dc8-f3d055d7ac71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:57 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-81b4e867-5772-4f0b-a0f2-17313fbae60f tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cda55d7d-0956-4e08-918d-649d2a1151a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:57 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-81b4e867-5772-4f0b-a0f2-17313fbae60f tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cda55d7d-0956-4e08-918d-649d2a1151a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c188c3af-037c-4372-81d4-452cff015807', 'volume_name': 'volume-c188c3af-037c-4372-81d4-452cff015807', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:57 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-81b4e867-5772-4f0b-a0f2-17313fbae60f tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4587979-c157-49bd-b59b-3b9e20a73c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:57 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-81b4e867-5772-4f0b-a0f2-17313fbae60f tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4587979-c157-49bd-b59b-3b9e20a73c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:57 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-81b4e867-5772-4f0b-a0f2-17313fbae60f tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f832e1e-b651-4086-b245-7bc6ed035755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:57 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-81b4e867-5772-4f0b-a0f2-17313fbae60f tempest-VolumesGetTest-1069786405 None] Volume c188c3af-037c-4372-81d4-452cff015807: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c188c3af-037c-4372-81d4-452cff015807', 'volume_size': 1} Sep 23 00:13:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-81b4e867-5772-4f0b-a0f2-17313fbae60f tempest-VolumesGetTest-1069786405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:13:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-81b4e867-5772-4f0b-a0f2-17313fbae60f tempest-VolumesGetTest-1069786405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:13:57 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-81b4e867-5772-4f0b-a0f2-17313fbae60f tempest-VolumesGetTest-1069786405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:13:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1766194051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c188c3af-037c-4372-81d4-452cff015807,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b528bf3790f4fd9a5eb0149c75a54a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:13:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:13:57Z,use_quota=True,user_id='be3a418f8b7f41e5af0877c2b3e37eec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:13:57 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-81b4e867-5772-4f0b-a0f2-17313fbae60f tempest-VolumesGetTest-1069786405 None] Creating volume c188c3af-037c-4372-81d4-452cff015807 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:13:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-81b4e867-5772-4f0b-a0f2-17313fbae60f tempest-VolumesGetTest-1069786405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:13:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-81b4e867-5772-4f0b-a0f2-17313fbae60f tempest-VolumesGetTest-1069786405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:13:57 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-81b4e867-5772-4f0b-a0f2-17313fbae60f tempest-VolumesGetTest-1069786405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:13:57 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-81b4e867-5772-4f0b-a0f2-17313fbae60f tempest-VolumesGetTest-1069786405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:13:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-81b4e867-5772-4f0b-a0f2-17313fbae60f tempest-VolumesGetTest-1069786405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:13:57 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-81b4e867-5772-4f0b-a0f2-17313fbae60f tempest-VolumesGetTest-1069786405 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:13:57 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-81b4e867-5772-4f0b-a0f2-17313fbae60f tempest-VolumesGetTest-1069786405 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:13:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-81b4e867-5772-4f0b-a0f2-17313fbae60f tempest-VolumesGetTest-1069786405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c188c3af-037c-4372-81d4-452cff015807 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:57 devstack sudo[91211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c188c3af-037c-4372-81d4-452cff015807 1073741824 Sep 23 00:13:57 devstack sudo[91211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:57 devstack sudo[91211]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-81b4e867-5772-4f0b-a0f2-17313fbae60f tempest-VolumesGetTest-1069786405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c188c3af-037c-4372-81d4-452cff015807 1073741824" returned: 0 in 0.601s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-81b4e867-5772-4f0b-a0f2-17313fbae60f tempest-VolumesGetTest-1069786405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c188c3af-037c-4372-81d4-452cff015807 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:57 devstack sudo[91219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c188c3af-037c-4372-81d4-452cff015807 Sep 23 00:13:57 devstack sudo[91219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:58 devstack sudo[91219]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-81b4e867-5772-4f0b-a0f2-17313fbae60f tempest-VolumesGetTest-1069786405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c188c3af-037c-4372-81d4-452cff015807" returned: 0 in 0.291s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:58 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-81b4e867-5772-4f0b-a0f2-17313fbae60f tempest-VolumesGetTest-1069786405 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:13:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-81b4e867-5772-4f0b-a0f2-17313fbae60f tempest-VolumesGetTest-1069786405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:13:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-81b4e867-5772-4f0b-a0f2-17313fbae60f tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f832e1e-b651-4086-b245-7bc6ed035755) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c188c3af-037c-4372-81d4-452cff015807', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-81b4e867-5772-4f0b-a0f2-17313fbae60f tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6436e587-d07a-4469-8dcd-0f5ff91ba44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:58 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-81b4e867-5772-4f0b-a0f2-17313fbae60f tempest-VolumesGetTest-1069786405 None] Volume volume-c188c3af-037c-4372-81d4-452cff015807 (c188c3af-037c-4372-81d4-452cff015807): created successfully Sep 23 00:13:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-81b4e867-5772-4f0b-a0f2-17313fbae60f tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6436e587-d07a-4469-8dcd-0f5ff91ba44c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-81b4e867-5772-4f0b-a0f2-17313fbae60f tempest-VolumesGetTest-1069786405 None] Flow 'volume_create_manager' (b9c5aabd-9179-4bc8-a332-4afa774c969e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:13:58 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-81b4e867-5772-4f0b-a0f2-17313fbae60f tempest-VolumesGetTest-1069786405 None] Created volume successfully. Sep 23 00:14:00 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:14:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] Flow 'volume_create_manager' (19276490-b6ae-407d-b96b-b0b7855f0e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:14:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1734032a-fe8d-485d-84af-347212e0c8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1734032a-fe8d-485d-84af-347212e0c8f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:14:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-278224043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ae74d0e-05ca-461e-87a9-e69ff04863c0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2b528bf3790f4fd9a5eb0149c75a54a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:14:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=c188c3af-037c-4372-81d4-452cff015807,status='creating',terminated_at=None,updated_at=2026-09-22T22:14:00Z,use_quota=True,user_id='be3a418f8b7f41e5af0877c2b3e37eec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (051c52a2-aa27-44b1-823b-5111189f92a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (051c52a2-aa27-44b1-823b-5111189f92a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7489f32c-a557-4c8f-9205-e8f818089329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7489f32c-a557-4c8f-9205-e8f818089329) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '2ae74d0e-05ca-461e-87a9-e69ff04863c0', 'volume_name': 'volume-2ae74d0e-05ca-461e-87a9-e69ff04863c0', 'volume_size': 1, 'source_volid': 'c188c3af-037c-4372-81d4-452cff015807', 'source_volstatus': 'available'}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef1ccaf4-bb06-4df4-91c1-c0825f185840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef1ccaf4-bb06-4df4-91c1-c0825f185840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2265e43e-ffbe-44f7-8842-4fe5372eac0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:00 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] Volume 2ae74d0e-05ca-461e-87a9-e69ff04863c0: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-2ae74d0e-05ca-461e-87a9-e69ff04863c0', 'volume_size': 1, 'source_volid': 'c188c3af-037c-4372-81d4-452cff015807', 'source_volstatus': 'available'} Sep 23 00:14:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:00 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] Cloning volume c188c3af-037c-4372-81d4-452cff015807 to volume 2ae74d0e-05ca-461e-87a9-e69ff04863c0 Sep 23 00:14:00 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] Creating offline snapshot 0ae1df31-f4ff-4a83-93e7-02d613df93e9 of volume c188c3af-037c-4372-81d4-452cff015807 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:14:00 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f30eabb-7a86-44ed-9356-3e2214d51ec9]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:14:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c188c3af-037c-4372-81d4-452cff015807 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:00 devstack sudo[91258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c188c3af-037c-4372-81d4-452cff015807 Sep 23 00:14:00 devstack sudo[91258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:01 devstack sudo[91258]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c188c3af-037c-4372-81d4-452cff015807" returned: 0 in 0.555s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c188c3af-037c-4372-81d4-452cff015807,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c188c3af-037c-4372-81d4-452cff015807.0ae1df31-f4ff-4a83-93e7-02d613df93e9 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:01 devstack sudo[91265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c188c3af-037c-4372-81d4-452cff015807,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c188c3af-037c-4372-81d4-452cff015807.0ae1df31-f4ff-4a83-93e7-02d613df93e9 1G Sep 23 00:14:01 devstack sudo[91265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:01 devstack sudo[91265]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c188c3af-037c-4372-81d4-452cff015807,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c188c3af-037c-4372-81d4-452cff015807.0ae1df31-f4ff-4a83-93e7-02d613df93e9 1G" returned: 0 in 0.649s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c188c3af-037c-4372-81d4-452cff015807 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c188c3af-037c-4372-81d4-452cff015807.0ae1df31-f4ff-4a83-93e7-02d613df93e9 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:01 devstack sudo[91270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c188c3af-037c-4372-81d4-452cff015807 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c188c3af-037c-4372-81d4-452cff015807.0ae1df31-f4ff-4a83-93e7-02d613df93e9 Sep 23 00:14:01 devstack sudo[91270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:02 devstack sudo[91270]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c188c3af-037c-4372-81d4-452cff015807 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c188c3af-037c-4372-81d4-452cff015807.0ae1df31-f4ff-4a83-93e7-02d613df93e9" returned: 0 in 0.493s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:02 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c188c3af-037c-4372-81d4-452cff015807.0ae1df31-f4ff-4a83-93e7-02d613df93e9 is being set with open permissions: ugo+rw Sep 23 00:14:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c188c3af-037c-4372-81d4-452cff015807.0ae1df31-f4ff-4a83-93e7-02d613df93e9 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:02 devstack sudo[91275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c188c3af-037c-4372-81d4-452cff015807.0ae1df31-f4ff-4a83-93e7-02d613df93e9 Sep 23 00:14:02 devstack sudo[91275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:02 devstack sudo[91275]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c188c3af-037c-4372-81d4-452cff015807.0ae1df31-f4ff-4a83-93e7-02d613df93e9" returned: 0 in 0.367s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c188c3af-037c-4372-81d4-452cff015807.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:02 devstack sudo[91278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c188c3af-037c-4372-81d4-452cff015807.info Sep 23 00:14:02 devstack sudo[91278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:03 devstack sudo[91278]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c188c3af-037c-4372-81d4-452cff015807.info" returned: 0 in 0.364s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:03 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c188c3af-037c-4372-81d4-452cff015807.info is being set with open permissions: ugo+rw Sep 23 00:14:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c188c3af-037c-4372-81d4-452cff015807.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:03 devstack sudo[91281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c188c3af-037c-4372-81d4-452cff015807.info Sep 23 00:14:03 devstack sudo[91281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:03 devstack sudo[91281]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c188c3af-037c-4372-81d4-452cff015807.info" returned: 0 in 0.355s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:03 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] Acquiring lock "cinder-quobyte-2ae74d0e-05ca-461e-87a9-e69ff04863c0" by "_copy_volume_from_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:14:03 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] Lock "cinder-quobyte-2ae74d0e-05ca-461e-87a9-e69ff04863c0" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:14:03 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] snapshot: 0ae1df31-f4ff-4a83-93e7-02d613df93e9, volume: 2ae74d0e-05ca-461e-87a9-e69ff04863c0, {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:14:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:03 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:14:03 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:14:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:03 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa47586-7dc8-44c0-8398-37c90e668945]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:14:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c188c3af-037c-4372-81d4-452cff015807.0ae1df31-f4ff-4a83-93e7-02d613df93e9 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:03 devstack sudo[91284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c188c3af-037c-4372-81d4-452cff015807.0ae1df31-f4ff-4a83-93e7-02d613df93e9 Sep 23 00:14:03 devstack sudo[91284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:03 devstack sudo[91284]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c188c3af-037c-4372-81d4-452cff015807.0ae1df31-f4ff-4a83-93e7-02d613df93e9" returned: 0 in 0.411s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:03 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c188c3af-037c-4372-81d4-452cff015807(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:14:03 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[8577a3dc-a2c3-418e-be7a-7ff98742e92c]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:14:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c188c3af-037c-4372-81d4-452cff015807 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:04 devstack sudo[91289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c188c3af-037c-4372-81d4-452cff015807 Sep 23 00:14:04 devstack sudo[91289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:04 devstack sudo[91289]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c188c3af-037c-4372-81d4-452cff015807" returned: 0 in 0.394s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:04 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c188c3af-037c-4372-81d4-452cff015807 {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:14:04 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] Creating direct copy from snapshot {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:14:04 devstack cinder-volume[86591]: DEBUG cinder.utils [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] Path /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2ae74d0e-05ca-461e-87a9-e69ff04863c0 not found in is_blk_device check {{(pid=86591) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:14:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c188c3af-037c-4372-81d4-452cff015807 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2ae74d0e-05ca-461e-87a9-e69ff04863c0 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:04 devstack sudo[91294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c188c3af-037c-4372-81d4-452cff015807 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2ae74d0e-05ca-461e-87a9-e69ff04863c0 Sep 23 00:14:04 devstack sudo[91294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:07 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-b65cf4ae-4615-40bc-b7c3-40030b76b15e tempest-AttachVolumeShelveTestJSON-294261862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:14:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b65cf4ae-4615-40bc-b7c3-40030b76b15e tempest-AttachVolumeShelveTestJSON-294261862 None] Flow 'volume_create_manager' (eee5f286-e780-4ff2-a141-64d81f9c86e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:14:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b65cf4ae-4615-40bc-b7c3-40030b76b15e tempest-AttachVolumeShelveTestJSON-294261862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06b05042-a719-4972-b947-85746517fb5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b65cf4ae-4615-40bc-b7c3-40030b76b15e tempest-AttachVolumeShelveTestJSON-294261862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06b05042-a719-4972-b947-85746517fb5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:14:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-640181703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db5de011-8b62-43c9-a2b0-ab20510f7b06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='091f8dfbcc194737b8a4cadd9306ff45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:14:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:14:07Z,use_quota=True,user_id='8efa2cb39a3546678c8a929fc7bd08f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b65cf4ae-4615-40bc-b7c3-40030b76b15e tempest-AttachVolumeShelveTestJSON-294261862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (910e6ce4-3deb-40e6-a85a-26ba38df4c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b65cf4ae-4615-40bc-b7c3-40030b76b15e tempest-AttachVolumeShelveTestJSON-294261862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (910e6ce4-3deb-40e6-a85a-26ba38df4c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b65cf4ae-4615-40bc-b7c3-40030b76b15e tempest-AttachVolumeShelveTestJSON-294261862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4e31d4e-f4e3-4064-82b1-5d49b67d7aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b65cf4ae-4615-40bc-b7c3-40030b76b15e tempest-AttachVolumeShelveTestJSON-294261862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4e31d4e-f4e3-4064-82b1-5d49b67d7aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db5de011-8b62-43c9-a2b0-ab20510f7b06', 'volume_name': 'volume-db5de011-8b62-43c9-a2b0-ab20510f7b06', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b65cf4ae-4615-40bc-b7c3-40030b76b15e tempest-AttachVolumeShelveTestJSON-294261862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb0b44f0-b012-4cf3-bdbf-d19d184e01f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b65cf4ae-4615-40bc-b7c3-40030b76b15e tempest-AttachVolumeShelveTestJSON-294261862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb0b44f0-b012-4cf3-bdbf-d19d184e01f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b65cf4ae-4615-40bc-b7c3-40030b76b15e tempest-AttachVolumeShelveTestJSON-294261862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56852d5a-74d5-49a1-9d79-764e96255a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:07 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-b65cf4ae-4615-40bc-b7c3-40030b76b15e tempest-AttachVolumeShelveTestJSON-294261862 None] Volume db5de011-8b62-43c9-a2b0-ab20510f7b06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db5de011-8b62-43c9-a2b0-ab20510f7b06', 'volume_size': 1} Sep 23 00:14:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b65cf4ae-4615-40bc-b7c3-40030b76b15e tempest-AttachVolumeShelveTestJSON-294261862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:12 devstack sudo[91294]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c188c3af-037c-4372-81d4-452cff015807 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2ae74d0e-05ca-461e-87a9-e69ff04863c0" returned: 0 in 8.444s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:12 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] Image conversion details: src /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c188c3af-037c-4372-81d4-452cff015807, size 1024.00 MB, duration 8.45 sec, destination /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2ae74d0e-05ca-461e-87a9-e69ff04863c0 {{(pid=86591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:14:12 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] Converted 1024.00 MB image at 121.25 MB/s Sep 23 00:14:12 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2ae74d0e-05ca-461e-87a9-e69ff04863c0 is being set with open permissions: ugo+rw Sep 23 00:14:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2ae74d0e-05ca-461e-87a9-e69ff04863c0 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:12 devstack sudo[91338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2ae74d0e-05ca-461e-87a9-e69ff04863c0 Sep 23 00:14:12 devstack sudo[91338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:13 devstack sudo[91338]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2ae74d0e-05ca-461e-87a9-e69ff04863c0" returned: 0 in 0.289s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:13 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] Lock "cinder-quobyte-2ae74d0e-05ca-461e-87a9-e69ff04863c0" released by "_copy_volume_from_snapshot" :: held 9.644s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:14:13 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] Acquiring lock "cinder-quobyte-0ae1df31-f4ff-4a83-93e7-02d613df93e9" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:14:13 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] Lock "cinder-quobyte-0ae1df31-f4ff-4a83-93e7-02d613df93e9" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:14:13 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] Deleting offline snapshot 0ae1df31-f4ff-4a83-93e7-02d613df93e9 of volume c188c3af-037c-4372-81d4-452cff015807 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:14:13 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] snapshot_file for this snap is: volume-c188c3af-037c-4372-81d4-452cff015807.0ae1df31-f4ff-4a83-93e7-02d613df93e9 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:14:13 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa03759-7213-4941-8ac4-cdf25b507f7a]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:14:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c188c3af-037c-4372-81d4-452cff015807.0ae1df31-f4ff-4a83-93e7-02d613df93e9 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:13 devstack sudo[91341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c188c3af-037c-4372-81d4-452cff015807.0ae1df31-f4ff-4a83-93e7-02d613df93e9 Sep 23 00:14:13 devstack sudo[91341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:13 devstack sudo[91341]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c188c3af-037c-4372-81d4-452cff015807.0ae1df31-f4ff-4a83-93e7-02d613df93e9" returned: 0 in 0.442s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:13 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c188c3af-037c-4372-81d4-452cff015807(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:14:13 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3139eb-8b29-4544-8be5-63e6e6c6798e]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:14:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c188c3af-037c-4372-81d4-452cff015807 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:13 devstack sudo[91347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c188c3af-037c-4372-81d4-452cff015807 Sep 23 00:14:13 devstack sudo[91347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:14 devstack sudo[91347]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c188c3af-037c-4372-81d4-452cff015807" returned: 0 in 0.685s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c188c3af-037c-4372-81d4-452cff015807.0ae1df31-f4ff-4a83-93e7-02d613df93e9 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:14 devstack sudo[91353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c188c3af-037c-4372-81d4-452cff015807.0ae1df31-f4ff-4a83-93e7-02d613df93e9 Sep 23 00:14:14 devstack sudo[91353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:14 devstack sudo[91353]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c188c3af-037c-4372-81d4-452cff015807.0ae1df31-f4ff-4a83-93e7-02d613df93e9" returned: 0 in 0.592s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c188c3af-037c-4372-81d4-452cff015807.0ae1df31-f4ff-4a83-93e7-02d613df93e9 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:15 devstack sudo[91358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c188c3af-037c-4372-81d4-452cff015807.0ae1df31-f4ff-4a83-93e7-02d613df93e9 Sep 23 00:14:15 devstack sudo[91358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:15 devstack sudo[91358]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c188c3af-037c-4372-81d4-452cff015807.0ae1df31-f4ff-4a83-93e7-02d613df93e9" returned: 0 in 0.343s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] Lock "cinder-quobyte-0ae1df31-f4ff-4a83-93e7-02d613df93e9" released by "_delete_snapshot" :: held 2.199s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:14:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.922s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b65cf4ae-4615-40bc-b7c3-40030b76b15e tempest-AttachVolumeShelveTestJSON-294261862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.787s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:15 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b65cf4ae-4615-40bc-b7c3-40030b76b15e tempest-AttachVolumeShelveTestJSON-294261862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:14:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-640181703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db5de011-8b62-43c9-a2b0-ab20510f7b06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='091f8dfbcc194737b8a4cadd9306ff45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:14:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:14:07Z,use_quota=True,user_id='8efa2cb39a3546678c8a929fc7bd08f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:14:15 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-b65cf4ae-4615-40bc-b7c3-40030b76b15e tempest-AttachVolumeShelveTestJSON-294261862 None] Creating volume db5de011-8b62-43c9-a2b0-ab20510f7b06 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:14:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b65cf4ae-4615-40bc-b7c3-40030b76b15e tempest-AttachVolumeShelveTestJSON-294261862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b65cf4ae-4615-40bc-b7c3-40030b76b15e tempest-AttachVolumeShelveTestJSON-294261862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:15 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b65cf4ae-4615-40bc-b7c3-40030b76b15e tempest-AttachVolumeShelveTestJSON-294261862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:14:15 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b65cf4ae-4615-40bc-b7c3-40030b76b15e tempest-AttachVolumeShelveTestJSON-294261862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:14:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b65cf4ae-4615-40bc-b7c3-40030b76b15e tempest-AttachVolumeShelveTestJSON-294261862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:15 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b65cf4ae-4615-40bc-b7c3-40030b76b15e tempest-AttachVolumeShelveTestJSON-294261862 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:14:15 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-b65cf4ae-4615-40bc-b7c3-40030b76b15e tempest-AttachVolumeShelveTestJSON-294261862 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:14:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b65cf4ae-4615-40bc-b7c3-40030b76b15e tempest-AttachVolumeShelveTestJSON-294261862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db5de011-8b62-43c9-a2b0-ab20510f7b06 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:15 devstack sudo[91361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db5de011-8b62-43c9-a2b0-ab20510f7b06 1073741824 Sep 23 00:14:15 devstack sudo[91361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:15 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2265e43e-ffbe-44f7-8842-4fe5372eac0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ae74d0e-05ca-461e-87a9-e69ff04863c0', 'volume_size': 1, 'source_volid': 'c188c3af-037c-4372-81d4-452cff015807', 'source_volstatus': 'available'}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:15 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab4d9c23-75da-41ce-8362-69d70e620e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:15 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] Volume volume-2ae74d0e-05ca-461e-87a9-e69ff04863c0 (2ae74d0e-05ca-461e-87a9-e69ff04863c0): created successfully Sep 23 00:14:15 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab4d9c23-75da-41ce-8362-69d70e620e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:15 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] Flow 'volume_create_manager' (19276490-b6ae-407d-b96b-b0b7855f0e0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:14:15 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-0b82fe53-fd33-4d42-8119-5f02a33b991b tempest-VolumesGetTest-1069786405 None] Created volume successfully. Sep 23 00:14:16 devstack sudo[91361]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b65cf4ae-4615-40bc-b7c3-40030b76b15e tempest-AttachVolumeShelveTestJSON-294261862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db5de011-8b62-43c9-a2b0-ab20510f7b06 1073741824" returned: 0 in 0.663s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b65cf4ae-4615-40bc-b7c3-40030b76b15e tempest-AttachVolumeShelveTestJSON-294261862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db5de011-8b62-43c9-a2b0-ab20510f7b06 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:16 devstack sudo[91368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db5de011-8b62-43c9-a2b0-ab20510f7b06 Sep 23 00:14:16 devstack sudo[91368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:16 devstack sudo[91368]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b65cf4ae-4615-40bc-b7c3-40030b76b15e tempest-AttachVolumeShelveTestJSON-294261862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db5de011-8b62-43c9-a2b0-ab20510f7b06" returned: 0 in 0.358s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b65cf4ae-4615-40bc-b7c3-40030b76b15e tempest-AttachVolumeShelveTestJSON-294261862 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:14:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b65cf4ae-4615-40bc-b7c3-40030b76b15e tempest-AttachVolumeShelveTestJSON-294261862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b65cf4ae-4615-40bc-b7c3-40030b76b15e tempest-AttachVolumeShelveTestJSON-294261862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56852d5a-74d5-49a1-9d79-764e96255a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db5de011-8b62-43c9-a2b0-ab20510f7b06', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b65cf4ae-4615-40bc-b7c3-40030b76b15e tempest-AttachVolumeShelveTestJSON-294261862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93e1e734-ae8f-4392-b28f-8d7892650239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:16 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:UPDATE=76,cinder:INSERT=17,cinder:SELECT=57,cinder:DELETE=7 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:14:16 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-b65cf4ae-4615-40bc-b7c3-40030b76b15e tempest-AttachVolumeShelveTestJSON-294261862 None] Volume volume-db5de011-8b62-43c9-a2b0-ab20510f7b06 (db5de011-8b62-43c9-a2b0-ab20510f7b06): created successfully Sep 23 00:14:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b65cf4ae-4615-40bc-b7c3-40030b76b15e tempest-AttachVolumeShelveTestJSON-294261862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93e1e734-ae8f-4392-b28f-8d7892650239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b65cf4ae-4615-40bc-b7c3-40030b76b15e tempest-AttachVolumeShelveTestJSON-294261862 None] Flow 'volume_create_manager' (eee5f286-e780-4ff2-a141-64d81f9c86e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:14:16 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-b65cf4ae-4615-40bc-b7c3-40030b76b15e tempest-AttachVolumeShelveTestJSON-294261862 None] Created volume successfully. Sep 23 00:14:16 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:14:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:14:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:14:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:16 devstack sudo[91372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:14:16 devstack sudo[91372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:17 devstack sudo[91372]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.444s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:17 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:14:17 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running periodic task VolumeManager._thread_info {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:14:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] thread count: 9 {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:14:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] thread info: [<_MainThread(MainThread, started 135440660459648)>, , , , , , , , ] {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:14:17 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-7111208f-5a0a-4d42-8091-137bdce1840c tempest-VolumesGetTest-1069786405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:14:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7111208f-5a0a-4d42-8091-137bdce1840c tempest-VolumesGetTest-1069786405 None] Flow 'volume_create_manager' (f82c4df9-e3ad-4e1b-9ee4-1be1f9e1a8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:14:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7111208f-5a0a-4d42-8091-137bdce1840c tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58f84c5b-e98b-434b-b1d6-0a9b70474ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7111208f-5a0a-4d42-8091-137bdce1840c tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58f84c5b-e98b-434b-b1d6-0a9b70474ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:14:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1001204969',display_name='tempest-VolumesGetTest-Volume-639441186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24115586-b168-409e-8228-4cbce6623282,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b528bf3790f4fd9a5eb0149c75a54a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:14:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:14:17Z,use_quota=True,user_id='be3a418f8b7f41e5af0877c2b3e37eec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7111208f-5a0a-4d42-8091-137bdce1840c tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b996ff44-c517-4c67-a026-cd7566c22256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7111208f-5a0a-4d42-8091-137bdce1840c tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b996ff44-c517-4c67-a026-cd7566c22256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7111208f-5a0a-4d42-8091-137bdce1840c tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41af24a7-a08f-40a3-9b86-8b448e2867e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7111208f-5a0a-4d42-8091-137bdce1840c tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41af24a7-a08f-40a3-9b86-8b448e2867e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24115586-b168-409e-8228-4cbce6623282', 'volume_name': 'volume-24115586-b168-409e-8228-4cbce6623282', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7111208f-5a0a-4d42-8091-137bdce1840c tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b68e706-9a5c-47cd-ac5a-11829878f659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7111208f-5a0a-4d42-8091-137bdce1840c tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b68e706-9a5c-47cd-ac5a-11829878f659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7111208f-5a0a-4d42-8091-137bdce1840c tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22d6eadb-a8aa-4460-abeb-78a9e2251fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:17 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-7111208f-5a0a-4d42-8091-137bdce1840c tempest-VolumesGetTest-1069786405 None] Volume 24115586-b168-409e-8228-4cbce6623282: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24115586-b168-409e-8228-4cbce6623282', 'volume_size': 1} Sep 23 00:14:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7111208f-5a0a-4d42-8091-137bdce1840c tempest-VolumesGetTest-1069786405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7111208f-5a0a-4d42-8091-137bdce1840c tempest-VolumesGetTest-1069786405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:17 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7111208f-5a0a-4d42-8091-137bdce1840c tempest-VolumesGetTest-1069786405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:14:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1001204969',display_name='tempest-VolumesGetTest-Volume-639441186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24115586-b168-409e-8228-4cbce6623282,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b528bf3790f4fd9a5eb0149c75a54a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:14:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:14:17Z,use_quota=True,user_id='be3a418f8b7f41e5af0877c2b3e37eec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:14:17 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-7111208f-5a0a-4d42-8091-137bdce1840c tempest-VolumesGetTest-1069786405 None] Creating volume 24115586-b168-409e-8228-4cbce6623282 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:14:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7111208f-5a0a-4d42-8091-137bdce1840c tempest-VolumesGetTest-1069786405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7111208f-5a0a-4d42-8091-137bdce1840c tempest-VolumesGetTest-1069786405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:17 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7111208f-5a0a-4d42-8091-137bdce1840c tempest-VolumesGetTest-1069786405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:14:17 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7111208f-5a0a-4d42-8091-137bdce1840c tempest-VolumesGetTest-1069786405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:14:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7111208f-5a0a-4d42-8091-137bdce1840c tempest-VolumesGetTest-1069786405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:17 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7111208f-5a0a-4d42-8091-137bdce1840c tempest-VolumesGetTest-1069786405 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:14:17 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-7111208f-5a0a-4d42-8091-137bdce1840c tempest-VolumesGetTest-1069786405 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:14:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7111208f-5a0a-4d42-8091-137bdce1840c tempest-VolumesGetTest-1069786405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-24115586-b168-409e-8228-4cbce6623282 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:17 devstack sudo[91379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-24115586-b168-409e-8228-4cbce6623282 1073741824 Sep 23 00:14:17 devstack sudo[91379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:17 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:UPDATE=78,cinder:SELECT=67,cinder:INSERT=17,cinder:DELETE=7 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:14:17 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcb506bc-f143-46ad-afae-2fdaa603c801 tempest-AttachVolumeNegativeTest-86753276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:14:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-dcb506bc-f143-46ad-afae-2fdaa603c801 tempest-AttachVolumeNegativeTest-86753276 None] Flow 'volume_create_manager' (a466b16c-6877-4bcc-998a-c2de9919236c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:14:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-dcb506bc-f143-46ad-afae-2fdaa603c801 tempest-AttachVolumeNegativeTest-86753276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94c1da79-e74c-4117-92f6-11066b45eadf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-dcb506bc-f143-46ad-afae-2fdaa603c801 tempest-AttachVolumeNegativeTest-86753276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94c1da79-e74c-4117-92f6-11066b45eadf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:14:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1688229888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c71d1f24-155e-4bb4-b25c-8f3e2336a7dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf852d90769e4bda8c3bcaf3abc9cdde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:14:18Z,use_quota=True,user_id='d38946cf23d046538a65564ac3e17d4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-dcb506bc-f143-46ad-afae-2fdaa603c801 tempest-AttachVolumeNegativeTest-86753276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e98e7f4a-1aad-4dc8-96a5-b16f21094e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-dcb506bc-f143-46ad-afae-2fdaa603c801 tempest-AttachVolumeNegativeTest-86753276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e98e7f4a-1aad-4dc8-96a5-b16f21094e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-dcb506bc-f143-46ad-afae-2fdaa603c801 tempest-AttachVolumeNegativeTest-86753276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28ef2509-8035-4f05-8afc-a625c3801374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-dcb506bc-f143-46ad-afae-2fdaa603c801 tempest-AttachVolumeNegativeTest-86753276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28ef2509-8035-4f05-8afc-a625c3801374) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c71d1f24-155e-4bb4-b25c-8f3e2336a7dc', 'volume_name': 'volume-c71d1f24-155e-4bb4-b25c-8f3e2336a7dc', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-dcb506bc-f143-46ad-afae-2fdaa603c801 tempest-AttachVolumeNegativeTest-86753276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd5a45f7-4dcb-40c1-bc7c-d3dccdba1eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-dcb506bc-f143-46ad-afae-2fdaa603c801 tempest-AttachVolumeNegativeTest-86753276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd5a45f7-4dcb-40c1-bc7c-d3dccdba1eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-dcb506bc-f143-46ad-afae-2fdaa603c801 tempest-AttachVolumeNegativeTest-86753276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d47a8622-4436-4340-890c-e54dfb3d556c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:18 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-dcb506bc-f143-46ad-afae-2fdaa603c801 tempest-AttachVolumeNegativeTest-86753276 None] Volume c71d1f24-155e-4bb4-b25c-8f3e2336a7dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c71d1f24-155e-4bb4-b25c-8f3e2336a7dc', 'volume_size': 1} Sep 23 00:14:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-dcb506bc-f143-46ad-afae-2fdaa603c801 tempest-AttachVolumeNegativeTest-86753276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:18 devstack sudo[91379]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7111208f-5a0a-4d42-8091-137bdce1840c tempest-VolumesGetTest-1069786405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-24115586-b168-409e-8228-4cbce6623282 1073741824" returned: 0 in 0.773s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7111208f-5a0a-4d42-8091-137bdce1840c tempest-VolumesGetTest-1069786405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-24115586-b168-409e-8228-4cbce6623282 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:18 devstack sudo[91386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-24115586-b168-409e-8228-4cbce6623282 Sep 23 00:14:18 devstack sudo[91386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:18 devstack sudo[91386]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7111208f-5a0a-4d42-8091-137bdce1840c tempest-VolumesGetTest-1069786405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-24115586-b168-409e-8228-4cbce6623282" returned: 0 in 0.352s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:18 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7111208f-5a0a-4d42-8091-137bdce1840c tempest-VolumesGetTest-1069786405 None] <== create_volume: return (1198ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:14:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7111208f-5a0a-4d42-8091-137bdce1840c tempest-VolumesGetTest-1069786405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.202s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-dcb506bc-f143-46ad-afae-2fdaa603c801 tempest-AttachVolumeNegativeTest-86753276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.490s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:18 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-dcb506bc-f143-46ad-afae-2fdaa603c801 tempest-AttachVolumeNegativeTest-86753276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:14:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1688229888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c71d1f24-155e-4bb4-b25c-8f3e2336a7dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf852d90769e4bda8c3bcaf3abc9cdde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:14:18Z,use_quota=True,user_id='d38946cf23d046538a65564ac3e17d4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:14:18 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-dcb506bc-f143-46ad-afae-2fdaa603c801 tempest-AttachVolumeNegativeTest-86753276 None] Creating volume c71d1f24-155e-4bb4-b25c-8f3e2336a7dc {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:14:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-dcb506bc-f143-46ad-afae-2fdaa603c801 tempest-AttachVolumeNegativeTest-86753276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-dcb506bc-f143-46ad-afae-2fdaa603c801 tempest-AttachVolumeNegativeTest-86753276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:18 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-dcb506bc-f143-46ad-afae-2fdaa603c801 tempest-AttachVolumeNegativeTest-86753276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:14:18 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-dcb506bc-f143-46ad-afae-2fdaa603c801 tempest-AttachVolumeNegativeTest-86753276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:14:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-dcb506bc-f143-46ad-afae-2fdaa603c801 tempest-AttachVolumeNegativeTest-86753276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:18 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-dcb506bc-f143-46ad-afae-2fdaa603c801 tempest-AttachVolumeNegativeTest-86753276 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:14:18 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-dcb506bc-f143-46ad-afae-2fdaa603c801 tempest-AttachVolumeNegativeTest-86753276 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:14:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dcb506bc-f143-46ad-afae-2fdaa603c801 tempest-AttachVolumeNegativeTest-86753276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c71d1f24-155e-4bb4-b25c-8f3e2336a7dc 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:18 devstack sudo[91389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c71d1f24-155e-4bb4-b25c-8f3e2336a7dc 1073741824 Sep 23 00:14:18 devstack sudo[91389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7111208f-5a0a-4d42-8091-137bdce1840c tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22d6eadb-a8aa-4460-abeb-78a9e2251fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24115586-b168-409e-8228-4cbce6623282', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7111208f-5a0a-4d42-8091-137bdce1840c tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3739fa7-c7c0-4df8-87c2-813f9804458f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:18 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-7111208f-5a0a-4d42-8091-137bdce1840c tempest-VolumesGetTest-1069786405 None] Volume volume-24115586-b168-409e-8228-4cbce6623282 (24115586-b168-409e-8228-4cbce6623282): created successfully Sep 23 00:14:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7111208f-5a0a-4d42-8091-137bdce1840c tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3739fa7-c7c0-4df8-87c2-813f9804458f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7111208f-5a0a-4d42-8091-137bdce1840c tempest-VolumesGetTest-1069786405 None] Flow 'volume_create_manager' (f82c4df9-e3ad-4e1b-9ee4-1be1f9e1a8bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:14:18 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-7111208f-5a0a-4d42-8091-137bdce1840c tempest-VolumesGetTest-1069786405 None] Created volume successfully. Sep 23 00:14:19 devstack sudo[91389]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dcb506bc-f143-46ad-afae-2fdaa603c801 tempest-AttachVolumeNegativeTest-86753276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c71d1f24-155e-4bb4-b25c-8f3e2336a7dc 1073741824" returned: 0 in 0.674s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dcb506bc-f143-46ad-afae-2fdaa603c801 tempest-AttachVolumeNegativeTest-86753276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c71d1f24-155e-4bb4-b25c-8f3e2336a7dc {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:19 devstack sudo[91398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c71d1f24-155e-4bb4-b25c-8f3e2336a7dc Sep 23 00:14:19 devstack sudo[91398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5609b8c9-5770-4545-9fc9-ca4dd7909929 tempest-VolumesGetTest-1069786405 None] Acquiring lock "cinder-24115586-b168-409e-8228-4cbce6623282-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:14:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5609b8c9-5770-4545-9fc9-ca4dd7909929 tempest-VolumesGetTest-1069786405 None] Lock "cinder-24115586-b168-409e-8228-4cbce6623282-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:14:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5609b8c9-5770-4545-9fc9-ca4dd7909929 tempest-VolumesGetTest-1069786405 None] Acquiring lock "cinder-quobyte-24115586-b168-409e-8228-4cbce6623282" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:14:19 devstack sudo[91398]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dcb506bc-f143-46ad-afae-2fdaa603c801 tempest-AttachVolumeNegativeTest-86753276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c71d1f24-155e-4bb4-b25c-8f3e2336a7dc" returned: 0 in 0.510s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:19 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-dcb506bc-f143-46ad-afae-2fdaa603c801 tempest-AttachVolumeNegativeTest-86753276 None] <== create_volume: return (1312ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:14:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-dcb506bc-f143-46ad-afae-2fdaa603c801 tempest-AttachVolumeNegativeTest-86753276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.316s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5609b8c9-5770-4545-9fc9-ca4dd7909929 tempest-VolumesGetTest-1069786405 None] Lock "cinder-quobyte-24115586-b168-409e-8228-4cbce6623282" acquired by "delete_volume" :: waited 0.028s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:14:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-dcb506bc-f143-46ad-afae-2fdaa603c801 tempest-AttachVolumeNegativeTest-86753276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d47a8622-4436-4340-890c-e54dfb3d556c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c71d1f24-155e-4bb4-b25c-8f3e2336a7dc', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-dcb506bc-f143-46ad-afae-2fdaa603c801 tempest-AttachVolumeNegativeTest-86753276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2ab289b-2512-41d2-a1fa-a3667e61a8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:19 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7c675a-26fa-4f0f-8a52-5cbc2c77f29b]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:14:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5609b8c9-5770-4545-9fc9-ca4dd7909929 tempest-VolumesGetTest-1069786405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-24115586-b168-409e-8228-4cbce6623282 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:20 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-dcb506bc-f143-46ad-afae-2fdaa603c801 tempest-AttachVolumeNegativeTest-86753276 None] Volume volume-c71d1f24-155e-4bb4-b25c-8f3e2336a7dc (c71d1f24-155e-4bb4-b25c-8f3e2336a7dc): created successfully Sep 23 00:14:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-dcb506bc-f143-46ad-afae-2fdaa603c801 tempest-AttachVolumeNegativeTest-86753276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2ab289b-2512-41d2-a1fa-a3667e61a8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-dcb506bc-f143-46ad-afae-2fdaa603c801 tempest-AttachVolumeNegativeTest-86753276 None] Flow 'volume_create_manager' (a466b16c-6877-4bcc-998a-c2de9919236c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:14:20 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-dcb506bc-f143-46ad-afae-2fdaa603c801 tempest-AttachVolumeNegativeTest-86753276 None] Created volume successfully. Sep 23 00:14:20 devstack sudo[91405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-24115586-b168-409e-8228-4cbce6623282 Sep 23 00:14:20 devstack sudo[91405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:20 devstack sudo[91405]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5609b8c9-5770-4545-9fc9-ca4dd7909929 tempest-VolumesGetTest-1069786405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-24115586-b168-409e-8228-4cbce6623282" returned: 0 in 0.508s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5609b8c9-5770-4545-9fc9-ca4dd7909929 tempest-VolumesGetTest-1069786405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-24115586-b168-409e-8228-4cbce6623282 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:20 devstack sudo[91416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-24115586-b168-409e-8228-4cbce6623282 Sep 23 00:14:20 devstack sudo[91416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:20 devstack sudo[91416]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5609b8c9-5770-4545-9fc9-ca4dd7909929 tempest-VolumesGetTest-1069786405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-24115586-b168-409e-8228-4cbce6623282" returned: 0 in 0.331s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:20 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5609b8c9-5770-4545-9fc9-ca4dd7909929 tempest-VolumesGetTest-1069786405 None] Lock "cinder-quobyte-24115586-b168-409e-8228-4cbce6623282" released by "delete_volume" :: held 0.914s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:14:20 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-5609b8c9-5770-4545-9fc9-ca4dd7909929 tempest-VolumesGetTest-1069786405 None] Created reservations ['7609b048-89d6-426b-bedf-667baf779b6a', '2844aeee-33f5-4999-92f4-57b7e0d6d34a', '418f8145-b119-4f3c-bf15-d068a01e136d', '468ba36b-3dc2-4288-a195-aa0768d4f640'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:14:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5609b8c9-5770-4545-9fc9-ca4dd7909929 tempest-VolumesGetTest-1069786405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5609b8c9-5770-4545-9fc9-ca4dd7909929 tempest-VolumesGetTest-1069786405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:21 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5609b8c9-5770-4545-9fc9-ca4dd7909929 tempest-VolumesGetTest-1069786405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:14:21 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5609b8c9-5770-4545-9fc9-ca4dd7909929 tempest-VolumesGetTest-1069786405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:14:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5609b8c9-5770-4545-9fc9-ca4dd7909929 tempest-VolumesGetTest-1069786405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5609b8c9-5770-4545-9fc9-ca4dd7909929 tempest-VolumesGetTest-1069786405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:21 devstack sudo[91419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:14:21 devstack sudo[91419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:21 devstack sudo[91419]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5609b8c9-5770-4545-9fc9-ca4dd7909929 tempest-VolumesGetTest-1069786405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.417s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:21 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-5609b8c9-5770-4545-9fc9-ca4dd7909929 tempest-VolumesGetTest-1069786405 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:14:21 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-5609b8c9-5770-4545-9fc9-ca4dd7909929 tempest-VolumesGetTest-1069786405 None] Deleted volume successfully. Sep 23 00:14:21 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5609b8c9-5770-4545-9fc9-ca4dd7909929 tempest-VolumesGetTest-1069786405 None] Lock "cinder-24115586-b168-409e-8228-4cbce6623282-delete_volume" released by "delete_volume" :: held 1.760s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:14:22 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-324cb7fd-e60a-43a5-86c5-f5f51525a790 tempest-VolumesGetTest-1069786405 None] Acquiring lock "cinder-2ae74d0e-05ca-461e-87a9-e69ff04863c0-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:14:22 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-324cb7fd-e60a-43a5-86c5-f5f51525a790 tempest-VolumesGetTest-1069786405 None] Lock "cinder-2ae74d0e-05ca-461e-87a9-e69ff04863c0-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:14:22 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-324cb7fd-e60a-43a5-86c5-f5f51525a790 tempest-VolumesGetTest-1069786405 None] Acquiring lock "cinder-quobyte-2ae74d0e-05ca-461e-87a9-e69ff04863c0" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:14:22 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-324cb7fd-e60a-43a5-86c5-f5f51525a790 tempest-VolumesGetTest-1069786405 None] Lock "cinder-quobyte-2ae74d0e-05ca-461e-87a9-e69ff04863c0" acquired by "delete_volume" :: waited 0.045s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:14:22 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[205c7bf6-5455-4af3-bb68-06a781846f16]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:14:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-324cb7fd-e60a-43a5-86c5-f5f51525a790 tempest-VolumesGetTest-1069786405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2ae74d0e-05ca-461e-87a9-e69ff04863c0 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:22 devstack sudo[91427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2ae74d0e-05ca-461e-87a9-e69ff04863c0 Sep 23 00:14:22 devstack sudo[91427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-54ddd717-6bdc-40d1-b51c-12e1c9b3fe72 req-69903ba5-7298-4bb9-8562-019d52a8b6ee tempest-AttachVolumeNegativeTest-86753276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-54ddd717-6bdc-40d1-b51c-12e1c9b3fe72 req-69903ba5-7298-4bb9-8562-019d52a8b6ee tempest-AttachVolumeNegativeTest-86753276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-54ddd717-6bdc-40d1-b51c-12e1c9b3fe72 req-69903ba5-7298-4bb9-8562-019d52a8b6ee tempest-AttachVolumeNegativeTest-86753276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.041s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-54ddd717-6bdc-40d1-b51c-12e1c9b3fe72 req-69903ba5-7298-4bb9-8562-019d52a8b6ee tempest-AttachVolumeNegativeTest-86753276 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974', 'name': 'volume-c71d1f24-155e-4bb4-b25c-8f3e2336a7dc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f2126448-76c0-4782-a085-3c54a88ad43b', 'enforce_multipath': True} {{(pid=86591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:14:23 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-54ddd717-6bdc-40d1-b51c-12e1c9b3fe72 req-69903ba5-7298-4bb9-8562-019d52a8b6ee tempest-AttachVolumeNegativeTest-86753276 None] attachment_update completed successfully. Sep 23 00:14:23 devstack sudo[91427]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-324cb7fd-e60a-43a5-86c5-f5f51525a790 tempest-VolumesGetTest-1069786405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2ae74d0e-05ca-461e-87a9-e69ff04863c0" returned: 0 in 0.847s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-324cb7fd-e60a-43a5-86c5-f5f51525a790 tempest-VolumesGetTest-1069786405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2ae74d0e-05ca-461e-87a9-e69ff04863c0 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:23 devstack sudo[91441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2ae74d0e-05ca-461e-87a9-e69ff04863c0 Sep 23 00:14:23 devstack sudo[91441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:23 devstack sudo[91441]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-324cb7fd-e60a-43a5-86c5-f5f51525a790 tempest-VolumesGetTest-1069786405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2ae74d0e-05ca-461e-87a9-e69ff04863c0" returned: 0 in 0.416s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:23 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-324cb7fd-e60a-43a5-86c5-f5f51525a790 tempest-VolumesGetTest-1069786405 None] Lock "cinder-quobyte-2ae74d0e-05ca-461e-87a9-e69ff04863c0" released by "delete_volume" :: held 1.378s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:14:24 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-324cb7fd-e60a-43a5-86c5-f5f51525a790 tempest-VolumesGetTest-1069786405 None] Created reservations ['0032ed71-dcbc-4fbd-8ce3-89c163368244', '65e8cec2-0759-41c1-9f21-cb1eea74fe5b', 'fab65c05-687d-46b4-aeb8-8e1875deb935', '27b19378-5d28-4645-b010-d525f186041e'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:14:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-324cb7fd-e60a-43a5-86c5-f5f51525a790 tempest-VolumesGetTest-1069786405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-324cb7fd-e60a-43a5-86c5-f5f51525a790 tempest-VolumesGetTest-1069786405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:24 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-324cb7fd-e60a-43a5-86c5-f5f51525a790 tempest-VolumesGetTest-1069786405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:14:24 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-324cb7fd-e60a-43a5-86c5-f5f51525a790 tempest-VolumesGetTest-1069786405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:14:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-324cb7fd-e60a-43a5-86c5-f5f51525a790 tempest-VolumesGetTest-1069786405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-324cb7fd-e60a-43a5-86c5-f5f51525a790 tempest-VolumesGetTest-1069786405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:24 devstack sudo[91855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:14:24 devstack sudo[91855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:24 devstack sudo[91855]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-324cb7fd-e60a-43a5-86c5-f5f51525a790 tempest-VolumesGetTest-1069786405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.458s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:24 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-324cb7fd-e60a-43a5-86c5-f5f51525a790 tempest-VolumesGetTest-1069786405 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:14:24 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-324cb7fd-e60a-43a5-86c5-f5f51525a790 tempest-VolumesGetTest-1069786405 None] Deleted volume successfully. Sep 23 00:14:24 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-324cb7fd-e60a-43a5-86c5-f5f51525a790 tempest-VolumesGetTest-1069786405 None] Lock "cinder-2ae74d0e-05ca-461e-87a9-e69ff04863c0-delete_volume" released by "delete_volume" :: held 2.364s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:14:25 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e8576e92-0a27-4025-bbe1-a482e634c4cb tempest-VolumesGetTest-1069786405 None] Acquiring lock "cinder-c188c3af-037c-4372-81d4-452cff015807-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:14:25 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e8576e92-0a27-4025-bbe1-a482e634c4cb tempest-VolumesGetTest-1069786405 None] Lock "cinder-c188c3af-037c-4372-81d4-452cff015807-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:14:25 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e8576e92-0a27-4025-bbe1-a482e634c4cb tempest-VolumesGetTest-1069786405 None] Acquiring lock "cinder-quobyte-c188c3af-037c-4372-81d4-452cff015807" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:14:25 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e8576e92-0a27-4025-bbe1-a482e634c4cb tempest-VolumesGetTest-1069786405 None] Lock "cinder-quobyte-c188c3af-037c-4372-81d4-452cff015807" acquired by "delete_volume" :: waited 0.027s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:14:25 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52f85b1-616c-458a-9ccc-ce5dd7bb20f9]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:14:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e8576e92-0a27-4025-bbe1-a482e634c4cb tempest-VolumesGetTest-1069786405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c188c3af-037c-4372-81d4-452cff015807 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:25 devstack sudo[91859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c188c3af-037c-4372-81d4-452cff015807 Sep 23 00:14:25 devstack sudo[91859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:25 devstack sudo[91859]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e8576e92-0a27-4025-bbe1-a482e634c4cb tempest-VolumesGetTest-1069786405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c188c3af-037c-4372-81d4-452cff015807" returned: 0 in 0.480s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e8576e92-0a27-4025-bbe1-a482e634c4cb tempest-VolumesGetTest-1069786405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c188c3af-037c-4372-81d4-452cff015807 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:25 devstack sudo[91865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c188c3af-037c-4372-81d4-452cff015807 Sep 23 00:14:25 devstack sudo[91865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:26 devstack sudo[91865]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e8576e92-0a27-4025-bbe1-a482e634c4cb tempest-VolumesGetTest-1069786405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c188c3af-037c-4372-81d4-452cff015807" returned: 0 in 0.465s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:26 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e8576e92-0a27-4025-bbe1-a482e634c4cb tempest-VolumesGetTest-1069786405 None] Lock "cinder-quobyte-c188c3af-037c-4372-81d4-452cff015807" released by "delete_volume" :: held 1.043s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:14:26 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-e8576e92-0a27-4025-bbe1-a482e634c4cb tempest-VolumesGetTest-1069786405 None] Created reservations ['5422dfb2-19af-43a5-9d25-a616ad224fe4', '238cad13-65a8-472e-9bf5-8ac5d3d26790', '06d0365c-6e90-474f-aef7-c88fb7e69129', 'a4828cfe-d3c4-4152-bd46-274a30e44f59'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:14:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e8576e92-0a27-4025-bbe1-a482e634c4cb tempest-VolumesGetTest-1069786405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e8576e92-0a27-4025-bbe1-a482e634c4cb tempest-VolumesGetTest-1069786405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:26 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e8576e92-0a27-4025-bbe1-a482e634c4cb tempest-VolumesGetTest-1069786405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:14:26 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e8576e92-0a27-4025-bbe1-a482e634c4cb tempest-VolumesGetTest-1069786405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:14:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e8576e92-0a27-4025-bbe1-a482e634c4cb tempest-VolumesGetTest-1069786405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e8576e92-0a27-4025-bbe1-a482e634c4cb tempest-VolumesGetTest-1069786405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:26 devstack sudo[91870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:14:26 devstack sudo[91870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:27 devstack sudo[91870]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e8576e92-0a27-4025-bbe1-a482e634c4cb tempest-VolumesGetTest-1069786405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.404s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:27 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-e8576e92-0a27-4025-bbe1-a482e634c4cb tempest-VolumesGetTest-1069786405 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:14:27 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-e8576e92-0a27-4025-bbe1-a482e634c4cb tempest-VolumesGetTest-1069786405 None] Deleted volume successfully. Sep 23 00:14:27 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e8576e92-0a27-4025-bbe1-a482e634c4cb tempest-VolumesGetTest-1069786405 None] Lock "cinder-c188c3af-037c-4372-81d4-452cff015807-delete_volume" released by "delete_volume" :: held 1.900s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:14:27 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-5825bd7f-c215-43b7-8a39-c07bd8725503 req-428ec0c7-c62f-4f13-94a2-38e1fcdbd17f tempest-AttachVolumeNegativeTest-86753276 None] Terminate volume connection completed successfully. Sep 23 00:14:27 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-5825bd7f-c215-43b7-8a39-c07bd8725503 req-428ec0c7-c62f-4f13-94a2-38e1fcdbd17f tempest-AttachVolumeNegativeTest-86753276 None] Deleting attachment f2126448-76c0-4782-a085-3c54a88ad43b. {{(pid=86591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:14:29 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-9219ce1e-a143-4bdb-9287-fc1148e775b9 tempest-VolumesGetTest-1069786405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:14:29 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9219ce1e-a143-4bdb-9287-fc1148e775b9 tempest-VolumesGetTest-1069786405 None] Flow 'volume_create_manager' (06996c62-1507-4783-acf0-00800c6c72f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:14:29 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9219ce1e-a143-4bdb-9287-fc1148e775b9 tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aa14271-f442-4c98-ad90-56d0004428b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:29 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9219ce1e-a143-4bdb-9287-fc1148e775b9 tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aa14271-f442-4c98-ad90-56d0004428b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:14:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-354580753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7536f850-ef86-493f-b826-be5eb86da06f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2b528bf3790f4fd9a5eb0149c75a54a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:14:30Z,use_quota=True,user_id='be3a418f8b7f41e5af0877c2b3e37eec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:29 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9219ce1e-a143-4bdb-9287-fc1148e775b9 tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95557075-8bbb-4d84-a925-f42c45b103db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:29 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9219ce1e-a143-4bdb-9287-fc1148e775b9 tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95557075-8bbb-4d84-a925-f42c45b103db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:29 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9219ce1e-a143-4bdb-9287-fc1148e775b9 tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a5d2db5-7954-4924-a881-3a1aa97f2d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:29 devstack cinder-volume[86591]: DEBUG cinder.image.glance [None req-9219ce1e-a143-4bdb-9287-fc1148e775b9 tempest-VolumesGetTest-1069786405 None] Creating Keystone auth plugin from conf {{(pid=86591) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 00:14:30 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9219ce1e-a143-4bdb-9287-fc1148e775b9 tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a5d2db5-7954-4924-a881-3a1aa97f2d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7536f850-ef86-493f-b826-be5eb86da06f', 'volume_name': 'volume-7536f850-ef86-493f-b826-be5eb86da06f', 'volume_size': 1, 'image_id': 'acf635b7-10f9-4fce-8332-3b60fddafd4d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/acf635b7-10f9-4fce-8332-3b60fddafd4d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '91fff89797994a81952b7814d0d951c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'acf635b7-10f9-4fce-8332-3b60fddafd4d', 'created_at': datetime.datetime(2026, 9, 22, 22, 4, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 4, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/acf635b7-10f9-4fce-8332-3b60fddafd4d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:30 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9219ce1e-a143-4bdb-9287-fc1148e775b9 tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33578834-1f4e-4074-bc34-911ee4389a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:30 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9219ce1e-a143-4bdb-9287-fc1148e775b9 tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33578834-1f4e-4074-bc34-911ee4389a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:30 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9219ce1e-a143-4bdb-9287-fc1148e775b9 tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daf8adf0-45d0-4b24-8da7-787007080df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:30 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-9219ce1e-a143-4bdb-9287-fc1148e775b9 tempest-VolumesGetTest-1069786405 None] Volume 7536f850-ef86-493f-b826-be5eb86da06f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7536f850-ef86-493f-b826-be5eb86da06f', 'volume_size': 1, 'image_id': 'acf635b7-10f9-4fce-8332-3b60fddafd4d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/acf635b7-10f9-4fce-8332-3b60fddafd4d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '91fff89797994a81952b7814d0d951c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'acf635b7-10f9-4fce-8332-3b60fddafd4d', 'created_at': datetime.datetime(2026, 9, 22, 22, 4, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 4, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/acf635b7-10f9-4fce-8332-3b60fddafd4d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 23 00:14:30 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-9219ce1e-a143-4bdb-9287-fc1148e775b9 tempest-VolumesGetTest-1069786405 None] Trying to clone 7536f850-ef86-493f-b826-be5eb86da06f from image acf635b7-10f9-4fce-8332-3b60fddafd4d at location (None, [{'url': 'file:///opt/stack/data/glance/images/acf635b7-10f9-4fce-8332-3b60fddafd4d', 'metadata': {}}]). {{(pid=86591) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 00:14:31 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-9219ce1e-a143-4bdb-9287-fc1148e775b9 tempest-VolumesGetTest-1069786405 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_8wzegyabdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86591) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 00:14:31 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-9219ce1e-a143-4bdb-9287-fc1148e775b9 tempest-VolumesGetTest-1069786405 None] Image download 20.69 MB at 20.69 MB/s Sep 23 00:14:31 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01b5de2-6de1-4286-8c2d-8c12af9b3164]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:14:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9219ce1e-a143-4bdb-9287-fc1148e775b9 tempest-VolumesGetTest-1069786405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_8wzegyabdevstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:31 devstack sudo[91971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_8wzegyabdevstack@QuobyteHD Sep 23 00:14:31 devstack sudo[91971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:31 devstack sudo[91971]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9219ce1e-a143-4bdb-9287-fc1148e775b9 tempest-VolumesGetTest-1069786405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_8wzegyabdevstack@QuobyteHD" returned: 0 in 0.813s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:32 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-9219ce1e-a143-4bdb-9287-fc1148e775b9 tempest-VolumesGetTest-1069786405 None] Temporary image acf635b7-10f9-4fce-8332-3b60fddafd4d is fetched for user be3a418f8b7f41e5af0877c2b3e37eec. {{(pid=86591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 00:14:32 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7338da5-fb45-40e6-ad4f-2603d7a6b394]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:14:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9219ce1e-a143-4bdb-9287-fc1148e775b9 tempest-VolumesGetTest-1069786405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_8wzegyabdevstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-fe714595-5833-4444-8251-02008bf761f6 req-a55109ce-1ae3-4586-a949-78f6cff68215 tempest-AttachVolumeShelveTestJSON-294261862 None] No connector for attachment 83d2d59b-3975-4894-8b12-179d761d7cc9; skipping storage backend terminate_connection call. {{(pid=86591) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 23 00:14:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-fe714595-5833-4444-8251-02008bf761f6 req-a55109ce-1ae3-4586-a949-78f6cff68215 tempest-AttachVolumeShelveTestJSON-294261862 None] Deleting attachment 83d2d59b-3975-4894-8b12-179d761d7cc9. {{(pid=86591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:14:32 devstack sudo[91978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_8wzegyabdevstack@QuobyteHD Sep 23 00:14:32 devstack sudo[91978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:32 devstack sudo[91978]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9219ce1e-a143-4bdb-9287-fc1148e775b9 tempest-VolumesGetTest-1069786405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_8wzegyabdevstack@QuobyteHD" returned: 0 in 0.497s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9219ce1e-a143-4bdb-9287-fc1148e775b9 tempest-VolumesGetTest-1069786405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9219ce1e-a143-4bdb-9287-fc1148e775b9 tempest-VolumesGetTest-1069786405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:32 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9219ce1e-a143-4bdb-9287-fc1148e775b9 tempest-VolumesGetTest-1069786405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:14:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-354580753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7536f850-ef86-493f-b826-be5eb86da06f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2b528bf3790f4fd9a5eb0149c75a54a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:14:30Z,use_quota=True,user_id='be3a418f8b7f41e5af0877c2b3e37eec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:14:32 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-9219ce1e-a143-4bdb-9287-fc1148e775b9 tempest-VolumesGetTest-1069786405 None] Creating volume 7536f850-ef86-493f-b826-be5eb86da06f {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:14:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9219ce1e-a143-4bdb-9287-fc1148e775b9 tempest-VolumesGetTest-1069786405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9219ce1e-a143-4bdb-9287-fc1148e775b9 tempest-VolumesGetTest-1069786405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:32 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9219ce1e-a143-4bdb-9287-fc1148e775b9 tempest-VolumesGetTest-1069786405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:14:32 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9219ce1e-a143-4bdb-9287-fc1148e775b9 tempest-VolumesGetTest-1069786405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:14:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9219ce1e-a143-4bdb-9287-fc1148e775b9 tempest-VolumesGetTest-1069786405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:32 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9219ce1e-a143-4bdb-9287-fc1148e775b9 tempest-VolumesGetTest-1069786405 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:14:32 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-9219ce1e-a143-4bdb-9287-fc1148e775b9 tempest-VolumesGetTest-1069786405 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:14:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9219ce1e-a143-4bdb-9287-fc1148e775b9 tempest-VolumesGetTest-1069786405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7536f850-ef86-493f-b826-be5eb86da06f 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:32 devstack sudo[91988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7536f850-ef86-493f-b826-be5eb86da06f 1073741824 Sep 23 00:14:32 devstack sudo[91988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:33 devstack sudo[91988]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9219ce1e-a143-4bdb-9287-fc1148e775b9 tempest-VolumesGetTest-1069786405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7536f850-ef86-493f-b826-be5eb86da06f 1073741824" returned: 0 in 0.850s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9219ce1e-a143-4bdb-9287-fc1148e775b9 tempest-VolumesGetTest-1069786405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7536f850-ef86-493f-b826-be5eb86da06f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:33 devstack sudo[91995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7536f850-ef86-493f-b826-be5eb86da06f Sep 23 00:14:33 devstack sudo[91995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:34 devstack sudo[91995]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9219ce1e-a143-4bdb-9287-fc1148e775b9 tempest-VolumesGetTest-1069786405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7536f850-ef86-493f-b826-be5eb86da06f" returned: 0 in 0.503s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:34 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9219ce1e-a143-4bdb-9287-fc1148e775b9 tempest-VolumesGetTest-1069786405 None] <== create_volume: return (1441ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:14:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9219ce1e-a143-4bdb-9287-fc1148e775b9 tempest-VolumesGetTest-1069786405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.444s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:34 devstack cinder-volume[86591]: DEBUG cinder.volume.volume_utils [None req-9219ce1e-a143-4bdb-9287-fc1148e775b9 tempest-VolumesGetTest-1069786405 None] Attempting download of acf635b7-10f9-4fce-8332-3b60fddafd4d ((None, [{'url': 'file:///opt/stack/data/glance/images/acf635b7-10f9-4fce-8332-3b60fddafd4d', 'metadata': {}}])) to volume 7536f850-ef86-493f-b826-be5eb86da06f. {{(pid=86591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 00:14:34 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[97de7cc0-e382-44e8-a9e9-f70aea69b1cd]: (4, 'raw') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:14:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9219ce1e-a143-4bdb-9287-fc1148e775b9 tempest-VolumesGetTest-1069786405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_acf635b7-10f9-4fce-8332-3b60fddafd4d_ppz13san {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:34 devstack sudo[92010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_acf635b7-10f9-4fce-8332-3b60fddafd4d_ppz13san Sep 23 00:14:34 devstack sudo[92010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:34 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6edf1ed8-ee05-4d1d-9c4e-a24909daa3ff tempest-AttachVolumeNegativeTest-86753276 None] Acquiring lock "cinder-c71d1f24-155e-4bb4-b25c-8f3e2336a7dc-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:14:34 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6edf1ed8-ee05-4d1d-9c4e-a24909daa3ff tempest-AttachVolumeNegativeTest-86753276 None] Lock "cinder-c71d1f24-155e-4bb4-b25c-8f3e2336a7dc-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:14:34 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6edf1ed8-ee05-4d1d-9c4e-a24909daa3ff tempest-AttachVolumeNegativeTest-86753276 None] Acquiring lock "cinder-quobyte-c71d1f24-155e-4bb4-b25c-8f3e2336a7dc" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:14:34 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6edf1ed8-ee05-4d1d-9c4e-a24909daa3ff tempest-AttachVolumeNegativeTest-86753276 None] Lock "cinder-quobyte-c71d1f24-155e-4bb4-b25c-8f3e2336a7dc" acquired by "delete_volume" :: waited 0.043s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:14:34 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d76ae44-bbb0-49c0-930e-72175bba86fb]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:14:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6edf1ed8-ee05-4d1d-9c4e-a24909daa3ff tempest-AttachVolumeNegativeTest-86753276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c71d1f24-155e-4bb4-b25c-8f3e2336a7dc {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:34 devstack sudo[92010]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9219ce1e-a143-4bdb-9287-fc1148e775b9 tempest-VolumesGetTest-1069786405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_acf635b7-10f9-4fce-8332-3b60fddafd4d_ppz13san" returned: 0 in 0.601s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9219ce1e-a143-4bdb-9287-fc1148e775b9 tempest-VolumesGetTest-1069786405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_acf635b7-10f9-4fce-8332-3b60fddafd4d_ppz13san {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:35 devstack sudo[92020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c71d1f24-155e-4bb4-b25c-8f3e2336a7dc Sep 23 00:14:35 devstack sudo[92020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:35 devstack sudo[92021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_acf635b7-10f9-4fce-8332-3b60fddafd4d_ppz13san Sep 23 00:14:35 devstack sudo[92021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:35 devstack sudo[92020]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6edf1ed8-ee05-4d1d-9c4e-a24909daa3ff tempest-AttachVolumeNegativeTest-86753276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c71d1f24-155e-4bb4-b25c-8f3e2336a7dc" returned: 0 in 0.617s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6edf1ed8-ee05-4d1d-9c4e-a24909daa3ff tempest-AttachVolumeNegativeTest-86753276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c71d1f24-155e-4bb4-b25c-8f3e2336a7dc {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:35 devstack sudo[92021]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9219ce1e-a143-4bdb-9287-fc1148e775b9 tempest-VolumesGetTest-1069786405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_acf635b7-10f9-4fce-8332-3b60fddafd4d_ppz13san" returned: 1 in 0.633s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9219ce1e-a143-4bdb-9287-fc1148e775b9 tempest-VolumesGetTest-1069786405 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_acf635b7-10f9-4fce-8332-3b60fddafd4d_ppz13san' failed. Not Retrying. {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:14:35 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a258e4b-84c2-457d-a68a-c0f33eca22c7]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:14:35 devstack sudo[92029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c71d1f24-155e-4bb4-b25c-8f3e2336a7dc Sep 23 00:14:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9219ce1e-a143-4bdb-9287-fc1148e775b9 tempest-VolumesGetTest-1069786405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_8wzegyabdevstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:35 devstack sudo[92029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:35 devstack sudo[92031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_8wzegyabdevstack@QuobyteHD Sep 23 00:14:35 devstack sudo[92031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:35 devstack sudo[92029]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6edf1ed8-ee05-4d1d-9c4e-a24909daa3ff tempest-AttachVolumeNegativeTest-86753276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c71d1f24-155e-4bb4-b25c-8f3e2336a7dc" returned: 0 in 0.311s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:35 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6edf1ed8-ee05-4d1d-9c4e-a24909daa3ff tempest-AttachVolumeNegativeTest-86753276 None] Lock "cinder-quobyte-c71d1f24-155e-4bb4-b25c-8f3e2336a7dc" released by "delete_volume" :: held 1.019s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:14:35 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-6edf1ed8-ee05-4d1d-9c4e-a24909daa3ff tempest-AttachVolumeNegativeTest-86753276 None] Created reservations ['c801638e-c5af-4797-a988-4b3b6ebfaa9a', 'fe05b761-5297-4fae-b626-ed2c4221a3ad', '2ad06168-4658-4a3e-98b1-620909e18445', '797c5ed4-6801-45e0-9d41-9e0cc36d535e'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:14:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6edf1ed8-ee05-4d1d-9c4e-a24909daa3ff tempest-AttachVolumeNegativeTest-86753276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6edf1ed8-ee05-4d1d-9c4e-a24909daa3ff tempest-AttachVolumeNegativeTest-86753276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:35 devstack sudo[92031]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:36 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6edf1ed8-ee05-4d1d-9c4e-a24909daa3ff tempest-AttachVolumeNegativeTest-86753276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:14:36 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6edf1ed8-ee05-4d1d-9c4e-a24909daa3ff tempest-AttachVolumeNegativeTest-86753276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:14:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6edf1ed8-ee05-4d1d-9c4e-a24909daa3ff tempest-AttachVolumeNegativeTest-86753276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6edf1ed8-ee05-4d1d-9c4e-a24909daa3ff tempest-AttachVolumeNegativeTest-86753276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9219ce1e-a143-4bdb-9287-fc1148e775b9 tempest-VolumesGetTest-1069786405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_8wzegyabdevstack@QuobyteHD" returned: 0 in 0.552s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:36 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-9219ce1e-a143-4bdb-9287-fc1148e775b9 tempest-VolumesGetTest-1069786405 None] acf635b7-10f9-4fce-8332-3b60fddafd4d was qcow2, converting to qcow2 {{(pid=86591) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 00:14:36 devstack sudo[92039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:14:36 devstack sudo[92039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9219ce1e-a143-4bdb-9287-fc1148e775b9 tempest-VolumesGetTest-1069786405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_8wzegyabdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7536f850-ef86-493f-b826-be5eb86da06f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:36 devstack sudo[92041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_8wzegyabdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7536f850-ef86-493f-b826-be5eb86da06f Sep 23 00:14:36 devstack sudo[92041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:36 devstack sudo[92039]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6edf1ed8-ee05-4d1d-9c4e-a24909daa3ff tempest-AttachVolumeNegativeTest-86753276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.326s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:36 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-6edf1ed8-ee05-4d1d-9c4e-a24909daa3ff tempest-AttachVolumeNegativeTest-86753276 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:14:36 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-6edf1ed8-ee05-4d1d-9c4e-a24909daa3ff tempest-AttachVolumeNegativeTest-86753276 None] Deleted volume successfully. Sep 23 00:14:36 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6edf1ed8-ee05-4d1d-9c4e-a24909daa3ff tempest-AttachVolumeNegativeTest-86753276 None] Lock "cinder-c71d1f24-155e-4bb4-b25c-8f3e2336a7dc-delete_volume" released by "delete_volume" :: held 1.737s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:14:37 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-165575e0-34a6-4f94-ba47-c1b7a4ab5aba tempest-AttachVolumeNegativeTest-86753276 None] Acquiring lock "cinder-2a70ad0f-0902-438a-ad08-5d3a000cc951-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:14:37 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-165575e0-34a6-4f94-ba47-c1b7a4ab5aba tempest-AttachVolumeNegativeTest-86753276 None] Lock "cinder-2a70ad0f-0902-438a-ad08-5d3a000cc951-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:14:37 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-165575e0-34a6-4f94-ba47-c1b7a4ab5aba tempest-AttachVolumeNegativeTest-86753276 None] Acquiring lock "cinder-quobyte-2a70ad0f-0902-438a-ad08-5d3a000cc951" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:14:37 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-165575e0-34a6-4f94-ba47-c1b7a4ab5aba tempest-AttachVolumeNegativeTest-86753276 None] Lock "cinder-quobyte-2a70ad0f-0902-438a-ad08-5d3a000cc951" acquired by "delete_volume" :: waited 0.028s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:14:37 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e16ad7-8a78-411d-90c8-eac61f3f74e5]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:14:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-165575e0-34a6-4f94-ba47-c1b7a4ab5aba tempest-AttachVolumeNegativeTest-86753276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2a70ad0f-0902-438a-ad08-5d3a000cc951 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:37 devstack sudo[92052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2a70ad0f-0902-438a-ad08-5d3a000cc951 Sep 23 00:14:37 devstack sudo[92052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:37 devstack sudo[92052]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-165575e0-34a6-4f94-ba47-c1b7a4ab5aba tempest-AttachVolumeNegativeTest-86753276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2a70ad0f-0902-438a-ad08-5d3a000cc951" returned: 0 in 0.631s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-165575e0-34a6-4f94-ba47-c1b7a4ab5aba tempest-AttachVolumeNegativeTest-86753276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2a70ad0f-0902-438a-ad08-5d3a000cc951 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:38 devstack sudo[92061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2a70ad0f-0902-438a-ad08-5d3a000cc951 Sep 23 00:14:38 devstack sudo[92061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:38 devstack sudo[92061]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-165575e0-34a6-4f94-ba47-c1b7a4ab5aba tempest-AttachVolumeNegativeTest-86753276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2a70ad0f-0902-438a-ad08-5d3a000cc951" returned: 0 in 0.607s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:38 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-165575e0-34a6-4f94-ba47-c1b7a4ab5aba tempest-AttachVolumeNegativeTest-86753276 None] Lock "cinder-quobyte-2a70ad0f-0902-438a-ad08-5d3a000cc951" released by "delete_volume" :: held 1.353s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:14:38 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-165575e0-34a6-4f94-ba47-c1b7a4ab5aba tempest-AttachVolumeNegativeTest-86753276 None] Created reservations ['894808cc-9692-4844-b981-e6f20a2f10a7', '94943a2b-7d60-42a4-82ed-45ce2fc55715', '93aa2bce-809d-4f4e-86f6-d3bce10ac5c6', '9c48d414-c00a-4954-93c5-ab77d99b8e84'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:14:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-165575e0-34a6-4f94-ba47-c1b7a4ab5aba tempest-AttachVolumeNegativeTest-86753276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-165575e0-34a6-4f94-ba47-c1b7a4ab5aba tempest-AttachVolumeNegativeTest-86753276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:38 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-165575e0-34a6-4f94-ba47-c1b7a4ab5aba tempest-AttachVolumeNegativeTest-86753276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:14:39 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-165575e0-34a6-4f94-ba47-c1b7a4ab5aba tempest-AttachVolumeNegativeTest-86753276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:14:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-165575e0-34a6-4f94-ba47-c1b7a4ab5aba tempest-AttachVolumeNegativeTest-86753276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-165575e0-34a6-4f94-ba47-c1b7a4ab5aba tempest-AttachVolumeNegativeTest-86753276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:39 devstack sudo[92119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:14:39 devstack sudo[92119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:39 devstack sudo[92041]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9219ce1e-a143-4bdb-9287-fc1148e775b9 tempest-VolumesGetTest-1069786405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_8wzegyabdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7536f850-ef86-493f-b826-be5eb86da06f" returned: 0 in 3.471s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:39 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-9219ce1e-a143-4bdb-9287-fc1148e775b9 tempest-VolumesGetTest-1069786405 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_8wzegyabdevstack@QuobyteHD, size 112.00 MB, duration 3.47 sec, destination /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7536f850-ef86-493f-b826-be5eb86da06f {{(pid=86591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:14:39 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-9219ce1e-a143-4bdb-9287-fc1148e775b9 tempest-VolumesGetTest-1069786405 None] Converted 112.00 MB image at 32.26 MB/s Sep 23 00:14:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9219ce1e-a143-4bdb-9287-fc1148e775b9 tempest-VolumesGetTest-1069786405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7536f850-ef86-493f-b826-be5eb86da06f 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:39 devstack sudo[92130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7536f850-ef86-493f-b826-be5eb86da06f 1G Sep 23 00:14:39 devstack sudo[92130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:39 devstack sudo[92119]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-165575e0-34a6-4f94-ba47-c1b7a4ab5aba tempest-AttachVolumeNegativeTest-86753276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.663s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:39 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-165575e0-34a6-4f94-ba47-c1b7a4ab5aba tempest-AttachVolumeNegativeTest-86753276 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:14:39 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-165575e0-34a6-4f94-ba47-c1b7a4ab5aba tempest-AttachVolumeNegativeTest-86753276 None] Deleted volume successfully. Sep 23 00:14:39 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-165575e0-34a6-4f94-ba47-c1b7a4ab5aba tempest-AttachVolumeNegativeTest-86753276 None] Lock "cinder-2a70ad0f-0902-438a-ad08-5d3a000cc951-delete_volume" released by "delete_volume" :: held 2.600s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:14:40 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0898568c-fbed-43be-9727-940bfba855ed tempest-AttachVolumeNegativeTest-86753276 None] Acquiring lock "cinder-c4d2ec28-8869-46e8-bc62-4265c35d0eb1-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:14:40 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0898568c-fbed-43be-9727-940bfba855ed tempest-AttachVolumeNegativeTest-86753276 None] Lock "cinder-c4d2ec28-8869-46e8-bc62-4265c35d0eb1-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:14:40 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0898568c-fbed-43be-9727-940bfba855ed tempest-AttachVolumeNegativeTest-86753276 None] Acquiring lock "cinder-quobyte-c4d2ec28-8869-46e8-bc62-4265c35d0eb1" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:14:40 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0898568c-fbed-43be-9727-940bfba855ed tempest-AttachVolumeNegativeTest-86753276 None] Lock "cinder-quobyte-c4d2ec28-8869-46e8-bc62-4265c35d0eb1" acquired by "delete_volume" :: waited 0.051s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:14:40 devstack sudo[92130]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9219ce1e-a143-4bdb-9287-fc1148e775b9 tempest-VolumesGetTest-1069786405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7536f850-ef86-493f-b826-be5eb86da06f 1G" returned: 0 in 0.930s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:40 devstack cinder-volume[86591]: DEBUG cinder.volume.volume_utils [None req-9219ce1e-a143-4bdb-9287-fc1148e775b9 tempest-VolumesGetTest-1069786405 None] Downloaded image acf635b7-10f9-4fce-8332-3b60fddafd4d ((None, [{'url': 'file:///opt/stack/data/glance/images/acf635b7-10f9-4fce-8332-3b60fddafd4d', 'metadata': {}}])) to volume 7536f850-ef86-493f-b826-be5eb86da06f successfully. {{(pid=86591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 00:14:40 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-9219ce1e-a143-4bdb-9287-fc1148e775b9 tempest-VolumesGetTest-1069786405 None] Temporary image acf635b7-10f9-4fce-8332-3b60fddafd4d for user be3a418f8b7f41e5af0877c2b3e37eec is deleted. {{(pid=86591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 00:14:40 devstack cinder-volume[86591]: DEBUG cinder.volume.volume_utils [None req-9219ce1e-a143-4bdb-9287-fc1148e775b9 tempest-VolumesGetTest-1069786405 None] Marking volume 7536f850-ef86-493f-b826-be5eb86da06f as bootable. {{(pid=86591) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 00:14:40 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0b4f0d-2bae-45af-9725-9480a5d4c76a]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:14:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0898568c-fbed-43be-9727-940bfba855ed tempest-AttachVolumeNegativeTest-86753276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c4d2ec28-8869-46e8-bc62-4265c35d0eb1 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:40 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-9219ce1e-a143-4bdb-9287-fc1148e775b9 tempest-VolumesGetTest-1069786405 None] Copying metadata from image acf635b7-10f9-4fce-8332-3b60fddafd4d to 7536f850-ef86-493f-b826-be5eb86da06f. {{(pid=86591) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 00:14:40 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-9219ce1e-a143-4bdb-9287-fc1148e775b9 tempest-VolumesGetTest-1069786405 None] Creating volume glance metadata for volume 7536f850-ef86-493f-b826-be5eb86da06f backed by image acf635b7-10f9-4fce-8332-3b60fddafd4d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'acf635b7-10f9-4fce-8332-3b60fddafd4d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86591) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 00:14:40 devstack sudo[92140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c4d2ec28-8869-46e8-bc62-4265c35d0eb1 Sep 23 00:14:40 devstack sudo[92140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9219ce1e-a143-4bdb-9287-fc1148e775b9 tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daf8adf0-45d0-4b24-8da7-787007080df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7536f850-ef86-493f-b826-be5eb86da06f', 'volume_size': 1, 'image_id': 'acf635b7-10f9-4fce-8332-3b60fddafd4d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/acf635b7-10f9-4fce-8332-3b60fddafd4d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '91fff89797994a81952b7814d0d951c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'acf635b7-10f9-4fce-8332-3b60fddafd4d', 'created_at': datetime.datetime(2026, 9, 22, 22, 4, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 4, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/acf635b7-10f9-4fce-8332-3b60fddafd4d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9219ce1e-a143-4bdb-9287-fc1148e775b9 tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2f779e8-4d1c-4c75-8a7b-f4cdb83f1496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:40 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-9219ce1e-a143-4bdb-9287-fc1148e775b9 tempest-VolumesGetTest-1069786405 None] Volume volume-7536f850-ef86-493f-b826-be5eb86da06f (7536f850-ef86-493f-b826-be5eb86da06f): created successfully Sep 23 00:14:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9219ce1e-a143-4bdb-9287-fc1148e775b9 tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2f779e8-4d1c-4c75-8a7b-f4cdb83f1496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9219ce1e-a143-4bdb-9287-fc1148e775b9 tempest-VolumesGetTest-1069786405 None] Flow 'volume_create_manager' (06996c62-1507-4783-acf0-00800c6c72f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:14:41 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-9219ce1e-a143-4bdb-9287-fc1148e775b9 tempest-VolumesGetTest-1069786405 None] Created volume successfully. Sep 23 00:14:41 devstack sudo[92140]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0898568c-fbed-43be-9727-940bfba855ed tempest-AttachVolumeNegativeTest-86753276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c4d2ec28-8869-46e8-bc62-4265c35d0eb1" returned: 0 in 0.706s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0898568c-fbed-43be-9727-940bfba855ed tempest-AttachVolumeNegativeTest-86753276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c4d2ec28-8869-46e8-bc62-4265c35d0eb1 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:41 devstack sudo[92146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c4d2ec28-8869-46e8-bc62-4265c35d0eb1 Sep 23 00:14:41 devstack sudo[92146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:41 devstack sudo[92146]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0898568c-fbed-43be-9727-940bfba855ed tempest-AttachVolumeNegativeTest-86753276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c4d2ec28-8869-46e8-bc62-4265c35d0eb1" returned: 0 in 0.604s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:41 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0898568c-fbed-43be-9727-940bfba855ed tempest-AttachVolumeNegativeTest-86753276 None] Lock "cinder-quobyte-c4d2ec28-8869-46e8-bc62-4265c35d0eb1" released by "delete_volume" :: held 1.480s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:14:41 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-0898568c-fbed-43be-9727-940bfba855ed tempest-AttachVolumeNegativeTest-86753276 None] Created reservations ['c9683f15-6c04-4850-b226-c176a269f543', '6f23719e-1fe0-4d3b-8ff7-6c01949d847d', 'd7028421-e7f1-45bd-9d9f-216e58a939d4', 'f198b624-f4d6-49f3-8287-28b568d2eed1'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:14:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0898568c-fbed-43be-9727-940bfba855ed tempest-AttachVolumeNegativeTest-86753276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0898568c-fbed-43be-9727-940bfba855ed tempest-AttachVolumeNegativeTest-86753276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0898568c-fbed-43be-9727-940bfba855ed tempest-AttachVolumeNegativeTest-86753276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:14:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0898568c-fbed-43be-9727-940bfba855ed tempest-AttachVolumeNegativeTest-86753276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:14:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0898568c-fbed-43be-9727-940bfba855ed tempest-AttachVolumeNegativeTest-86753276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0898568c-fbed-43be-9727-940bfba855ed tempest-AttachVolumeNegativeTest-86753276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:42 devstack sudo[92150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:14:42 devstack sudo[92150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:42 devstack sudo[92150]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0898568c-fbed-43be-9727-940bfba855ed tempest-AttachVolumeNegativeTest-86753276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.741s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:42 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-0898568c-fbed-43be-9727-940bfba855ed tempest-AttachVolumeNegativeTest-86753276 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:14:42 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-0898568c-fbed-43be-9727-940bfba855ed tempest-AttachVolumeNegativeTest-86753276 None] Deleted volume successfully. Sep 23 00:14:42 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0898568c-fbed-43be-9727-940bfba855ed tempest-AttachVolumeNegativeTest-86753276 None] Lock "cinder-c4d2ec28-8869-46e8-bc62-4265c35d0eb1-delete_volume" released by "delete_volume" :: held 2.725s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:14:43 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7565120-3ff0-4c3f-bcd3-cd34926d7aa6 tempest-VolumesGetTest-1069786405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:14:43 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d7565120-3ff0-4c3f-bcd3-cd34926d7aa6 tempest-VolumesGetTest-1069786405 None] Flow 'volume_create_manager' (261d58c4-c5d5-4d1b-9196-52c25f46fb94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:14:43 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d7565120-3ff0-4c3f-bcd3-cd34926d7aa6 tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (033e6233-aee2-41ba-aa05-9d5dde590ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:43 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d7565120-3ff0-4c3f-bcd3-cd34926d7aa6 tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (033e6233-aee2-41ba-aa05-9d5dde590ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:14:43Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1205810159',display_name='tempest-VolumesGetTest-Volume-2063168338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf9ecef9-45c3-464d-b27b-91c47f8fd970,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b528bf3790f4fd9a5eb0149c75a54a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:14:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:14:44Z,use_quota=True,user_id='be3a418f8b7f41e5af0877c2b3e37eec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:43 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d7565120-3ff0-4c3f-bcd3-cd34926d7aa6 tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64e115f9-07c4-4bc1-8c75-7557a5544d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:43 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d7565120-3ff0-4c3f-bcd3-cd34926d7aa6 tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64e115f9-07c4-4bc1-8c75-7557a5544d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:43 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d7565120-3ff0-4c3f-bcd3-cd34926d7aa6 tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46badd76-d063-49dd-bd4b-bda774b096d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:43 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d7565120-3ff0-4c3f-bcd3-cd34926d7aa6 tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46badd76-d063-49dd-bd4b-bda774b096d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf9ecef9-45c3-464d-b27b-91c47f8fd970', 'volume_name': 'volume-cf9ecef9-45c3-464d-b27b-91c47f8fd970', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d7565120-3ff0-4c3f-bcd3-cd34926d7aa6 tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c8885ea-2688-4b12-ad94-92da6c9ea3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d7565120-3ff0-4c3f-bcd3-cd34926d7aa6 tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c8885ea-2688-4b12-ad94-92da6c9ea3b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d7565120-3ff0-4c3f-bcd3-cd34926d7aa6 tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70e8f5d4-b983-4cf2-9135-67e16e30e4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:44 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-d7565120-3ff0-4c3f-bcd3-cd34926d7aa6 tempest-VolumesGetTest-1069786405 None] Volume cf9ecef9-45c3-464d-b27b-91c47f8fd970: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf9ecef9-45c3-464d-b27b-91c47f8fd970', 'volume_size': 1} Sep 23 00:14:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d7565120-3ff0-4c3f-bcd3-cd34926d7aa6 tempest-VolumesGetTest-1069786405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d7565120-3ff0-4c3f-bcd3-cd34926d7aa6 tempest-VolumesGetTest-1069786405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:44 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d7565120-3ff0-4c3f-bcd3-cd34926d7aa6 tempest-VolumesGetTest-1069786405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:14:43Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1205810159',display_name='tempest-VolumesGetTest-Volume-2063168338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf9ecef9-45c3-464d-b27b-91c47f8fd970,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b528bf3790f4fd9a5eb0149c75a54a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:14:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:14:44Z,use_quota=True,user_id='be3a418f8b7f41e5af0877c2b3e37eec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:14:44 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-d7565120-3ff0-4c3f-bcd3-cd34926d7aa6 tempest-VolumesGetTest-1069786405 None] Creating volume cf9ecef9-45c3-464d-b27b-91c47f8fd970 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:14:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d7565120-3ff0-4c3f-bcd3-cd34926d7aa6 tempest-VolumesGetTest-1069786405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d7565120-3ff0-4c3f-bcd3-cd34926d7aa6 tempest-VolumesGetTest-1069786405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:44 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d7565120-3ff0-4c3f-bcd3-cd34926d7aa6 tempest-VolumesGetTest-1069786405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:14:44 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d7565120-3ff0-4c3f-bcd3-cd34926d7aa6 tempest-VolumesGetTest-1069786405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:14:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d7565120-3ff0-4c3f-bcd3-cd34926d7aa6 tempest-VolumesGetTest-1069786405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:44 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d7565120-3ff0-4c3f-bcd3-cd34926d7aa6 tempest-VolumesGetTest-1069786405 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:14:44 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-d7565120-3ff0-4c3f-bcd3-cd34926d7aa6 tempest-VolumesGetTest-1069786405 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:14:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d7565120-3ff0-4c3f-bcd3-cd34926d7aa6 tempest-VolumesGetTest-1069786405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf9ecef9-45c3-464d-b27b-91c47f8fd970 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:44 devstack sudo[92154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf9ecef9-45c3-464d-b27b-91c47f8fd970 1073741824 Sep 23 00:14:44 devstack sudo[92154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:44 devstack sudo[92154]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d7565120-3ff0-4c3f-bcd3-cd34926d7aa6 tempest-VolumesGetTest-1069786405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf9ecef9-45c3-464d-b27b-91c47f8fd970 1073741824" returned: 0 in 0.825s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d7565120-3ff0-4c3f-bcd3-cd34926d7aa6 tempest-VolumesGetTest-1069786405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf9ecef9-45c3-464d-b27b-91c47f8fd970 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:45 devstack sudo[92161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf9ecef9-45c3-464d-b27b-91c47f8fd970 Sep 23 00:14:45 devstack sudo[92161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:45 devstack sudo[92161]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d7565120-3ff0-4c3f-bcd3-cd34926d7aa6 tempest-VolumesGetTest-1069786405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf9ecef9-45c3-464d-b27b-91c47f8fd970" returned: 0 in 0.413s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:45 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d7565120-3ff0-4c3f-bcd3-cd34926d7aa6 tempest-VolumesGetTest-1069786405 None] <== create_volume: return (1338ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:14:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d7565120-3ff0-4c3f-bcd3-cd34926d7aa6 tempest-VolumesGetTest-1069786405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.345s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d7565120-3ff0-4c3f-bcd3-cd34926d7aa6 tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70e8f5d4-b983-4cf2-9135-67e16e30e4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf9ecef9-45c3-464d-b27b-91c47f8fd970', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d7565120-3ff0-4c3f-bcd3-cd34926d7aa6 tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (615f2b33-7d0e-43cc-a56c-4570079a8cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:45 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-d7565120-3ff0-4c3f-bcd3-cd34926d7aa6 tempest-VolumesGetTest-1069786405 None] Volume volume-cf9ecef9-45c3-464d-b27b-91c47f8fd970 (cf9ecef9-45c3-464d-b27b-91c47f8fd970): created successfully Sep 23 00:14:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d7565120-3ff0-4c3f-bcd3-cd34926d7aa6 tempest-VolumesGetTest-1069786405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (615f2b33-7d0e-43cc-a56c-4570079a8cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d7565120-3ff0-4c3f-bcd3-cd34926d7aa6 tempest-VolumesGetTest-1069786405 None] Flow 'volume_create_manager' (261d58c4-c5d5-4d1b-9196-52c25f46fb94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:14:45 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-d7565120-3ff0-4c3f-bcd3-cd34926d7aa6 tempest-VolumesGetTest-1069786405 None] Created volume successfully. Sep 23 00:14:46 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ce560781-1191-496a-931d-ded6688c6c0b tempest-VolumesGetTest-1069786405 None] Acquiring lock "cinder-cf9ecef9-45c3-464d-b27b-91c47f8fd970-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:14:46 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ce560781-1191-496a-931d-ded6688c6c0b tempest-VolumesGetTest-1069786405 None] Lock "cinder-cf9ecef9-45c3-464d-b27b-91c47f8fd970-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:14:46 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ce560781-1191-496a-931d-ded6688c6c0b tempest-VolumesGetTest-1069786405 None] Acquiring lock "cinder-quobyte-cf9ecef9-45c3-464d-b27b-91c47f8fd970" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:14:46 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ce560781-1191-496a-931d-ded6688c6c0b tempest-VolumesGetTest-1069786405 None] Lock "cinder-quobyte-cf9ecef9-45c3-464d-b27b-91c47f8fd970" acquired by "delete_volume" :: waited 0.037s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:14:46 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35a5458-089c-4c19-946f-63fe8409e53b]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:14:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ce560781-1191-496a-931d-ded6688c6c0b tempest-VolumesGetTest-1069786405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf9ecef9-45c3-464d-b27b-91c47f8fd970 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:46 devstack sudo[92192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf9ecef9-45c3-464d-b27b-91c47f8fd970 Sep 23 00:14:46 devstack sudo[92192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:47 devstack sudo[92192]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ce560781-1191-496a-931d-ded6688c6c0b tempest-VolumesGetTest-1069786405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf9ecef9-45c3-464d-b27b-91c47f8fd970" returned: 0 in 0.626s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ce560781-1191-496a-931d-ded6688c6c0b tempest-VolumesGetTest-1069786405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf9ecef9-45c3-464d-b27b-91c47f8fd970 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:47 devstack sudo[92207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf9ecef9-45c3-464d-b27b-91c47f8fd970 Sep 23 00:14:47 devstack sudo[92207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:47 devstack sudo[92207]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ce560781-1191-496a-931d-ded6688c6c0b tempest-VolumesGetTest-1069786405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf9ecef9-45c3-464d-b27b-91c47f8fd970" returned: 0 in 0.353s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:47 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ce560781-1191-496a-931d-ded6688c6c0b tempest-VolumesGetTest-1069786405 None] Lock "cinder-quobyte-cf9ecef9-45c3-464d-b27b-91c47f8fd970" released by "delete_volume" :: held 1.122s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:14:47 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-ce560781-1191-496a-931d-ded6688c6c0b tempest-VolumesGetTest-1069786405 None] Created reservations ['9a9ef445-e01e-46ef-9fe8-99e4435d486e', 'ea274984-889b-44d4-a32d-dce0433e15e8', '62e59c72-364f-4bd6-a8eb-d40ae5a47b81', '45cb375d-cdbd-4eec-a967-d046277e4519'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:14:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ce560781-1191-496a-931d-ded6688c6c0b tempest-VolumesGetTest-1069786405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ce560781-1191-496a-931d-ded6688c6c0b tempest-VolumesGetTest-1069786405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:47 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ce560781-1191-496a-931d-ded6688c6c0b tempest-VolumesGetTest-1069786405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:14:47 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ce560781-1191-496a-931d-ded6688c6c0b tempest-VolumesGetTest-1069786405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:14:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ce560781-1191-496a-931d-ded6688c6c0b tempest-VolumesGetTest-1069786405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ce560781-1191-496a-931d-ded6688c6c0b tempest-VolumesGetTest-1069786405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:47 devstack sudo[92210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:14:47 devstack sudo[92210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:48 devstack sudo[92210]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ce560781-1191-496a-931d-ded6688c6c0b tempest-VolumesGetTest-1069786405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.341s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:48 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-ce560781-1191-496a-931d-ded6688c6c0b tempest-VolumesGetTest-1069786405 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:14:48 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-ce560781-1191-496a-931d-ded6688c6c0b tempest-VolumesGetTest-1069786405 None] Deleted volume successfully. Sep 23 00:14:48 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ce560781-1191-496a-931d-ded6688c6c0b tempest-VolumesGetTest-1069786405 None] Lock "cinder-cf9ecef9-45c3-464d-b27b-91c47f8fd970-delete_volume" released by "delete_volume" :: held 2.090s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:14:48 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9e9fdd96-b2b9-4b33-980b-c595addae40e tempest-VolumesGetTest-1069786405 None] Acquiring lock "cinder-7536f850-ef86-493f-b826-be5eb86da06f-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:14:48 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9e9fdd96-b2b9-4b33-980b-c595addae40e tempest-VolumesGetTest-1069786405 None] Lock "cinder-7536f850-ef86-493f-b826-be5eb86da06f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:14:49 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9e9fdd96-b2b9-4b33-980b-c595addae40e tempest-VolumesGetTest-1069786405 None] Acquiring lock "cinder-quobyte-7536f850-ef86-493f-b826-be5eb86da06f" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:14:49 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9e9fdd96-b2b9-4b33-980b-c595addae40e tempest-VolumesGetTest-1069786405 None] Lock "cinder-quobyte-7536f850-ef86-493f-b826-be5eb86da06f" acquired by "delete_volume" :: waited 0.034s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:14:49 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[4122ace4-6d04-410d-9415-bb56b07896ae]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:14:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9e9fdd96-b2b9-4b33-980b-c595addae40e tempest-VolumesGetTest-1069786405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7536f850-ef86-493f-b826-be5eb86da06f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:49 devstack sudo[92232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7536f850-ef86-493f-b826-be5eb86da06f Sep 23 00:14:49 devstack sudo[92232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:50 devstack sudo[92232]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9e9fdd96-b2b9-4b33-980b-c595addae40e tempest-VolumesGetTest-1069786405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7536f850-ef86-493f-b826-be5eb86da06f" returned: 0 in 0.919s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9e9fdd96-b2b9-4b33-980b-c595addae40e tempest-VolumesGetTest-1069786405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7536f850-ef86-493f-b826-be5eb86da06f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:50 devstack sudo[92279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7536f850-ef86-493f-b826-be5eb86da06f Sep 23 00:14:50 devstack sudo[92279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:50 devstack sudo[92279]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9e9fdd96-b2b9-4b33-980b-c595addae40e tempest-VolumesGetTest-1069786405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7536f850-ef86-493f-b826-be5eb86da06f" returned: 0 in 0.676s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:50 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9e9fdd96-b2b9-4b33-980b-c595addae40e tempest-VolumesGetTest-1069786405 None] Lock "cinder-quobyte-7536f850-ef86-493f-b826-be5eb86da06f" released by "delete_volume" :: held 1.708s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:14:50 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-9e9fdd96-b2b9-4b33-980b-c595addae40e tempest-VolumesGetTest-1069786405 None] Created reservations ['a333ccc9-b8f3-4aba-9c19-33e3a91afdb2', '44911e7a-3455-42a3-9fa0-6aec77deeddb', 'ed612ea8-809a-4edd-8a93-c06d4125133b', '9fecca83-da9a-4513-83f7-55f5cad279b3'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:14:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9e9fdd96-b2b9-4b33-980b-c595addae40e tempest-VolumesGetTest-1069786405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9e9fdd96-b2b9-4b33-980b-c595addae40e tempest-VolumesGetTest-1069786405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:51 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9e9fdd96-b2b9-4b33-980b-c595addae40e tempest-VolumesGetTest-1069786405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:14:51 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9e9fdd96-b2b9-4b33-980b-c595addae40e tempest-VolumesGetTest-1069786405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:14:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9e9fdd96-b2b9-4b33-980b-c595addae40e tempest-VolumesGetTest-1069786405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9e9fdd96-b2b9-4b33-980b-c595addae40e tempest-VolumesGetTest-1069786405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:51 devstack sudo[92289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:14:51 devstack sudo[92289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:51 devstack sudo[92289]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9e9fdd96-b2b9-4b33-980b-c595addae40e tempest-VolumesGetTest-1069786405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.545s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:51 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-9e9fdd96-b2b9-4b33-980b-c595addae40e tempest-VolumesGetTest-1069786405 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:14:51 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-9e9fdd96-b2b9-4b33-980b-c595addae40e tempest-VolumesGetTest-1069786405 None] Deleted volume successfully. Sep 23 00:14:51 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9e9fdd96-b2b9-4b33-980b-c595addae40e tempest-VolumesGetTest-1069786405 None] Lock "cinder-7536f850-ef86-493f-b826-be5eb86da06f-delete_volume" released by "delete_volume" :: held 2.915s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:14:59 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [req-4c53da44-9bfd-4220-8a61-e2b71dface1f req-04d45e65-eb5c-4532-a0f5-2fb1089f9697 tempest-VolumesGetTestJSON-95911215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:14:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-4c53da44-9bfd-4220-8a61-e2b71dface1f req-04d45e65-eb5c-4532-a0f5-2fb1089f9697 tempest-VolumesGetTestJSON-95911215 None] Flow 'volume_create_manager' (707707a6-4a19-4064-aea0-48fb6b1f60fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:14:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-4c53da44-9bfd-4220-8a61-e2b71dface1f req-04d45e65-eb5c-4532-a0f5-2fb1089f9697 tempest-VolumesGetTestJSON-95911215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (293de903-3be6-4125-8ac1-5ed5d9bb6ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-4c53da44-9bfd-4220-8a61-e2b71dface1f req-04d45e65-eb5c-4532-a0f5-2fb1089f9697 tempest-VolumesGetTestJSON-95911215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (293de903-3be6-4125-8ac1-5ed5d9bb6ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:14:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1348329711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19b2fa48-9669-4ce8-819f-91b7077f55d1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='08cf3008fba24ab7862e33258e853656',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:00Z,use_quota=True,user_id='41554a7d01e943a282f3f333e1ccfc35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-4c53da44-9bfd-4220-8a61-e2b71dface1f req-04d45e65-eb5c-4532-a0f5-2fb1089f9697 tempest-VolumesGetTestJSON-95911215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9e42816-8443-45e5-a1a7-2e7c26eb53f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-4c53da44-9bfd-4220-8a61-e2b71dface1f req-04d45e65-eb5c-4532-a0f5-2fb1089f9697 tempest-VolumesGetTestJSON-95911215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9e42816-8443-45e5-a1a7-2e7c26eb53f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-4c53da44-9bfd-4220-8a61-e2b71dface1f req-04d45e65-eb5c-4532-a0f5-2fb1089f9697 tempest-VolumesGetTestJSON-95911215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d4cf534-20c3-4d3f-a5a5-cb34d68167c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-4c53da44-9bfd-4220-8a61-e2b71dface1f req-04d45e65-eb5c-4532-a0f5-2fb1089f9697 tempest-VolumesGetTestJSON-95911215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d4cf534-20c3-4d3f-a5a5-cb34d68167c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19b2fa48-9669-4ce8-819f-91b7077f55d1', 'volume_name': 'volume-19b2fa48-9669-4ce8-819f-91b7077f55d1', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-4c53da44-9bfd-4220-8a61-e2b71dface1f req-04d45e65-eb5c-4532-a0f5-2fb1089f9697 tempest-VolumesGetTestJSON-95911215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6d1004b-3af3-4aae-a63a-8ffc0396347f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-4c53da44-9bfd-4220-8a61-e2b71dface1f req-04d45e65-eb5c-4532-a0f5-2fb1089f9697 tempest-VolumesGetTestJSON-95911215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6d1004b-3af3-4aae-a63a-8ffc0396347f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-4c53da44-9bfd-4220-8a61-e2b71dface1f req-04d45e65-eb5c-4532-a0f5-2fb1089f9697 tempest-VolumesGetTestJSON-95911215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0d449d1-bc5f-4095-bb9a-2d30f741d94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:59 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [req-4c53da44-9bfd-4220-8a61-e2b71dface1f req-04d45e65-eb5c-4532-a0f5-2fb1089f9697 tempest-VolumesGetTestJSON-95911215 None] Volume 19b2fa48-9669-4ce8-819f-91b7077f55d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19b2fa48-9669-4ce8-819f-91b7077f55d1', 'volume_size': 1} Sep 23 00:14:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-4c53da44-9bfd-4220-8a61-e2b71dface1f req-04d45e65-eb5c-4532-a0f5-2fb1089f9697 tempest-VolumesGetTestJSON-95911215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-4c53da44-9bfd-4220-8a61-e2b71dface1f req-04d45e65-eb5c-4532-a0f5-2fb1089f9697 tempest-VolumesGetTestJSON-95911215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [req-4c53da44-9bfd-4220-8a61-e2b71dface1f req-04d45e65-eb5c-4532-a0f5-2fb1089f9697 tempest-VolumesGetTestJSON-95911215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:14:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1348329711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19b2fa48-9669-4ce8-819f-91b7077f55d1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='08cf3008fba24ab7862e33258e853656',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:00Z,use_quota=True,user_id='41554a7d01e943a282f3f333e1ccfc35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:14:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [req-4c53da44-9bfd-4220-8a61-e2b71dface1f req-04d45e65-eb5c-4532-a0f5-2fb1089f9697 tempest-VolumesGetTestJSON-95911215 None] Creating volume 19b2fa48-9669-4ce8-819f-91b7077f55d1 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:14:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-4c53da44-9bfd-4220-8a61-e2b71dface1f req-04d45e65-eb5c-4532-a0f5-2fb1089f9697 tempest-VolumesGetTestJSON-95911215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-4c53da44-9bfd-4220-8a61-e2b71dface1f req-04d45e65-eb5c-4532-a0f5-2fb1089f9697 tempest-VolumesGetTestJSON-95911215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [req-4c53da44-9bfd-4220-8a61-e2b71dface1f req-04d45e65-eb5c-4532-a0f5-2fb1089f9697 tempest-VolumesGetTestJSON-95911215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:14:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [req-4c53da44-9bfd-4220-8a61-e2b71dface1f req-04d45e65-eb5c-4532-a0f5-2fb1089f9697 tempest-VolumesGetTestJSON-95911215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:14:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-4c53da44-9bfd-4220-8a61-e2b71dface1f req-04d45e65-eb5c-4532-a0f5-2fb1089f9697 tempest-VolumesGetTestJSON-95911215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [req-4c53da44-9bfd-4220-8a61-e2b71dface1f req-04d45e65-eb5c-4532-a0f5-2fb1089f9697 tempest-VolumesGetTestJSON-95911215 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:14:59 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [req-4c53da44-9bfd-4220-8a61-e2b71dface1f req-04d45e65-eb5c-4532-a0f5-2fb1089f9697 tempest-VolumesGetTestJSON-95911215 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:14:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-4c53da44-9bfd-4220-8a61-e2b71dface1f req-04d45e65-eb5c-4532-a0f5-2fb1089f9697 tempest-VolumesGetTestJSON-95911215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-19b2fa48-9669-4ce8-819f-91b7077f55d1 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:59 devstack sudo[92351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-19b2fa48-9669-4ce8-819f-91b7077f55d1 1073741824 Sep 23 00:14:59 devstack sudo[92351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:59 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-1169758d-4a79-441b-9944-6cd599b83b43 tempest-VolumesListTestJSON-507965263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:14:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1169758d-4a79-441b-9944-6cd599b83b43 tempest-VolumesListTestJSON-507965263 None] Flow 'volume_create_manager' (089688bb-6e1b-4186-b85a-9623245ca3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:14:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1169758d-4a79-441b-9944-6cd599b83b43 tempest-VolumesListTestJSON-507965263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14dbbac3-5408-4a38-b09f-a51051e482fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1169758d-4a79-441b-9944-6cd599b83b43 tempest-VolumesListTestJSON-507965263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14dbbac3-5408-4a38-b09f-a51051e482fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:14:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-250770286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9498d4cd-aa20-41b5-86e1-f8ff0cca317f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='58b8408608a14e5196e5df780b1001ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:00Z,use_quota=True,user_id='9e5e844aed0c483fb334b8fbe9c7da54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1169758d-4a79-441b-9944-6cd599b83b43 tempest-VolumesListTestJSON-507965263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5f68665-e5d7-4d3c-9cf5-8a46a021d5b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1169758d-4a79-441b-9944-6cd599b83b43 tempest-VolumesListTestJSON-507965263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5f68665-e5d7-4d3c-9cf5-8a46a021d5b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1169758d-4a79-441b-9944-6cd599b83b43 tempest-VolumesListTestJSON-507965263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9df61adf-7d02-4086-a0e3-abcbf75ee06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1169758d-4a79-441b-9944-6cd599b83b43 tempest-VolumesListTestJSON-507965263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9df61adf-7d02-4086-a0e3-abcbf75ee06a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9498d4cd-aa20-41b5-86e1-f8ff0cca317f', 'volume_name': 'volume-9498d4cd-aa20-41b5-86e1-f8ff0cca317f', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1169758d-4a79-441b-9944-6cd599b83b43 tempest-VolumesListTestJSON-507965263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e2fe53b-0c8e-4f3d-beeb-236ac7444dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1169758d-4a79-441b-9944-6cd599b83b43 tempest-VolumesListTestJSON-507965263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e2fe53b-0c8e-4f3d-beeb-236ac7444dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1169758d-4a79-441b-9944-6cd599b83b43 tempest-VolumesListTestJSON-507965263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2642688-7667-42d2-9bdb-eb77c5364783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:00 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-1169758d-4a79-441b-9944-6cd599b83b43 tempest-VolumesListTestJSON-507965263 None] Volume 9498d4cd-aa20-41b5-86e1-f8ff0cca317f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9498d4cd-aa20-41b5-86e1-f8ff0cca317f', 'volume_size': 1} Sep 23 00:15:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1169758d-4a79-441b-9944-6cd599b83b43 tempest-VolumesListTestJSON-507965263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:00 devstack sudo[92351]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-4c53da44-9bfd-4220-8a61-e2b71dface1f req-04d45e65-eb5c-4532-a0f5-2fb1089f9697 tempest-VolumesGetTestJSON-95911215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-19b2fa48-9669-4ce8-819f-91b7077f55d1 1073741824" returned: 0 in 0.567s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-4c53da44-9bfd-4220-8a61-e2b71dface1f req-04d45e65-eb5c-4532-a0f5-2fb1089f9697 tempest-VolumesGetTestJSON-95911215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-19b2fa48-9669-4ce8-819f-91b7077f55d1 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:00 devstack sudo[92392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-19b2fa48-9669-4ce8-819f-91b7077f55d1 Sep 23 00:15:00 devstack sudo[92392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:00 devstack sudo[92392]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-4c53da44-9bfd-4220-8a61-e2b71dface1f req-04d45e65-eb5c-4532-a0f5-2fb1089f9697 tempest-VolumesGetTestJSON-95911215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-19b2fa48-9669-4ce8-819f-91b7077f55d1" returned: 0 in 0.387s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:00 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [req-4c53da44-9bfd-4220-8a61-e2b71dface1f req-04d45e65-eb5c-4532-a0f5-2fb1089f9697 tempest-VolumesGetTestJSON-95911215 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:15:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-4c53da44-9bfd-4220-8a61-e2b71dface1f req-04d45e65-eb5c-4532-a0f5-2fb1089f9697 tempest-VolumesGetTestJSON-95911215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1169758d-4a79-441b-9944-6cd599b83b43 tempest-VolumesListTestJSON-507965263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.711s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:00 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1169758d-4a79-441b-9944-6cd599b83b43 tempest-VolumesListTestJSON-507965263 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:14:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-250770286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9498d4cd-aa20-41b5-86e1-f8ff0cca317f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='58b8408608a14e5196e5df780b1001ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:00Z,use_quota=True,user_id='9e5e844aed0c483fb334b8fbe9c7da54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:15:00 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-1169758d-4a79-441b-9944-6cd599b83b43 tempest-VolumesListTestJSON-507965263 None] Creating volume 9498d4cd-aa20-41b5-86e1-f8ff0cca317f {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:15:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1169758d-4a79-441b-9944-6cd599b83b43 tempest-VolumesListTestJSON-507965263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1169758d-4a79-441b-9944-6cd599b83b43 tempest-VolumesListTestJSON-507965263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:00 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1169758d-4a79-441b-9944-6cd599b83b43 tempest-VolumesListTestJSON-507965263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:00 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1169758d-4a79-441b-9944-6cd599b83b43 tempest-VolumesListTestJSON-507965263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1169758d-4a79-441b-9944-6cd599b83b43 tempest-VolumesListTestJSON-507965263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:00 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1169758d-4a79-441b-9944-6cd599b83b43 tempest-VolumesListTestJSON-507965263 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:15:00 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-1169758d-4a79-441b-9944-6cd599b83b43 tempest-VolumesListTestJSON-507965263 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:15:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1169758d-4a79-441b-9944-6cd599b83b43 tempest-VolumesListTestJSON-507965263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9498d4cd-aa20-41b5-86e1-f8ff0cca317f 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:00 devstack sudo[92397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9498d4cd-aa20-41b5-86e1-f8ff0cca317f 1073741824 Sep 23 00:15:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-4c53da44-9bfd-4220-8a61-e2b71dface1f req-04d45e65-eb5c-4532-a0f5-2fb1089f9697 tempest-VolumesGetTestJSON-95911215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0d449d1-bc5f-4095-bb9a-2d30f741d94d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19b2fa48-9669-4ce8-819f-91b7077f55d1', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:00 devstack sudo[92397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-4c53da44-9bfd-4220-8a61-e2b71dface1f req-04d45e65-eb5c-4532-a0f5-2fb1089f9697 tempest-VolumesGetTestJSON-95911215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e1d4741-9ae2-4c93-8038-abd16de2e1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:00 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [req-4c53da44-9bfd-4220-8a61-e2b71dface1f req-04d45e65-eb5c-4532-a0f5-2fb1089f9697 tempest-VolumesGetTestJSON-95911215 None] Volume volume-19b2fa48-9669-4ce8-819f-91b7077f55d1 (19b2fa48-9669-4ce8-819f-91b7077f55d1): created successfully Sep 23 00:15:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-4c53da44-9bfd-4220-8a61-e2b71dface1f req-04d45e65-eb5c-4532-a0f5-2fb1089f9697 tempest-VolumesGetTestJSON-95911215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e1d4741-9ae2-4c93-8038-abd16de2e1f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-4c53da44-9bfd-4220-8a61-e2b71dface1f req-04d45e65-eb5c-4532-a0f5-2fb1089f9697 tempest-VolumesGetTestJSON-95911215 None] Flow 'volume_create_manager' (707707a6-4a19-4064-aea0-48fb6b1f60fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:15:00 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-4c53da44-9bfd-4220-8a61-e2b71dface1f req-04d45e65-eb5c-4532-a0f5-2fb1089f9697 tempest-VolumesGetTestJSON-95911215 None] Created volume successfully. Sep 23 00:15:01 devstack sudo[92397]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1169758d-4a79-441b-9944-6cd599b83b43 tempest-VolumesListTestJSON-507965263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9498d4cd-aa20-41b5-86e1-f8ff0cca317f 1073741824" returned: 0 in 0.598s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1169758d-4a79-441b-9944-6cd599b83b43 tempest-VolumesListTestJSON-507965263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9498d4cd-aa20-41b5-86e1-f8ff0cca317f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:01 devstack sudo[92402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9498d4cd-aa20-41b5-86e1-f8ff0cca317f Sep 23 00:15:01 devstack sudo[92402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:01 devstack sudo[92402]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1169758d-4a79-441b-9944-6cd599b83b43 tempest-VolumesListTestJSON-507965263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9498d4cd-aa20-41b5-86e1-f8ff0cca317f" returned: 0 in 0.284s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1169758d-4a79-441b-9944-6cd599b83b43 tempest-VolumesListTestJSON-507965263 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:15:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1169758d-4a79-441b-9944-6cd599b83b43 tempest-VolumesListTestJSON-507965263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1169758d-4a79-441b-9944-6cd599b83b43 tempest-VolumesListTestJSON-507965263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2642688-7667-42d2-9bdb-eb77c5364783) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9498d4cd-aa20-41b5-86e1-f8ff0cca317f', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1169758d-4a79-441b-9944-6cd599b83b43 tempest-VolumesListTestJSON-507965263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e482424f-0805-44ec-a08a-064fafc4c1ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:01 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-1169758d-4a79-441b-9944-6cd599b83b43 tempest-VolumesListTestJSON-507965263 None] Volume volume-9498d4cd-aa20-41b5-86e1-f8ff0cca317f (9498d4cd-aa20-41b5-86e1-f8ff0cca317f): created successfully Sep 23 00:15:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1169758d-4a79-441b-9944-6cd599b83b43 tempest-VolumesListTestJSON-507965263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e482424f-0805-44ec-a08a-064fafc4c1ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1169758d-4a79-441b-9944-6cd599b83b43 tempest-VolumesListTestJSON-507965263 None] Flow 'volume_create_manager' (089688bb-6e1b-4186-b85a-9623245ca3cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:15:01 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-1169758d-4a79-441b-9944-6cd599b83b43 tempest-VolumesListTestJSON-507965263 None] Created volume successfully. Sep 23 00:15:02 devstack cinder-volume[86591]: DEBUG cinder.coordination [req-414b661b-11cc-4d6c-a1fd-6a324c8d5900 req-0bdad902-27d6-481e-a6a5-4cac53a2465b tempest-VolumesGetTestJSON-95911215 None] Acquiring lock "cinder-19b2fa48-9669-4ce8-819f-91b7077f55d1-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:02 devstack cinder-volume[86591]: DEBUG cinder.coordination [req-414b661b-11cc-4d6c-a1fd-6a324c8d5900 req-0bdad902-27d6-481e-a6a5-4cac53a2465b tempest-VolumesGetTestJSON-95911215 None] Lock "cinder-19b2fa48-9669-4ce8-819f-91b7077f55d1-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:02 devstack cinder-volume[86591]: DEBUG cinder.coordination [req-414b661b-11cc-4d6c-a1fd-6a324c8d5900 req-0bdad902-27d6-481e-a6a5-4cac53a2465b tempest-VolumesGetTestJSON-95911215 None] Acquiring lock "cinder-quobyte-19b2fa48-9669-4ce8-819f-91b7077f55d1" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:02 devstack cinder-volume[86591]: DEBUG cinder.coordination [req-414b661b-11cc-4d6c-a1fd-6a324c8d5900 req-0bdad902-27d6-481e-a6a5-4cac53a2465b tempest-VolumesGetTestJSON-95911215 None] Lock "cinder-quobyte-19b2fa48-9669-4ce8-819f-91b7077f55d1" acquired by "delete_volume" :: waited 0.017s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:02 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0336948-5c79-43ec-8eee-3f1a66986c5f]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-414b661b-11cc-4d6c-a1fd-6a324c8d5900 req-0bdad902-27d6-481e-a6a5-4cac53a2465b tempest-VolumesGetTestJSON-95911215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-19b2fa48-9669-4ce8-819f-91b7077f55d1 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:02 devstack sudo[92408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-19b2fa48-9669-4ce8-819f-91b7077f55d1 Sep 23 00:15:02 devstack sudo[92408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:02 devstack sudo[92408]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-414b661b-11cc-4d6c-a1fd-6a324c8d5900 req-0bdad902-27d6-481e-a6a5-4cac53a2465b tempest-VolumesGetTestJSON-95911215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-19b2fa48-9669-4ce8-819f-91b7077f55d1" returned: 0 in 0.464s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-414b661b-11cc-4d6c-a1fd-6a324c8d5900 req-0bdad902-27d6-481e-a6a5-4cac53a2465b tempest-VolumesGetTestJSON-95911215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-19b2fa48-9669-4ce8-819f-91b7077f55d1 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:02 devstack sudo[92413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-19b2fa48-9669-4ce8-819f-91b7077f55d1 Sep 23 00:15:02 devstack sudo[92413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:03 devstack sudo[92413]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-414b661b-11cc-4d6c-a1fd-6a324c8d5900 req-0bdad902-27d6-481e-a6a5-4cac53a2465b tempest-VolumesGetTestJSON-95911215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-19b2fa48-9669-4ce8-819f-91b7077f55d1" returned: 0 in 0.472s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:03 devstack cinder-volume[86591]: DEBUG cinder.coordination [req-414b661b-11cc-4d6c-a1fd-6a324c8d5900 req-0bdad902-27d6-481e-a6a5-4cac53a2465b tempest-VolumesGetTestJSON-95911215 None] Lock "cinder-quobyte-19b2fa48-9669-4ce8-819f-91b7077f55d1" released by "delete_volume" :: held 1.002s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:03 devstack cinder-volume[86591]: DEBUG cinder.quota [req-414b661b-11cc-4d6c-a1fd-6a324c8d5900 req-0bdad902-27d6-481e-a6a5-4cac53a2465b tempest-VolumesGetTestJSON-95911215 None] Created reservations ['82477285-9057-4a64-849a-2eab126f1e7b', '5a42d783-e018-4610-bc6c-e6f1623c1349', '2f682829-dd56-473f-b13d-3032ce6a207e', '5f956c1a-074a-4823-95df-a586a5275a56'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:15:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-414b661b-11cc-4d6c-a1fd-6a324c8d5900 req-0bdad902-27d6-481e-a6a5-4cac53a2465b tempest-VolumesGetTestJSON-95911215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-414b661b-11cc-4d6c-a1fd-6a324c8d5900 req-0bdad902-27d6-481e-a6a5-4cac53a2465b tempest-VolumesGetTestJSON-95911215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:03 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [req-414b661b-11cc-4d6c-a1fd-6a324c8d5900 req-0bdad902-27d6-481e-a6a5-4cac53a2465b tempest-VolumesGetTestJSON-95911215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:03 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [req-414b661b-11cc-4d6c-a1fd-6a324c8d5900 req-0bdad902-27d6-481e-a6a5-4cac53a2465b tempest-VolumesGetTestJSON-95911215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-414b661b-11cc-4d6c-a1fd-6a324c8d5900 req-0bdad902-27d6-481e-a6a5-4cac53a2465b tempest-VolumesGetTestJSON-95911215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-414b661b-11cc-4d6c-a1fd-6a324c8d5900 req-0bdad902-27d6-481e-a6a5-4cac53a2465b tempest-VolumesGetTestJSON-95911215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:03 devstack sudo[92416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:15:03 devstack sudo[92416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:03 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9049eb7-ad50-4020-a087-128c75484048 tempest-VolumesListTestJSON-507965263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:15:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b9049eb7-ad50-4020-a087-128c75484048 tempest-VolumesListTestJSON-507965263 None] Flow 'volume_create_manager' (a6c6fbc3-9cdb-4880-a3c4-56acb8422cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:15:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b9049eb7-ad50-4020-a087-128c75484048 tempest-VolumesListTestJSON-507965263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72ab7c64-2e25-49dc-ac41-0e82ab0b38d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:04 devstack sudo[92416]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b9049eb7-ad50-4020-a087-128c75484048 tempest-VolumesListTestJSON-507965263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72ab7c64-2e25-49dc-ac41-0e82ab0b38d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1161902833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d134ba06-ebb5-4113-8b9e-c6149178a54d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='58b8408608a14e5196e5df780b1001ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:04Z,use_quota=True,user_id='9e5e844aed0c483fb334b8fbe9c7da54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b9049eb7-ad50-4020-a087-128c75484048 tempest-VolumesListTestJSON-507965263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8d74f19-23a8-4d9b-9311-019015697074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b9049eb7-ad50-4020-a087-128c75484048 tempest-VolumesListTestJSON-507965263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8d74f19-23a8-4d9b-9311-019015697074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b9049eb7-ad50-4020-a087-128c75484048 tempest-VolumesListTestJSON-507965263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f89ad03e-365f-42df-8891-abedecb5f5b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b9049eb7-ad50-4020-a087-128c75484048 tempest-VolumesListTestJSON-507965263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f89ad03e-365f-42df-8891-abedecb5f5b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd134ba06-ebb5-4113-8b9e-c6149178a54d', 'volume_name': 'volume-d134ba06-ebb5-4113-8b9e-c6149178a54d', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b9049eb7-ad50-4020-a087-128c75484048 tempest-VolumesListTestJSON-507965263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40904f28-f957-49de-8d2c-93d9a894f11e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b9049eb7-ad50-4020-a087-128c75484048 tempest-VolumesListTestJSON-507965263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40904f28-f957-49de-8d2c-93d9a894f11e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b9049eb7-ad50-4020-a087-128c75484048 tempest-VolumesListTestJSON-507965263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87c4eb6b-8dd4-4f59-9154-6cf0760cca84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:04 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-b9049eb7-ad50-4020-a087-128c75484048 tempest-VolumesListTestJSON-507965263 None] Volume d134ba06-ebb5-4113-8b9e-c6149178a54d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d134ba06-ebb5-4113-8b9e-c6149178a54d', 'volume_size': 1} Sep 23 00:15:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b9049eb7-ad50-4020-a087-128c75484048 tempest-VolumesListTestJSON-507965263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b9049eb7-ad50-4020-a087-128c75484048 tempest-VolumesListTestJSON-507965263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:04 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b9049eb7-ad50-4020-a087-128c75484048 tempest-VolumesListTestJSON-507965263 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1161902833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d134ba06-ebb5-4113-8b9e-c6149178a54d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='58b8408608a14e5196e5df780b1001ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:04Z,use_quota=True,user_id='9e5e844aed0c483fb334b8fbe9c7da54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:15:04 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-b9049eb7-ad50-4020-a087-128c75484048 tempest-VolumesListTestJSON-507965263 None] Creating volume d134ba06-ebb5-4113-8b9e-c6149178a54d {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:15:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b9049eb7-ad50-4020-a087-128c75484048 tempest-VolumesListTestJSON-507965263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b9049eb7-ad50-4020-a087-128c75484048 tempest-VolumesListTestJSON-507965263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:04 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b9049eb7-ad50-4020-a087-128c75484048 tempest-VolumesListTestJSON-507965263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:04 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b9049eb7-ad50-4020-a087-128c75484048 tempest-VolumesListTestJSON-507965263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b9049eb7-ad50-4020-a087-128c75484048 tempest-VolumesListTestJSON-507965263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:04 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b9049eb7-ad50-4020-a087-128c75484048 tempest-VolumesListTestJSON-507965263 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:15:04 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-b9049eb7-ad50-4020-a087-128c75484048 tempest-VolumesListTestJSON-507965263 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:15:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b9049eb7-ad50-4020-a087-128c75484048 tempest-VolumesListTestJSON-507965263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d134ba06-ebb5-4113-8b9e-c6149178a54d 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-414b661b-11cc-4d6c-a1fd-6a324c8d5900 req-0bdad902-27d6-481e-a6a5-4cac53a2465b tempest-VolumesGetTestJSON-95911215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.472s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:04 devstack cinder-volume[86591]: DEBUG cinder.manager [req-414b661b-11cc-4d6c-a1fd-6a324c8d5900 req-0bdad902-27d6-481e-a6a5-4cac53a2465b tempest-VolumesGetTestJSON-95911215 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:15:04 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-414b661b-11cc-4d6c-a1fd-6a324c8d5900 req-0bdad902-27d6-481e-a6a5-4cac53a2465b tempest-VolumesGetTestJSON-95911215 None] Deleted volume successfully. Sep 23 00:15:04 devstack sudo[92419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d134ba06-ebb5-4113-8b9e-c6149178a54d 1073741824 Sep 23 00:15:04 devstack sudo[92419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:04 devstack cinder-volume[86591]: DEBUG cinder.coordination [req-414b661b-11cc-4d6c-a1fd-6a324c8d5900 req-0bdad902-27d6-481e-a6a5-4cac53a2465b tempest-VolumesGetTestJSON-95911215 None] Lock "cinder-19b2fa48-9669-4ce8-819f-91b7077f55d1-delete_volume" released by "delete_volume" :: held 1.983s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:04 devstack sudo[92419]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b9049eb7-ad50-4020-a087-128c75484048 tempest-VolumesListTestJSON-507965263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d134ba06-ebb5-4113-8b9e-c6149178a54d 1073741824" returned: 0 in 0.573s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b9049eb7-ad50-4020-a087-128c75484048 tempest-VolumesListTestJSON-507965263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d134ba06-ebb5-4113-8b9e-c6149178a54d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:04 devstack sudo[92425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d134ba06-ebb5-4113-8b9e-c6149178a54d Sep 23 00:15:04 devstack sudo[92425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:05 devstack sudo[92425]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b9049eb7-ad50-4020-a087-128c75484048 tempest-VolumesListTestJSON-507965263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d134ba06-ebb5-4113-8b9e-c6149178a54d" returned: 0 in 0.364s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:05 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b9049eb7-ad50-4020-a087-128c75484048 tempest-VolumesListTestJSON-507965263 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:15:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b9049eb7-ad50-4020-a087-128c75484048 tempest-VolumesListTestJSON-507965263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b9049eb7-ad50-4020-a087-128c75484048 tempest-VolumesListTestJSON-507965263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87c4eb6b-8dd4-4f59-9154-6cf0760cca84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d134ba06-ebb5-4113-8b9e-c6149178a54d', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b9049eb7-ad50-4020-a087-128c75484048 tempest-VolumesListTestJSON-507965263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f80b3c93-8dd8-4b47-a7fc-3f4aba2cb502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:05 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-b9049eb7-ad50-4020-a087-128c75484048 tempest-VolumesListTestJSON-507965263 None] Volume volume-d134ba06-ebb5-4113-8b9e-c6149178a54d (d134ba06-ebb5-4113-8b9e-c6149178a54d): created successfully Sep 23 00:15:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b9049eb7-ad50-4020-a087-128c75484048 tempest-VolumesListTestJSON-507965263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f80b3c93-8dd8-4b47-a7fc-3f4aba2cb502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b9049eb7-ad50-4020-a087-128c75484048 tempest-VolumesListTestJSON-507965263 None] Flow 'volume_create_manager' (a6c6fbc3-9cdb-4880-a3c4-56acb8422cc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:15:05 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-b9049eb7-ad50-4020-a087-128c75484048 tempest-VolumesListTestJSON-507965263 None] Created volume successfully. Sep 23 00:15:06 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-c78dca5a-24a8-4444-b31f-38b79e4450c6 tempest-VolumesListTestJSON-507965263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:15:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c78dca5a-24a8-4444-b31f-38b79e4450c6 tempest-VolumesListTestJSON-507965263 None] Flow 'volume_create_manager' (d0964d8a-5375-4fc7-ab96-510a4ae7825b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:15:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c78dca5a-24a8-4444-b31f-38b79e4450c6 tempest-VolumesListTestJSON-507965263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb9d4f8e-bbf6-48c9-af0e-08b797de2013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c78dca5a-24a8-4444-b31f-38b79e4450c6 tempest-VolumesListTestJSON-507965263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb9d4f8e-bbf6-48c9-af0e-08b797de2013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:15:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1317484945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fd896fd-98ca-4cae-b863-8afc1fea2ee5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='58b8408608a14e5196e5df780b1001ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:07Z,use_quota=True,user_id='9e5e844aed0c483fb334b8fbe9c7da54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c78dca5a-24a8-4444-b31f-38b79e4450c6 tempest-VolumesListTestJSON-507965263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (508a4585-4017-498a-810a-f90fced37e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c78dca5a-24a8-4444-b31f-38b79e4450c6 tempest-VolumesListTestJSON-507965263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (508a4585-4017-498a-810a-f90fced37e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c78dca5a-24a8-4444-b31f-38b79e4450c6 tempest-VolumesListTestJSON-507965263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbe873cb-86dc-4e3a-8a76-bf27b4431d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c78dca5a-24a8-4444-b31f-38b79e4450c6 tempest-VolumesListTestJSON-507965263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbe873cb-86dc-4e3a-8a76-bf27b4431d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fd896fd-98ca-4cae-b863-8afc1fea2ee5', 'volume_name': 'volume-1fd896fd-98ca-4cae-b863-8afc1fea2ee5', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c78dca5a-24a8-4444-b31f-38b79e4450c6 tempest-VolumesListTestJSON-507965263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d8dd225-0068-4716-94aa-e2421da124ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c78dca5a-24a8-4444-b31f-38b79e4450c6 tempest-VolumesListTestJSON-507965263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d8dd225-0068-4716-94aa-e2421da124ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c78dca5a-24a8-4444-b31f-38b79e4450c6 tempest-VolumesListTestJSON-507965263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6406b322-3c0d-49ea-9288-efd08e952863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:06 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-c78dca5a-24a8-4444-b31f-38b79e4450c6 tempest-VolumesListTestJSON-507965263 None] Volume 1fd896fd-98ca-4cae-b863-8afc1fea2ee5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fd896fd-98ca-4cae-b863-8afc1fea2ee5', 'volume_size': 1} Sep 23 00:15:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c78dca5a-24a8-4444-b31f-38b79e4450c6 tempest-VolumesListTestJSON-507965263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c78dca5a-24a8-4444-b31f-38b79e4450c6 tempest-VolumesListTestJSON-507965263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c78dca5a-24a8-4444-b31f-38b79e4450c6 tempest-VolumesListTestJSON-507965263 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:15:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1317484945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fd896fd-98ca-4cae-b863-8afc1fea2ee5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='58b8408608a14e5196e5df780b1001ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:07Z,use_quota=True,user_id='9e5e844aed0c483fb334b8fbe9c7da54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:15:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-c78dca5a-24a8-4444-b31f-38b79e4450c6 tempest-VolumesListTestJSON-507965263 None] Creating volume 1fd896fd-98ca-4cae-b863-8afc1fea2ee5 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:15:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c78dca5a-24a8-4444-b31f-38b79e4450c6 tempest-VolumesListTestJSON-507965263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c78dca5a-24a8-4444-b31f-38b79e4450c6 tempest-VolumesListTestJSON-507965263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c78dca5a-24a8-4444-b31f-38b79e4450c6 tempest-VolumesListTestJSON-507965263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c78dca5a-24a8-4444-b31f-38b79e4450c6 tempest-VolumesListTestJSON-507965263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c78dca5a-24a8-4444-b31f-38b79e4450c6 tempest-VolumesListTestJSON-507965263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c78dca5a-24a8-4444-b31f-38b79e4450c6 tempest-VolumesListTestJSON-507965263 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:15:06 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-c78dca5a-24a8-4444-b31f-38b79e4450c6 tempest-VolumesListTestJSON-507965263 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:15:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c78dca5a-24a8-4444-b31f-38b79e4450c6 tempest-VolumesListTestJSON-507965263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1fd896fd-98ca-4cae-b863-8afc1fea2ee5 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:07 devstack sudo[92434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1fd896fd-98ca-4cae-b863-8afc1fea2ee5 1073741824 Sep 23 00:15:07 devstack sudo[92434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:07 devstack sudo[92434]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c78dca5a-24a8-4444-b31f-38b79e4450c6 tempest-VolumesListTestJSON-507965263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1fd896fd-98ca-4cae-b863-8afc1fea2ee5 1073741824" returned: 0 in 0.655s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c78dca5a-24a8-4444-b31f-38b79e4450c6 tempest-VolumesListTestJSON-507965263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1fd896fd-98ca-4cae-b863-8afc1fea2ee5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:07 devstack sudo[92440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1fd896fd-98ca-4cae-b863-8afc1fea2ee5 Sep 23 00:15:07 devstack sudo[92440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:07 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-a65a54d0-81c3-44ab-9231-4c585a23b366 tempest-ServerActionsTestOtherA-1121932693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:15:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a65a54d0-81c3-44ab-9231-4c585a23b366 tempest-ServerActionsTestOtherA-1121932693 None] Flow 'volume_create_manager' (866cf0ba-bda4-4358-b597-984ec10a010d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:15:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a65a54d0-81c3-44ab-9231-4c585a23b366 tempest-ServerActionsTestOtherA-1121932693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e982d2ef-7207-43ed-80dc-dce25e711feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:08 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a65a54d0-81c3-44ab-9231-4c585a23b366 tempest-ServerActionsTestOtherA-1121932693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e982d2ef-7207-43ed-80dc-dce25e711feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:15:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1020783736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1815be18-5aab-4633-8ca2-69aaaa6fb514,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c5fef9d68b149cabc95a584d36f2b4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:08Z,use_quota=True,user_id='0348bfc609ed457880d6167a905ecabf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:08 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a65a54d0-81c3-44ab-9231-4c585a23b366 tempest-ServerActionsTestOtherA-1121932693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (521ab9be-1111-451e-aef8-4baade9b2717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:08 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a65a54d0-81c3-44ab-9231-4c585a23b366 tempest-ServerActionsTestOtherA-1121932693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (521ab9be-1111-451e-aef8-4baade9b2717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:08 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a65a54d0-81c3-44ab-9231-4c585a23b366 tempest-ServerActionsTestOtherA-1121932693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5e98673-1779-4e70-a255-297fe4b65400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:08 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a65a54d0-81c3-44ab-9231-4c585a23b366 tempest-ServerActionsTestOtherA-1121932693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5e98673-1779-4e70-a255-297fe4b65400) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1815be18-5aab-4633-8ca2-69aaaa6fb514', 'volume_name': 'volume-1815be18-5aab-4633-8ca2-69aaaa6fb514', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:08 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a65a54d0-81c3-44ab-9231-4c585a23b366 tempest-ServerActionsTestOtherA-1121932693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2d6afca-f246-405e-b377-b124af654ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:08 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a65a54d0-81c3-44ab-9231-4c585a23b366 tempest-ServerActionsTestOtherA-1121932693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2d6afca-f246-405e-b377-b124af654ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:08 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a65a54d0-81c3-44ab-9231-4c585a23b366 tempest-ServerActionsTestOtherA-1121932693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f18cfb8b-8613-42ea-8f35-a54d2a755170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:08 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-a65a54d0-81c3-44ab-9231-4c585a23b366 tempest-ServerActionsTestOtherA-1121932693 None] Volume 1815be18-5aab-4633-8ca2-69aaaa6fb514: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1815be18-5aab-4633-8ca2-69aaaa6fb514', 'volume_size': 1} Sep 23 00:15:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a65a54d0-81c3-44ab-9231-4c585a23b366 tempest-ServerActionsTestOtherA-1121932693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:08 devstack sudo[92440]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c78dca5a-24a8-4444-b31f-38b79e4450c6 tempest-VolumesListTestJSON-507965263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1fd896fd-98ca-4cae-b863-8afc1fea2ee5" returned: 0 in 0.413s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:08 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c78dca5a-24a8-4444-b31f-38b79e4450c6 tempest-VolumesListTestJSON-507965263 None] <== create_volume: return (1164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:15:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c78dca5a-24a8-4444-b31f-38b79e4450c6 tempest-VolumesListTestJSON-507965263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.167s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a65a54d0-81c3-44ab-9231-4c585a23b366 tempest-ServerActionsTestOtherA-1121932693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.043s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:08 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a65a54d0-81c3-44ab-9231-4c585a23b366 tempest-ServerActionsTestOtherA-1121932693 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:15:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1020783736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1815be18-5aab-4633-8ca2-69aaaa6fb514,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c5fef9d68b149cabc95a584d36f2b4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:08Z,use_quota=True,user_id='0348bfc609ed457880d6167a905ecabf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:15:08 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-a65a54d0-81c3-44ab-9231-4c585a23b366 tempest-ServerActionsTestOtherA-1121932693 None] Creating volume 1815be18-5aab-4633-8ca2-69aaaa6fb514 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:15:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a65a54d0-81c3-44ab-9231-4c585a23b366 tempest-ServerActionsTestOtherA-1121932693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a65a54d0-81c3-44ab-9231-4c585a23b366 tempest-ServerActionsTestOtherA-1121932693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:08 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a65a54d0-81c3-44ab-9231-4c585a23b366 tempest-ServerActionsTestOtherA-1121932693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:08 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a65a54d0-81c3-44ab-9231-4c585a23b366 tempest-ServerActionsTestOtherA-1121932693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a65a54d0-81c3-44ab-9231-4c585a23b366 tempest-ServerActionsTestOtherA-1121932693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:08 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a65a54d0-81c3-44ab-9231-4c585a23b366 tempest-ServerActionsTestOtherA-1121932693 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:15:08 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-a65a54d0-81c3-44ab-9231-4c585a23b366 tempest-ServerActionsTestOtherA-1121932693 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:15:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a65a54d0-81c3-44ab-9231-4c585a23b366 tempest-ServerActionsTestOtherA-1121932693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1815be18-5aab-4633-8ca2-69aaaa6fb514 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:08 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c78dca5a-24a8-4444-b31f-38b79e4450c6 tempest-VolumesListTestJSON-507965263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6406b322-3c0d-49ea-9288-efd08e952863) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fd896fd-98ca-4cae-b863-8afc1fea2ee5', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:08 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c78dca5a-24a8-4444-b31f-38b79e4450c6 tempest-VolumesListTestJSON-507965263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6c7817a-9cfd-4029-bac7-226b280f4097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:08 devstack sudo[92443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1815be18-5aab-4633-8ca2-69aaaa6fb514 1073741824 Sep 23 00:15:08 devstack sudo[92443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:08 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-c78dca5a-24a8-4444-b31f-38b79e4450c6 tempest-VolumesListTestJSON-507965263 None] Volume volume-1fd896fd-98ca-4cae-b863-8afc1fea2ee5 (1fd896fd-98ca-4cae-b863-8afc1fea2ee5): created successfully Sep 23 00:15:08 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c78dca5a-24a8-4444-b31f-38b79e4450c6 tempest-VolumesListTestJSON-507965263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6c7817a-9cfd-4029-bac7-226b280f4097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:08 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c78dca5a-24a8-4444-b31f-38b79e4450c6 tempest-VolumesListTestJSON-507965263 None] Flow 'volume_create_manager' (d0964d8a-5375-4fc7-ab96-510a4ae7825b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:15:08 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-c78dca5a-24a8-4444-b31f-38b79e4450c6 tempest-VolumesListTestJSON-507965263 None] Created volume successfully. Sep 23 00:15:08 devstack sudo[92443]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a65a54d0-81c3-44ab-9231-4c585a23b366 tempest-ServerActionsTestOtherA-1121932693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1815be18-5aab-4633-8ca2-69aaaa6fb514 1073741824" returned: 0 in 0.666s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a65a54d0-81c3-44ab-9231-4c585a23b366 tempest-ServerActionsTestOtherA-1121932693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1815be18-5aab-4633-8ca2-69aaaa6fb514 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:08 devstack sudo[92449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1815be18-5aab-4633-8ca2-69aaaa6fb514 Sep 23 00:15:08 devstack sudo[92449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:09 devstack sudo[92449]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a65a54d0-81c3-44ab-9231-4c585a23b366 tempest-ServerActionsTestOtherA-1121932693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1815be18-5aab-4633-8ca2-69aaaa6fb514" returned: 0 in 0.510s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:09 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a65a54d0-81c3-44ab-9231-4c585a23b366 tempest-ServerActionsTestOtherA-1121932693 None] <== create_volume: return (1265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:15:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a65a54d0-81c3-44ab-9231-4c585a23b366 tempest-ServerActionsTestOtherA-1121932693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.271s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a65a54d0-81c3-44ab-9231-4c585a23b366 tempest-ServerActionsTestOtherA-1121932693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f18cfb8b-8613-42ea-8f35-a54d2a755170) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1815be18-5aab-4633-8ca2-69aaaa6fb514', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a65a54d0-81c3-44ab-9231-4c585a23b366 tempest-ServerActionsTestOtherA-1121932693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ea7b2cb-62a5-47af-b6af-6271972cb98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:09 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-a65a54d0-81c3-44ab-9231-4c585a23b366 tempest-ServerActionsTestOtherA-1121932693 None] Volume volume-1815be18-5aab-4633-8ca2-69aaaa6fb514 (1815be18-5aab-4633-8ca2-69aaaa6fb514): created successfully Sep 23 00:15:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a65a54d0-81c3-44ab-9231-4c585a23b366 tempest-ServerActionsTestOtherA-1121932693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ea7b2cb-62a5-47af-b6af-6271972cb98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a65a54d0-81c3-44ab-9231-4c585a23b366 tempest-ServerActionsTestOtherA-1121932693 None] Flow 'volume_create_manager' (866cf0ba-bda4-4358-b597-984ec10a010d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:15:09 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-a65a54d0-81c3-44ab-9231-4c585a23b366 tempest-ServerActionsTestOtherA-1121932693 None] Created volume successfully. Sep 23 00:15:12 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-63bdc354-bff5-4a30-9741-618cb9f18d46 tempest-VolumesListTestJSON-507965263 None] Acquiring lock "cinder-1fd896fd-98ca-4cae-b863-8afc1fea2ee5-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:12 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-63bdc354-bff5-4a30-9741-618cb9f18d46 tempest-VolumesListTestJSON-507965263 None] Lock "cinder-1fd896fd-98ca-4cae-b863-8afc1fea2ee5-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:12 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-63bdc354-bff5-4a30-9741-618cb9f18d46 tempest-VolumesListTestJSON-507965263 None] Acquiring lock "cinder-quobyte-1fd896fd-98ca-4cae-b863-8afc1fea2ee5" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:12 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-63bdc354-bff5-4a30-9741-618cb9f18d46 tempest-VolumesListTestJSON-507965263 None] Lock "cinder-quobyte-1fd896fd-98ca-4cae-b863-8afc1fea2ee5" acquired by "delete_volume" :: waited 0.018s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:12 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5d46dc-0684-48d8-9a71-a8a577d65106]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-63bdc354-bff5-4a30-9741-618cb9f18d46 tempest-VolumesListTestJSON-507965263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1fd896fd-98ca-4cae-b863-8afc1fea2ee5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:12 devstack sudo[92462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1fd896fd-98ca-4cae-b863-8afc1fea2ee5 Sep 23 00:15:12 devstack sudo[92462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:13 devstack sudo[92462]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-63bdc354-bff5-4a30-9741-618cb9f18d46 tempest-VolumesListTestJSON-507965263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1fd896fd-98ca-4cae-b863-8afc1fea2ee5" returned: 0 in 0.529s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-63bdc354-bff5-4a30-9741-618cb9f18d46 tempest-VolumesListTestJSON-507965263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1fd896fd-98ca-4cae-b863-8afc1fea2ee5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:13 devstack sudo[92467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1fd896fd-98ca-4cae-b863-8afc1fea2ee5 Sep 23 00:15:13 devstack sudo[92467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:13 devstack sudo[92467]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-63bdc354-bff5-4a30-9741-618cb9f18d46 tempest-VolumesListTestJSON-507965263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1fd896fd-98ca-4cae-b863-8afc1fea2ee5" returned: 0 in 0.459s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:13 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-63bdc354-bff5-4a30-9741-618cb9f18d46 tempest-VolumesListTestJSON-507965263 None] Lock "cinder-quobyte-1fd896fd-98ca-4cae-b863-8afc1fea2ee5" released by "delete_volume" :: held 1.062s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:13 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-63bdc354-bff5-4a30-9741-618cb9f18d46 tempest-VolumesListTestJSON-507965263 None] Created reservations ['fb11a4b2-3de6-4d37-b8e7-49633859abe4', 'b0eff407-8c8d-492a-8d65-12a857552d11', '432b94f5-c4b6-40bf-925a-e1a379119622', 'f23b6026-cc79-4ac2-a4d0-c59fb8b14914'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:15:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-63bdc354-bff5-4a30-9741-618cb9f18d46 tempest-VolumesListTestJSON-507965263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-63bdc354-bff5-4a30-9741-618cb9f18d46 tempest-VolumesListTestJSON-507965263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:13 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-63bdc354-bff5-4a30-9741-618cb9f18d46 tempest-VolumesListTestJSON-507965263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:13 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-63bdc354-bff5-4a30-9741-618cb9f18d46 tempest-VolumesListTestJSON-507965263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-63bdc354-bff5-4a30-9741-618cb9f18d46 tempest-VolumesListTestJSON-507965263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-63bdc354-bff5-4a30-9741-618cb9f18d46 tempest-VolumesListTestJSON-507965263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:13 devstack sudo[92471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:15:13 devstack sudo[92471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:14 devstack sudo[92471]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-63bdc354-bff5-4a30-9741-618cb9f18d46 tempest-VolumesListTestJSON-507965263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.327s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:14 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-63bdc354-bff5-4a30-9741-618cb9f18d46 tempest-VolumesListTestJSON-507965263 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:15:14 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-63bdc354-bff5-4a30-9741-618cb9f18d46 tempest-VolumesListTestJSON-507965263 None] Deleted volume successfully. Sep 23 00:15:14 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-63bdc354-bff5-4a30-9741-618cb9f18d46 tempest-VolumesListTestJSON-507965263 None] Lock "cinder-1fd896fd-98ca-4cae-b863-8afc1fea2ee5-delete_volume" released by "delete_volume" :: held 1.799s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9cf7493a-8a09-4317-9719-cc33e8db26b6 tempest-VolumesListTestJSON-507965263 None] Acquiring lock "cinder-d134ba06-ebb5-4113-8b9e-c6149178a54d-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9cf7493a-8a09-4317-9719-cc33e8db26b6 tempest-VolumesListTestJSON-507965263 None] Lock "cinder-d134ba06-ebb5-4113-8b9e-c6149178a54d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9cf7493a-8a09-4317-9719-cc33e8db26b6 tempest-VolumesListTestJSON-507965263 None] Acquiring lock "cinder-quobyte-d134ba06-ebb5-4113-8b9e-c6149178a54d" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9cf7493a-8a09-4317-9719-cc33e8db26b6 tempest-VolumesListTestJSON-507965263 None] Lock "cinder-quobyte-d134ba06-ebb5-4113-8b9e-c6149178a54d" acquired by "delete_volume" :: waited 0.023s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:15 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b4e13f-aba5-47e6-a4f0-d9d2edf4a5d0]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9cf7493a-8a09-4317-9719-cc33e8db26b6 tempest-VolumesListTestJSON-507965263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d134ba06-ebb5-4113-8b9e-c6149178a54d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:15 devstack sudo[92484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d134ba06-ebb5-4113-8b9e-c6149178a54d Sep 23 00:15:15 devstack sudo[92484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:16 devstack sudo[92484]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9cf7493a-8a09-4317-9719-cc33e8db26b6 tempest-VolumesListTestJSON-507965263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d134ba06-ebb5-4113-8b9e-c6149178a54d" returned: 0 in 0.773s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9cf7493a-8a09-4317-9719-cc33e8db26b6 tempest-VolumesListTestJSON-507965263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d134ba06-ebb5-4113-8b9e-c6149178a54d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:16 devstack sudo[92496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d134ba06-ebb5-4113-8b9e-c6149178a54d Sep 23 00:15:16 devstack sudo[92496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:16 devstack sudo[92496]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9cf7493a-8a09-4317-9719-cc33e8db26b6 tempest-VolumesListTestJSON-507965263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d134ba06-ebb5-4113-8b9e-c6149178a54d" returned: 0 in 0.500s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:16 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9cf7493a-8a09-4317-9719-cc33e8db26b6 tempest-VolumesListTestJSON-507965263 None] Lock "cinder-quobyte-d134ba06-ebb5-4113-8b9e-c6149178a54d" released by "delete_volume" :: held 1.360s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:16 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-9cf7493a-8a09-4317-9719-cc33e8db26b6 tempest-VolumesListTestJSON-507965263 None] Created reservations ['c16618cd-dfab-483b-8e82-169a7ee63173', '9e68979e-1347-4150-9da9-b3e9b04a78c2', '65d5e0ea-ec2b-49d8-a696-f4135acdaaab', '9d63ba46-7ebc-4643-84c0-de001df4cd0e'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:15:16 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=86,cinder:UPDATE=107,cinder:DELETE=12,cinder:INSERT=38 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:15:16 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:15:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:16 devstack sudo[92500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:15:16 devstack sudo[92500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9cf7493a-8a09-4317-9719-cc33e8db26b6 tempest-VolumesListTestJSON-507965263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9cf7493a-8a09-4317-9719-cc33e8db26b6 tempest-VolumesListTestJSON-507965263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9cf7493a-8a09-4317-9719-cc33e8db26b6 tempest-VolumesListTestJSON-507965263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9cf7493a-8a09-4317-9719-cc33e8db26b6 tempest-VolumesListTestJSON-507965263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9cf7493a-8a09-4317-9719-cc33e8db26b6 tempest-VolumesListTestJSON-507965263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9cf7493a-8a09-4317-9719-cc33e8db26b6 tempest-VolumesListTestJSON-507965263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:16 devstack sudo[92502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:15:16 devstack sudo[92502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:17 devstack sudo[92500]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.400s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:17 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:15:17 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running periodic task VolumeManager._thread_info {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:15:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] thread count: 29 {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:15:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] thread info: [<_MainThread(MainThread, started 135440660459648)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:15:17 devstack sudo[92502]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9cf7493a-8a09-4317-9719-cc33e8db26b6 tempest-VolumesListTestJSON-507965263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.387s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:17 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-9cf7493a-8a09-4317-9719-cc33e8db26b6 tempest-VolumesListTestJSON-507965263 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:15:17 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-9cf7493a-8a09-4317-9719-cc33e8db26b6 tempest-VolumesListTestJSON-507965263 None] Deleted volume successfully. Sep 23 00:15:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9cf7493a-8a09-4317-9719-cc33e8db26b6 tempest-VolumesListTestJSON-507965263 None] Lock "cinder-d134ba06-ebb5-4113-8b9e-c6149178a54d-delete_volume" released by "delete_volume" :: held 2.117s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-7e656afc-b630-414c-b7bb-86dff752a53f tempest-VolumesListTestJSON-507965263 None] Acquiring lock "cinder-9498d4cd-aa20-41b5-86e1-f8ff0cca317f-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:17 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-aad9a57a-6a1e-44c0-83aa-a0208d4e297a tempest-GroupsTest-1290518108 None] Group tempest-Group1-1411838551: creating Sep 23 00:15:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-7e656afc-b630-414c-b7bb-86dff752a53f tempest-VolumesListTestJSON-507965263 None] Lock "cinder-9498d4cd-aa20-41b5-86e1-f8ff0cca317f-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:17 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-aad9a57a-6a1e-44c0-83aa-a0208d4e297a tempest-GroupsTest-1290518108 None] Group tempest-Group1-1411838551: created successfully Sep 23 00:15:17 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-aad9a57a-6a1e-44c0-83aa-a0208d4e297a tempest-GroupsTest-1290518108 None] Create group completed successfully. Sep 23 00:15:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-7e656afc-b630-414c-b7bb-86dff752a53f tempest-VolumesListTestJSON-507965263 None] Acquiring lock "cinder-quobyte-9498d4cd-aa20-41b5-86e1-f8ff0cca317f" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-7e656afc-b630-414c-b7bb-86dff752a53f tempest-VolumesListTestJSON-507965263 None] Lock "cinder-quobyte-9498d4cd-aa20-41b5-86e1-f8ff0cca317f" acquired by "delete_volume" :: waited 0.018s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:17 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c51c8ac-5b9f-4bb5-a415-0f351f68f2c6]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7e656afc-b630-414c-b7bb-86dff752a53f tempest-VolumesListTestJSON-507965263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9498d4cd-aa20-41b5-86e1-f8ff0cca317f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:17 devstack sudo[92506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9498d4cd-aa20-41b5-86e1-f8ff0cca317f Sep 23 00:15:17 devstack sudo[92506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:18 devstack sudo[92506]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7e656afc-b630-414c-b7bb-86dff752a53f tempest-VolumesListTestJSON-507965263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9498d4cd-aa20-41b5-86e1-f8ff0cca317f" returned: 0 in 0.431s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7e656afc-b630-414c-b7bb-86dff752a53f tempest-VolumesListTestJSON-507965263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9498d4cd-aa20-41b5-86e1-f8ff0cca317f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:18 devstack sudo[92512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9498d4cd-aa20-41b5-86e1-f8ff0cca317f Sep 23 00:15:18 devstack sudo[92512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:18 devstack sudo[92512]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7e656afc-b630-414c-b7bb-86dff752a53f tempest-VolumesListTestJSON-507965263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9498d4cd-aa20-41b5-86e1-f8ff0cca317f" returned: 0 in 0.265s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-7e656afc-b630-414c-b7bb-86dff752a53f tempest-VolumesListTestJSON-507965263 None] Lock "cinder-quobyte-9498d4cd-aa20-41b5-86e1-f8ff0cca317f" released by "delete_volume" :: held 0.751s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:18 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:UPDATE=128,cinder:SELECT=94,cinder:INSERT=28,cinder:DELETE=7 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:15:18 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-7e656afc-b630-414c-b7bb-86dff752a53f tempest-VolumesListTestJSON-507965263 None] Created reservations ['8db2fede-e482-4079-a2d1-930bdf8abab2', '01232e6f-2d1f-4913-8a68-39cd4921dae8', '7e3acbdd-31f8-4f47-b9e9-35b322e09665', 'd47032c4-9da9-42b6-b229-c1d3a9610de4'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:15:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7e656afc-b630-414c-b7bb-86dff752a53f tempest-VolumesListTestJSON-507965263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7e656afc-b630-414c-b7bb-86dff752a53f tempest-VolumesListTestJSON-507965263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:18 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7e656afc-b630-414c-b7bb-86dff752a53f tempest-VolumesListTestJSON-507965263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:18 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7e656afc-b630-414c-b7bb-86dff752a53f tempest-VolumesListTestJSON-507965263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7e656afc-b630-414c-b7bb-86dff752a53f tempest-VolumesListTestJSON-507965263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7e656afc-b630-414c-b7bb-86dff752a53f tempest-VolumesListTestJSON-507965263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:18 devstack sudo[92515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:15:18 devstack sudo[92515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:19 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-622be52b-1fcf-467d-a653-5ec2e8122579 tempest-GroupsTest-1290518108 None] Group tempest-Group2-703439890: creating Sep 23 00:15:19 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-622be52b-1fcf-467d-a653-5ec2e8122579 tempest-GroupsTest-1290518108 None] Group tempest-Group2-703439890: created successfully Sep 23 00:15:19 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-622be52b-1fcf-467d-a653-5ec2e8122579 tempest-GroupsTest-1290518108 None] Create group completed successfully. Sep 23 00:15:19 devstack sudo[92515]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7e656afc-b630-414c-b7bb-86dff752a53f tempest-VolumesListTestJSON-507965263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.709s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:19 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-7e656afc-b630-414c-b7bb-86dff752a53f tempest-VolumesListTestJSON-507965263 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:15:19 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-7e656afc-b630-414c-b7bb-86dff752a53f tempest-VolumesListTestJSON-507965263 None] Deleted volume successfully. Sep 23 00:15:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-7e656afc-b630-414c-b7bb-86dff752a53f tempest-VolumesListTestJSON-507965263 None] Lock "cinder-9498d4cd-aa20-41b5-86e1-f8ff0cca317f-delete_volume" released by "delete_volume" :: held 1.811s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:21 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-392d2a60-fc51-4945-ba85-38566641d8ce tempest-GroupsTest-1290518108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:15:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-392d2a60-fc51-4945-ba85-38566641d8ce tempest-GroupsTest-1290518108 None] Flow 'volume_create_manager' (b185205b-4795-4ade-9c49-fb7e1cb38407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:15:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-392d2a60-fc51-4945-ba85-38566641d8ce tempest-GroupsTest-1290518108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6476c814-8943-478f-84ef-d18e88da683e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-392d2a60-fc51-4945-ba85-38566641d8ce tempest-GroupsTest-1290518108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6476c814-8943-478f-84ef-d18e88da683e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:15:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-741906947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5ef46de0-7427-495e-9f40-429c16afb89e,host='devstack@QuobyteHD#QuobyteHD',id=fd41569c-560a-40d0-9458-6db08b6e4a8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0219498b10164562a862ad51e7bb1725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:21Z,use_quota=True,user_id='75f83680df71444eb9141c920815e0c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1bd56b1-7c98-42b1-9ebe-48c4f9456cf4),volume_type_id=b1bd56b1-7c98-42b1-9ebe-48c4f9456cf4)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-392d2a60-fc51-4945-ba85-38566641d8ce tempest-GroupsTest-1290518108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bc0bef3-3535-4ccb-8c9b-6a61362b6650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-392d2a60-fc51-4945-ba85-38566641d8ce tempest-GroupsTest-1290518108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bc0bef3-3535-4ccb-8c9b-6a61362b6650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-392d2a60-fc51-4945-ba85-38566641d8ce tempest-GroupsTest-1290518108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07139cd5-ff8d-4e6f-b243-154298e43159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-392d2a60-fc51-4945-ba85-38566641d8ce tempest-GroupsTest-1290518108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07139cd5-ff8d-4e6f-b243-154298e43159) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd41569c-560a-40d0-9458-6db08b6e4a8f', 'volume_name': 'volume-fd41569c-560a-40d0-9458-6db08b6e4a8f', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-392d2a60-fc51-4945-ba85-38566641d8ce tempest-GroupsTest-1290518108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab5782eb-7a1b-4c64-9292-21298cbe958e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-392d2a60-fc51-4945-ba85-38566641d8ce tempest-GroupsTest-1290518108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab5782eb-7a1b-4c64-9292-21298cbe958e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-392d2a60-fc51-4945-ba85-38566641d8ce tempest-GroupsTest-1290518108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a298edf9-aa72-43e0-95d8-f269e31c0247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:21 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-392d2a60-fc51-4945-ba85-38566641d8ce tempest-GroupsTest-1290518108 None] Volume fd41569c-560a-40d0-9458-6db08b6e4a8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd41569c-560a-40d0-9458-6db08b6e4a8f', 'volume_size': 1} Sep 23 00:15:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-392d2a60-fc51-4945-ba85-38566641d8ce tempest-GroupsTest-1290518108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-392d2a60-fc51-4945-ba85-38566641d8ce tempest-GroupsTest-1290518108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:21 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-392d2a60-fc51-4945-ba85-38566641d8ce tempest-GroupsTest-1290518108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5ef46de0-7427-495e-9f40-429c16afb89e,created_at=2026-09-22T22:15:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-741906947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5ef46de0-7427-495e-9f40-429c16afb89e,host='devstack@QuobyteHD#QuobyteHD',id=fd41569c-560a-40d0-9458-6db08b6e4a8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0219498b10164562a862ad51e7bb1725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:21Z,use_quota=True,user_id='75f83680df71444eb9141c920815e0c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1bd56b1-7c98-42b1-9ebe-48c4f9456cf4),volume_type_id=b1bd56b1-7c98-42b1-9ebe-48c4f9456cf4)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:15:21 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-392d2a60-fc51-4945-ba85-38566641d8ce tempest-GroupsTest-1290518108 None] Creating volume fd41569c-560a-40d0-9458-6db08b6e4a8f {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:15:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-392d2a60-fc51-4945-ba85-38566641d8ce tempest-GroupsTest-1290518108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-392d2a60-fc51-4945-ba85-38566641d8ce tempest-GroupsTest-1290518108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:21 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-392d2a60-fc51-4945-ba85-38566641d8ce tempest-GroupsTest-1290518108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:21 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-392d2a60-fc51-4945-ba85-38566641d8ce tempest-GroupsTest-1290518108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-392d2a60-fc51-4945-ba85-38566641d8ce tempest-GroupsTest-1290518108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:21 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-392d2a60-fc51-4945-ba85-38566641d8ce tempest-GroupsTest-1290518108 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:15:21 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-392d2a60-fc51-4945-ba85-38566641d8ce tempest-GroupsTest-1290518108 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:15:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-392d2a60-fc51-4945-ba85-38566641d8ce tempest-GroupsTest-1290518108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-fd41569c-560a-40d0-9458-6db08b6e4a8f 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:21 devstack sudo[92560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-fd41569c-560a-40d0-9458-6db08b6e4a8f 1073741824 Sep 23 00:15:21 devstack sudo[92560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:22 devstack sudo[92560]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-392d2a60-fc51-4945-ba85-38566641d8ce tempest-GroupsTest-1290518108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-fd41569c-560a-40d0-9458-6db08b6e4a8f 1073741824" returned: 0 in 0.776s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-392d2a60-fc51-4945-ba85-38566641d8ce tempest-GroupsTest-1290518108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-fd41569c-560a-40d0-9458-6db08b6e4a8f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:22 devstack sudo[92565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-fd41569c-560a-40d0-9458-6db08b6e4a8f Sep 23 00:15:22 devstack sudo[92565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:22 devstack sudo[92565]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-392d2a60-fc51-4945-ba85-38566641d8ce tempest-GroupsTest-1290518108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-fd41569c-560a-40d0-9458-6db08b6e4a8f" returned: 0 in 0.556s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:23 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-392d2a60-fc51-4945-ba85-38566641d8ce tempest-GroupsTest-1290518108 None] <== create_volume: return (1437ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:15:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-392d2a60-fc51-4945-ba85-38566641d8ce tempest-GroupsTest-1290518108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.440s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-392d2a60-fc51-4945-ba85-38566641d8ce tempest-GroupsTest-1290518108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a298edf9-aa72-43e0-95d8-f269e31c0247) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd41569c-560a-40d0-9458-6db08b6e4a8f', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-392d2a60-fc51-4945-ba85-38566641d8ce tempest-GroupsTest-1290518108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c63382ea-ee20-4be1-98c4-925519790fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:23 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-392d2a60-fc51-4945-ba85-38566641d8ce tempest-GroupsTest-1290518108 None] Volume volume-fd41569c-560a-40d0-9458-6db08b6e4a8f (fd41569c-560a-40d0-9458-6db08b6e4a8f): created successfully Sep 23 00:15:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-392d2a60-fc51-4945-ba85-38566641d8ce tempest-GroupsTest-1290518108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c63382ea-ee20-4be1-98c4-925519790fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-392d2a60-fc51-4945-ba85-38566641d8ce tempest-GroupsTest-1290518108 None] Flow 'volume_create_manager' (b185205b-4795-4ade-9c49-fb7e1cb38407) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:15:23 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-392d2a60-fc51-4945-ba85-38566641d8ce tempest-GroupsTest-1290518108 None] Created volume successfully. Sep 23 00:15:25 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c7ff31e6-9ed8-41b4-9a28-eaffa3018066 tempest-GroupsTest-1290518108 None] Acquiring lock "cinder-quobyte-fd41569c-560a-40d0-9458-6db08b6e4a8f" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:25 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c7ff31e6-9ed8-41b4-9a28-eaffa3018066 tempest-GroupsTest-1290518108 None] Lock "cinder-quobyte-fd41569c-560a-40d0-9458-6db08b6e4a8f" acquired by "delete_volume" :: waited 0.013s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:25 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c3d4a6-194c-47ac-b549-a963936db3dc]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c7ff31e6-9ed8-41b4-9a28-eaffa3018066 tempest-GroupsTest-1290518108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-fd41569c-560a-40d0-9458-6db08b6e4a8f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:25 devstack sudo[92570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-fd41569c-560a-40d0-9458-6db08b6e4a8f Sep 23 00:15:25 devstack sudo[92570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:25 devstack sudo[92570]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c7ff31e6-9ed8-41b4-9a28-eaffa3018066 tempest-GroupsTest-1290518108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-fd41569c-560a-40d0-9458-6db08b6e4a8f" returned: 0 in 0.562s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c7ff31e6-9ed8-41b4-9a28-eaffa3018066 tempest-GroupsTest-1290518108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-fd41569c-560a-40d0-9458-6db08b6e4a8f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:25 devstack sudo[92576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-fd41569c-560a-40d0-9458-6db08b6e4a8f Sep 23 00:15:25 devstack sudo[92576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:26 devstack sudo[92576]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c7ff31e6-9ed8-41b4-9a28-eaffa3018066 tempest-GroupsTest-1290518108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-fd41569c-560a-40d0-9458-6db08b6e4a8f" returned: 0 in 0.338s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:26 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c7ff31e6-9ed8-41b4-9a28-eaffa3018066 tempest-GroupsTest-1290518108 None] Lock "cinder-quobyte-fd41569c-560a-40d0-9458-6db08b6e4a8f" released by "delete_volume" :: held 1.008s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:26 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-c7ff31e6-9ed8-41b4-9a28-eaffa3018066 tempest-GroupsTest-1290518108 None] Created reservations ['a43f2f83-dcf5-4c46-a9d8-63ea100fa6ed'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:15:26 devstack cinder-volume[86591]: WARNING cinder.quota [None req-c7ff31e6-9ed8-41b4-9a28-eaffa3018066 tempest-GroupsTest-1290518108 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-352020826 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-352020826, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:15:26 devstack cinder-volume[86591]: WARNING cinder.quota [None req-c7ff31e6-9ed8-41b4-9a28-eaffa3018066 tempest-GroupsTest-1290518108 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-352020826 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-352020826, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:15:26 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-c7ff31e6-9ed8-41b4-9a28-eaffa3018066 tempest-GroupsTest-1290518108 None] Created reservations ['936273c3-470d-484f-b9b9-c16de46bb651', '8f39f53a-6439-4bfa-b198-58c67dcdaae0', '77d021a7-c677-4f87-8589-f64ba5bfa225', '79573cd8-a028-45d3-bf40-cdb17b2b0d5b'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:15:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c7ff31e6-9ed8-41b4-9a28-eaffa3018066 tempest-GroupsTest-1290518108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c7ff31e6-9ed8-41b4-9a28-eaffa3018066 tempest-GroupsTest-1290518108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:26 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c7ff31e6-9ed8-41b4-9a28-eaffa3018066 tempest-GroupsTest-1290518108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:26 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c7ff31e6-9ed8-41b4-9a28-eaffa3018066 tempest-GroupsTest-1290518108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c7ff31e6-9ed8-41b4-9a28-eaffa3018066 tempest-GroupsTest-1290518108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c7ff31e6-9ed8-41b4-9a28-eaffa3018066 tempest-GroupsTest-1290518108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:26 devstack sudo[92580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:15:26 devstack sudo[92580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:26 devstack sudo[92580]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c7ff31e6-9ed8-41b4-9a28-eaffa3018066 tempest-GroupsTest-1290518108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.359s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:26 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-c7ff31e6-9ed8-41b4-9a28-eaffa3018066 tempest-GroupsTest-1290518108 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:15:26 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-c7ff31e6-9ed8-41b4-9a28-eaffa3018066 tempest-GroupsTest-1290518108 None] Delete group completed successfully. Sep 23 00:15:27 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-9a4479aa-2694-4e46-b093-105fb76f4c04 tempest-GroupsTest-1290518108 None] Created reservations ['9468ea3a-8d7f-40bb-83f5-33100a5268ae'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:15:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9a4479aa-2694-4e46-b093-105fb76f4c04 tempest-GroupsTest-1290518108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9a4479aa-2694-4e46-b093-105fb76f4c04 tempest-GroupsTest-1290518108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:28 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9a4479aa-2694-4e46-b093-105fb76f4c04 tempest-GroupsTest-1290518108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:28 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9a4479aa-2694-4e46-b093-105fb76f4c04 tempest-GroupsTest-1290518108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9a4479aa-2694-4e46-b093-105fb76f4c04 tempest-GroupsTest-1290518108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9a4479aa-2694-4e46-b093-105fb76f4c04 tempest-GroupsTest-1290518108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:28 devstack sudo[92583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:15:28 devstack sudo[92583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:28 devstack sudo[92583]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9a4479aa-2694-4e46-b093-105fb76f4c04 tempest-GroupsTest-1290518108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.349s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:28 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-9a4479aa-2694-4e46-b093-105fb76f4c04 tempest-GroupsTest-1290518108 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:15:28 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-9a4479aa-2694-4e46-b093-105fb76f4c04 tempest-GroupsTest-1290518108 None] Delete group completed successfully. Sep 23 00:15:29 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-5634ae21-1664-4d35-a666-31876713bf31 tempest-GroupsTest-1290518108 None] Group tempest-GroupsTest-Group-994439950: creating Sep 23 00:15:30 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-5634ae21-1664-4d35-a666-31876713bf31 tempest-GroupsTest-1290518108 None] Group tempest-GroupsTest-Group-994439950: created successfully Sep 23 00:15:30 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-5634ae21-1664-4d35-a666-31876713bf31 tempest-GroupsTest-1290518108 None] Create group completed successfully. Sep 23 00:15:32 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-daec8f45-4523-4579-9f7e-160cfe8840f9 tempest-GroupsTest-1290518108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:15:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-daec8f45-4523-4579-9f7e-160cfe8840f9 tempest-GroupsTest-1290518108 None] Flow 'volume_create_manager' (916ec0a3-1294-412b-aaad-b1f9c4b872f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:15:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-daec8f45-4523-4579-9f7e-160cfe8840f9 tempest-GroupsTest-1290518108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (446d5ae9-4b9d-4664-8771-39391ca8619c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-daec8f45-4523-4579-9f7e-160cfe8840f9 tempest-GroupsTest-1290518108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (446d5ae9-4b9d-4664-8771-39391ca8619c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:15:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-83302542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=36603fd7-4d48-4289-b312-bed1e67b4da3,host='devstack@QuobyteHD#QuobyteHD',id=cd91fd17-48f8-488f-9f6f-e48831415004,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0219498b10164562a862ad51e7bb1725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:32Z,use_quota=True,user_id='75f83680df71444eb9141c920815e0c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(96dc9ac6-2ca1-4e41-97a6-c77fa1ece205),volume_type_id=96dc9ac6-2ca1-4e41-97a6-c77fa1ece205)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-daec8f45-4523-4579-9f7e-160cfe8840f9 tempest-GroupsTest-1290518108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ba42599-1526-40b8-a599-af5b7534f40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-daec8f45-4523-4579-9f7e-160cfe8840f9 tempest-GroupsTest-1290518108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ba42599-1526-40b8-a599-af5b7534f40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-daec8f45-4523-4579-9f7e-160cfe8840f9 tempest-GroupsTest-1290518108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b087446-3249-4788-8aec-9e7dc90565a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-daec8f45-4523-4579-9f7e-160cfe8840f9 tempest-GroupsTest-1290518108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b087446-3249-4788-8aec-9e7dc90565a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd91fd17-48f8-488f-9f6f-e48831415004', 'volume_name': 'volume-cd91fd17-48f8-488f-9f6f-e48831415004', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-daec8f45-4523-4579-9f7e-160cfe8840f9 tempest-GroupsTest-1290518108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1742e5de-8b56-48e1-b59c-e93f01aa26d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-daec8f45-4523-4579-9f7e-160cfe8840f9 tempest-GroupsTest-1290518108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1742e5de-8b56-48e1-b59c-e93f01aa26d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-daec8f45-4523-4579-9f7e-160cfe8840f9 tempest-GroupsTest-1290518108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dc91c5e-70e5-43d1-b2a6-78b263fe022a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:32 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-daec8f45-4523-4579-9f7e-160cfe8840f9 tempest-GroupsTest-1290518108 None] Volume cd91fd17-48f8-488f-9f6f-e48831415004: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd91fd17-48f8-488f-9f6f-e48831415004', 'volume_size': 1} Sep 23 00:15:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-daec8f45-4523-4579-9f7e-160cfe8840f9 tempest-GroupsTest-1290518108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-daec8f45-4523-4579-9f7e-160cfe8840f9 tempest-GroupsTest-1290518108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:32 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-daec8f45-4523-4579-9f7e-160cfe8840f9 tempest-GroupsTest-1290518108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=36603fd7-4d48-4289-b312-bed1e67b4da3,created_at=2026-09-22T22:15:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-83302542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=36603fd7-4d48-4289-b312-bed1e67b4da3,host='devstack@QuobyteHD#QuobyteHD',id=cd91fd17-48f8-488f-9f6f-e48831415004,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0219498b10164562a862ad51e7bb1725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:32Z,use_quota=True,user_id='75f83680df71444eb9141c920815e0c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(96dc9ac6-2ca1-4e41-97a6-c77fa1ece205),volume_type_id=96dc9ac6-2ca1-4e41-97a6-c77fa1ece205)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:15:32 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-daec8f45-4523-4579-9f7e-160cfe8840f9 tempest-GroupsTest-1290518108 None] Creating volume cd91fd17-48f8-488f-9f6f-e48831415004 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:15:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-daec8f45-4523-4579-9f7e-160cfe8840f9 tempest-GroupsTest-1290518108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-daec8f45-4523-4579-9f7e-160cfe8840f9 tempest-GroupsTest-1290518108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:32 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-daec8f45-4523-4579-9f7e-160cfe8840f9 tempest-GroupsTest-1290518108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:32 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-daec8f45-4523-4579-9f7e-160cfe8840f9 tempest-GroupsTest-1290518108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-daec8f45-4523-4579-9f7e-160cfe8840f9 tempest-GroupsTest-1290518108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:32 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-daec8f45-4523-4579-9f7e-160cfe8840f9 tempest-GroupsTest-1290518108 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:15:32 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-daec8f45-4523-4579-9f7e-160cfe8840f9 tempest-GroupsTest-1290518108 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:15:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-daec8f45-4523-4579-9f7e-160cfe8840f9 tempest-GroupsTest-1290518108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cd91fd17-48f8-488f-9f6f-e48831415004 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:32 devstack sudo[92612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cd91fd17-48f8-488f-9f6f-e48831415004 1073741824 Sep 23 00:15:32 devstack sudo[92612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:33 devstack sudo[92612]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-daec8f45-4523-4579-9f7e-160cfe8840f9 tempest-GroupsTest-1290518108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cd91fd17-48f8-488f-9f6f-e48831415004 1073741824" returned: 0 in 0.839s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-daec8f45-4523-4579-9f7e-160cfe8840f9 tempest-GroupsTest-1290518108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cd91fd17-48f8-488f-9f6f-e48831415004 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:33 devstack sudo[92620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cd91fd17-48f8-488f-9f6f-e48831415004 Sep 23 00:15:33 devstack sudo[92620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:34 devstack sudo[92620]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-daec8f45-4523-4579-9f7e-160cfe8840f9 tempest-GroupsTest-1290518108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cd91fd17-48f8-488f-9f6f-e48831415004" returned: 0 in 0.322s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:34 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-daec8f45-4523-4579-9f7e-160cfe8840f9 tempest-GroupsTest-1290518108 None] <== create_volume: return (1259ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:15:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-daec8f45-4523-4579-9f7e-160cfe8840f9 tempest-GroupsTest-1290518108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.263s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-daec8f45-4523-4579-9f7e-160cfe8840f9 tempest-GroupsTest-1290518108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dc91c5e-70e5-43d1-b2a6-78b263fe022a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd91fd17-48f8-488f-9f6f-e48831415004', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-daec8f45-4523-4579-9f7e-160cfe8840f9 tempest-GroupsTest-1290518108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1a08316-6e78-408b-8482-813771291d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:34 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-daec8f45-4523-4579-9f7e-160cfe8840f9 tempest-GroupsTest-1290518108 None] Volume volume-cd91fd17-48f8-488f-9f6f-e48831415004 (cd91fd17-48f8-488f-9f6f-e48831415004): created successfully Sep 23 00:15:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-daec8f45-4523-4579-9f7e-160cfe8840f9 tempest-GroupsTest-1290518108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1a08316-6e78-408b-8482-813771291d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-daec8f45-4523-4579-9f7e-160cfe8840f9 tempest-GroupsTest-1290518108 None] Flow 'volume_create_manager' (916ec0a3-1294-412b-aaad-b1f9c4b872f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:15:34 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-daec8f45-4523-4579-9f7e-160cfe8840f9 tempest-GroupsTest-1290518108 None] Created volume successfully. Sep 23 00:15:36 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-baaa9dd1-8a2f-4b74-bb3e-ced938f3df37 tempest-GroupsTest-1290518108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:15:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-baaa9dd1-8a2f-4b74-bb3e-ced938f3df37 tempest-GroupsTest-1290518108 None] Flow 'volume_create_manager' (bb70287e-7617-4fbb-8be8-78575def784a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:15:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-baaa9dd1-8a2f-4b74-bb3e-ced938f3df37 tempest-GroupsTest-1290518108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a316c91-0e29-4ff7-bb7f-6a31259f377a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-baaa9dd1-8a2f-4b74-bb3e-ced938f3df37 tempest-GroupsTest-1290518108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a316c91-0e29-4ff7-bb7f-6a31259f377a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:15:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1495149943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=36603fd7-4d48-4289-b312-bed1e67b4da3,host='devstack@QuobyteHD#QuobyteHD',id=84a3c551-c0ac-486f-91ab-5bfa7756d416,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0219498b10164562a862ad51e7bb1725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:36Z,use_quota=True,user_id='75f83680df71444eb9141c920815e0c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(96dc9ac6-2ca1-4e41-97a6-c77fa1ece205),volume_type_id=96dc9ac6-2ca1-4e41-97a6-c77fa1ece205)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-baaa9dd1-8a2f-4b74-bb3e-ced938f3df37 tempest-GroupsTest-1290518108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b78dc8b-41af-42d5-aa9f-31847202f754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-baaa9dd1-8a2f-4b74-bb3e-ced938f3df37 tempest-GroupsTest-1290518108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b78dc8b-41af-42d5-aa9f-31847202f754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-baaa9dd1-8a2f-4b74-bb3e-ced938f3df37 tempest-GroupsTest-1290518108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8821bf14-9b7d-472d-baf6-bfb8963fd0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-baaa9dd1-8a2f-4b74-bb3e-ced938f3df37 tempest-GroupsTest-1290518108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8821bf14-9b7d-472d-baf6-bfb8963fd0fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84a3c551-c0ac-486f-91ab-5bfa7756d416', 'volume_name': 'volume-84a3c551-c0ac-486f-91ab-5bfa7756d416', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-baaa9dd1-8a2f-4b74-bb3e-ced938f3df37 tempest-GroupsTest-1290518108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf09ff03-11f9-4435-affd-af560b81462d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-baaa9dd1-8a2f-4b74-bb3e-ced938f3df37 tempest-GroupsTest-1290518108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf09ff03-11f9-4435-affd-af560b81462d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-baaa9dd1-8a2f-4b74-bb3e-ced938f3df37 tempest-GroupsTest-1290518108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eddc6e76-5b4f-48b8-8abb-66ca9b87b5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:36 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-baaa9dd1-8a2f-4b74-bb3e-ced938f3df37 tempest-GroupsTest-1290518108 None] Volume 84a3c551-c0ac-486f-91ab-5bfa7756d416: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84a3c551-c0ac-486f-91ab-5bfa7756d416', 'volume_size': 1} Sep 23 00:15:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-baaa9dd1-8a2f-4b74-bb3e-ced938f3df37 tempest-GroupsTest-1290518108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-baaa9dd1-8a2f-4b74-bb3e-ced938f3df37 tempest-GroupsTest-1290518108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:36 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-baaa9dd1-8a2f-4b74-bb3e-ced938f3df37 tempest-GroupsTest-1290518108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=36603fd7-4d48-4289-b312-bed1e67b4da3,created_at=2026-09-22T22:15:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1495149943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=36603fd7-4d48-4289-b312-bed1e67b4da3,host='devstack@QuobyteHD#QuobyteHD',id=84a3c551-c0ac-486f-91ab-5bfa7756d416,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0219498b10164562a862ad51e7bb1725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:36Z,use_quota=True,user_id='75f83680df71444eb9141c920815e0c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(96dc9ac6-2ca1-4e41-97a6-c77fa1ece205),volume_type_id=96dc9ac6-2ca1-4e41-97a6-c77fa1ece205)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:15:36 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-baaa9dd1-8a2f-4b74-bb3e-ced938f3df37 tempest-GroupsTest-1290518108 None] Creating volume 84a3c551-c0ac-486f-91ab-5bfa7756d416 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:15:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-baaa9dd1-8a2f-4b74-bb3e-ced938f3df37 tempest-GroupsTest-1290518108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-baaa9dd1-8a2f-4b74-bb3e-ced938f3df37 tempest-GroupsTest-1290518108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:36 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-baaa9dd1-8a2f-4b74-bb3e-ced938f3df37 tempest-GroupsTest-1290518108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:36 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-baaa9dd1-8a2f-4b74-bb3e-ced938f3df37 tempest-GroupsTest-1290518108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-baaa9dd1-8a2f-4b74-bb3e-ced938f3df37 tempest-GroupsTest-1290518108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:36 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-baaa9dd1-8a2f-4b74-bb3e-ced938f3df37 tempest-GroupsTest-1290518108 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:15:36 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-baaa9dd1-8a2f-4b74-bb3e-ced938f3df37 tempest-GroupsTest-1290518108 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:15:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-baaa9dd1-8a2f-4b74-bb3e-ced938f3df37 tempest-GroupsTest-1290518108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-84a3c551-c0ac-486f-91ab-5bfa7756d416 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:36 devstack sudo[92662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-84a3c551-c0ac-486f-91ab-5bfa7756d416 1073741824 Sep 23 00:15:36 devstack sudo[92662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:37 devstack sudo[92662]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-baaa9dd1-8a2f-4b74-bb3e-ced938f3df37 tempest-GroupsTest-1290518108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-84a3c551-c0ac-486f-91ab-5bfa7756d416 1073741824" returned: 0 in 0.865s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-baaa9dd1-8a2f-4b74-bb3e-ced938f3df37 tempest-GroupsTest-1290518108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-84a3c551-c0ac-486f-91ab-5bfa7756d416 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:37 devstack sudo[92668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-84a3c551-c0ac-486f-91ab-5bfa7756d416 Sep 23 00:15:37 devstack sudo[92668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:37 devstack sudo[92668]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-baaa9dd1-8a2f-4b74-bb3e-ced938f3df37 tempest-GroupsTest-1290518108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-84a3c551-c0ac-486f-91ab-5bfa7756d416" returned: 0 in 0.447s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-baaa9dd1-8a2f-4b74-bb3e-ced938f3df37 tempest-GroupsTest-1290518108 None] <== create_volume: return (1390ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:15:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-baaa9dd1-8a2f-4b74-bb3e-ced938f3df37 tempest-GroupsTest-1290518108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.394s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-baaa9dd1-8a2f-4b74-bb3e-ced938f3df37 tempest-GroupsTest-1290518108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eddc6e76-5b4f-48b8-8abb-66ca9b87b5ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84a3c551-c0ac-486f-91ab-5bfa7756d416', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-baaa9dd1-8a2f-4b74-bb3e-ced938f3df37 tempest-GroupsTest-1290518108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (466eded0-ebe4-4d28-9b29-4f662a7fb915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:37 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-baaa9dd1-8a2f-4b74-bb3e-ced938f3df37 tempest-GroupsTest-1290518108 None] Volume volume-84a3c551-c0ac-486f-91ab-5bfa7756d416 (84a3c551-c0ac-486f-91ab-5bfa7756d416): created successfully Sep 23 00:15:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-baaa9dd1-8a2f-4b74-bb3e-ced938f3df37 tempest-GroupsTest-1290518108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (466eded0-ebe4-4d28-9b29-4f662a7fb915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:38 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-baaa9dd1-8a2f-4b74-bb3e-ced938f3df37 tempest-GroupsTest-1290518108 None] Flow 'volume_create_manager' (bb70287e-7617-4fbb-8be8-78575def784a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:15:38 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-baaa9dd1-8a2f-4b74-bb3e-ced938f3df37 tempest-GroupsTest-1290518108 None] Created volume successfully. Sep 23 00:15:39 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-73d5daa0-9ab0-4829-a629-e0a5f2822e8d tempest-AttachVolumeShelveTestJSON-294261862 None] Acquiring lock "cinder-db5de011-8b62-43c9-a2b0-ab20510f7b06-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:39 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-73d5daa0-9ab0-4829-a629-e0a5f2822e8d tempest-AttachVolumeShelveTestJSON-294261862 None] Lock "cinder-db5de011-8b62-43c9-a2b0-ab20510f7b06-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:39 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-73d5daa0-9ab0-4829-a629-e0a5f2822e8d tempest-AttachVolumeShelveTestJSON-294261862 None] Acquiring lock "cinder-quobyte-db5de011-8b62-43c9-a2b0-ab20510f7b06" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:39 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-73d5daa0-9ab0-4829-a629-e0a5f2822e8d tempest-AttachVolumeShelveTestJSON-294261862 None] Lock "cinder-quobyte-db5de011-8b62-43c9-a2b0-ab20510f7b06" acquired by "delete_volume" :: waited 0.018s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:39 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[06fdcfbb-bda5-46f8-b95e-10ffe7ae6b97]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-73d5daa0-9ab0-4829-a629-e0a5f2822e8d tempest-AttachVolumeShelveTestJSON-294261862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db5de011-8b62-43c9-a2b0-ab20510f7b06 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:39 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-9a2cb312-6843-4f0b-b183-2096f72aad74 tempest-GroupsTest-1290518108 None] Update group completed successfully. Sep 23 00:15:39 devstack sudo[92671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db5de011-8b62-43c9-a2b0-ab20510f7b06 Sep 23 00:15:39 devstack sudo[92671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:39 devstack sudo[92671]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-73d5daa0-9ab0-4829-a629-e0a5f2822e8d tempest-AttachVolumeShelveTestJSON-294261862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db5de011-8b62-43c9-a2b0-ab20510f7b06" returned: 0 in 0.568s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-73d5daa0-9ab0-4829-a629-e0a5f2822e8d tempest-AttachVolumeShelveTestJSON-294261862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db5de011-8b62-43c9-a2b0-ab20510f7b06 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:39 devstack sudo[92676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db5de011-8b62-43c9-a2b0-ab20510f7b06 Sep 23 00:15:39 devstack sudo[92676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:40 devstack sudo[92676]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-73d5daa0-9ab0-4829-a629-e0a5f2822e8d tempest-AttachVolumeShelveTestJSON-294261862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db5de011-8b62-43c9-a2b0-ab20510f7b06" returned: 0 in 0.280s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:40 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-73d5daa0-9ab0-4829-a629-e0a5f2822e8d tempest-AttachVolumeShelveTestJSON-294261862 None] Lock "cinder-quobyte-db5de011-8b62-43c9-a2b0-ab20510f7b06" released by "delete_volume" :: held 0.903s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:40 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-73d5daa0-9ab0-4829-a629-e0a5f2822e8d tempest-AttachVolumeShelveTestJSON-294261862 None] Created reservations ['cce1f039-5296-4775-aa68-3ef4ae653648', '60a723d3-ed1f-4e22-b555-0d7a9f15d9f5', '8a9bbd57-73bd-484b-bad0-84880ce314c7', '3932ce6d-0353-4ea2-8254-5a6a5f53dbb5'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:15:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-73d5daa0-9ab0-4829-a629-e0a5f2822e8d tempest-AttachVolumeShelveTestJSON-294261862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-73d5daa0-9ab0-4829-a629-e0a5f2822e8d tempest-AttachVolumeShelveTestJSON-294261862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:40 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-73d5daa0-9ab0-4829-a629-e0a5f2822e8d tempest-AttachVolumeShelveTestJSON-294261862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:40 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-73d5daa0-9ab0-4829-a629-e0a5f2822e8d tempest-AttachVolumeShelveTestJSON-294261862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-73d5daa0-9ab0-4829-a629-e0a5f2822e8d tempest-AttachVolumeShelveTestJSON-294261862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-73d5daa0-9ab0-4829-a629-e0a5f2822e8d tempest-AttachVolumeShelveTestJSON-294261862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:40 devstack sudo[92679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:15:40 devstack sudo[92679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:40 devstack sudo[92679]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-73d5daa0-9ab0-4829-a629-e0a5f2822e8d tempest-AttachVolumeShelveTestJSON-294261862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.350s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:40 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-73d5daa0-9ab0-4829-a629-e0a5f2822e8d tempest-AttachVolumeShelveTestJSON-294261862 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:15:40 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-73d5daa0-9ab0-4829-a629-e0a5f2822e8d tempest-AttachVolumeShelveTestJSON-294261862 None] Deleted volume successfully. Sep 23 00:15:40 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-73d5daa0-9ab0-4829-a629-e0a5f2822e8d tempest-AttachVolumeShelveTestJSON-294261862 None] Lock "cinder-db5de011-8b62-43c9-a2b0-ab20510f7b06-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:40 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-72a6798a-0d3a-48a8-9868-7f93dc915c0e tempest-GroupsTest-1290518108 None] Update group completed successfully. Sep 23 00:15:41 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad98663d-9850-4eea-91d9-92610a2786db tempest-VolumesSnapshotTestJSON-1723175258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:15:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ad98663d-9850-4eea-91d9-92610a2786db tempest-VolumesSnapshotTestJSON-1723175258 None] Flow 'volume_create_manager' (eb6ec335-ccfd-412f-8647-05a17f79a3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:15:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ad98663d-9850-4eea-91d9-92610a2786db tempest-VolumesSnapshotTestJSON-1723175258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb7c14ff-2c44-4cce-be04-0d0d7299de98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ad98663d-9850-4eea-91d9-92610a2786db tempest-VolumesSnapshotTestJSON-1723175258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb7c14ff-2c44-4cce-be04-0d0d7299de98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:15:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1431477643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43b96489-7914-433d-baad-a261d97ef2bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf7cafdac732417c8e137325cfbd0195',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:42Z,use_quota=True,user_id='2f5c64ce686b4e50896d496f23e2a61f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ad98663d-9850-4eea-91d9-92610a2786db tempest-VolumesSnapshotTestJSON-1723175258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14582864-3c24-45dd-b226-9135392ebc9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ad98663d-9850-4eea-91d9-92610a2786db tempest-VolumesSnapshotTestJSON-1723175258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14582864-3c24-45dd-b226-9135392ebc9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ad98663d-9850-4eea-91d9-92610a2786db tempest-VolumesSnapshotTestJSON-1723175258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e01b0231-6f7f-4117-9cb0-b79e442ea3da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ad98663d-9850-4eea-91d9-92610a2786db tempest-VolumesSnapshotTestJSON-1723175258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e01b0231-6f7f-4117-9cb0-b79e442ea3da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43b96489-7914-433d-baad-a261d97ef2bf', 'volume_name': 'volume-43b96489-7914-433d-baad-a261d97ef2bf', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ad98663d-9850-4eea-91d9-92610a2786db tempest-VolumesSnapshotTestJSON-1723175258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (761997a3-12cf-4abb-8d0c-cb0183a17754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ad98663d-9850-4eea-91d9-92610a2786db tempest-VolumesSnapshotTestJSON-1723175258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (761997a3-12cf-4abb-8d0c-cb0183a17754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ad98663d-9850-4eea-91d9-92610a2786db tempest-VolumesSnapshotTestJSON-1723175258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (059eed93-04dc-41c8-8640-8029aaa08756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:42 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-ad98663d-9850-4eea-91d9-92610a2786db tempest-VolumesSnapshotTestJSON-1723175258 None] Volume 43b96489-7914-433d-baad-a261d97ef2bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43b96489-7914-433d-baad-a261d97ef2bf', 'volume_size': 1} Sep 23 00:15:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ad98663d-9850-4eea-91d9-92610a2786db tempest-VolumesSnapshotTestJSON-1723175258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ad98663d-9850-4eea-91d9-92610a2786db tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ad98663d-9850-4eea-91d9-92610a2786db tempest-VolumesSnapshotTestJSON-1723175258 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:15:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1431477643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43b96489-7914-433d-baad-a261d97ef2bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf7cafdac732417c8e137325cfbd0195',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:42Z,use_quota=True,user_id='2f5c64ce686b4e50896d496f23e2a61f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:15:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-ad98663d-9850-4eea-91d9-92610a2786db tempest-VolumesSnapshotTestJSON-1723175258 None] Creating volume 43b96489-7914-433d-baad-a261d97ef2bf {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:15:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ad98663d-9850-4eea-91d9-92610a2786db tempest-VolumesSnapshotTestJSON-1723175258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ad98663d-9850-4eea-91d9-92610a2786db tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ad98663d-9850-4eea-91d9-92610a2786db tempest-VolumesSnapshotTestJSON-1723175258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ad98663d-9850-4eea-91d9-92610a2786db tempest-VolumesSnapshotTestJSON-1723175258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ad98663d-9850-4eea-91d9-92610a2786db tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ad98663d-9850-4eea-91d9-92610a2786db tempest-VolumesSnapshotTestJSON-1723175258 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:15:42 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-ad98663d-9850-4eea-91d9-92610a2786db tempest-VolumesSnapshotTestJSON-1723175258 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:15:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ad98663d-9850-4eea-91d9-92610a2786db tempest-VolumesSnapshotTestJSON-1723175258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-43b96489-7914-433d-baad-a261d97ef2bf 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:42 devstack sudo[92682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-43b96489-7914-433d-baad-a261d97ef2bf 1073741824 Sep 23 00:15:42 devstack sudo[92682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:42 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-47679837-ccb5-44a0-a608-249354f83da4 tempest-GroupsTest-1290518108 None] Acquiring lock "cinder-quobyte-84a3c551-c0ac-486f-91ab-5bfa7756d416" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:42 devstack sudo[92682]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:42 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-47679837-ccb5-44a0-a608-249354f83da4 tempest-GroupsTest-1290518108 None] Lock "cinder-quobyte-84a3c551-c0ac-486f-91ab-5bfa7756d416" acquired by "delete_volume" :: waited 0.024s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ad98663d-9850-4eea-91d9-92610a2786db tempest-VolumesSnapshotTestJSON-1723175258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-43b96489-7914-433d-baad-a261d97ef2bf 1073741824" returned: 0 in 0.833s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:42 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ce94c7-658a-4128-a295-c63e81700040]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-47679837-ccb5-44a0-a608-249354f83da4 tempest-GroupsTest-1290518108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-84a3c551-c0ac-486f-91ab-5bfa7756d416 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ad98663d-9850-4eea-91d9-92610a2786db tempest-VolumesSnapshotTestJSON-1723175258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-43b96489-7914-433d-baad-a261d97ef2bf {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:43 devstack sudo[92689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-43b96489-7914-433d-baad-a261d97ef2bf Sep 23 00:15:43 devstack sudo[92689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:43 devstack sudo[92688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-84a3c551-c0ac-486f-91ab-5bfa7756d416 Sep 23 00:15:43 devstack sudo[92688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:43 devstack sudo[92689]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ad98663d-9850-4eea-91d9-92610a2786db tempest-VolumesSnapshotTestJSON-1723175258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-43b96489-7914-433d-baad-a261d97ef2bf" returned: 0 in 0.304s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:43 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ad98663d-9850-4eea-91d9-92610a2786db tempest-VolumesSnapshotTestJSON-1723175258 None] <== create_volume: return (1226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:15:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ad98663d-9850-4eea-91d9-92610a2786db tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.230s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:43 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ad98663d-9850-4eea-91d9-92610a2786db tempest-VolumesSnapshotTestJSON-1723175258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (059eed93-04dc-41c8-8640-8029aaa08756) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43b96489-7914-433d-baad-a261d97ef2bf', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:43 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ad98663d-9850-4eea-91d9-92610a2786db tempest-VolumesSnapshotTestJSON-1723175258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd56bb57-dfff-4cc6-85a9-674ddc4c54bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:43 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-ad98663d-9850-4eea-91d9-92610a2786db tempest-VolumesSnapshotTestJSON-1723175258 None] Volume volume-43b96489-7914-433d-baad-a261d97ef2bf (43b96489-7914-433d-baad-a261d97ef2bf): created successfully Sep 23 00:15:43 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ad98663d-9850-4eea-91d9-92610a2786db tempest-VolumesSnapshotTestJSON-1723175258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd56bb57-dfff-4cc6-85a9-674ddc4c54bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:43 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ad98663d-9850-4eea-91d9-92610a2786db tempest-VolumesSnapshotTestJSON-1723175258 None] Flow 'volume_create_manager' (eb6ec335-ccfd-412f-8647-05a17f79a3dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:15:43 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-ad98663d-9850-4eea-91d9-92610a2786db tempest-VolumesSnapshotTestJSON-1723175258 None] Created volume successfully. Sep 23 00:15:43 devstack sudo[92688]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-47679837-ccb5-44a0-a608-249354f83da4 tempest-GroupsTest-1290518108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-84a3c551-c0ac-486f-91ab-5bfa7756d416" returned: 0 in 0.559s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-47679837-ccb5-44a0-a608-249354f83da4 tempest-GroupsTest-1290518108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-84a3c551-c0ac-486f-91ab-5bfa7756d416 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:43 devstack sudo[92696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-84a3c551-c0ac-486f-91ab-5bfa7756d416 Sep 23 00:15:43 devstack sudo[92696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:43 devstack sudo[92696]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-47679837-ccb5-44a0-a608-249354f83da4 tempest-GroupsTest-1290518108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-84a3c551-c0ac-486f-91ab-5bfa7756d416" returned: 0 in 0.314s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:43 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-47679837-ccb5-44a0-a608-249354f83da4 tempest-GroupsTest-1290518108 None] Lock "cinder-quobyte-84a3c551-c0ac-486f-91ab-5bfa7756d416" released by "delete_volume" :: held 0.938s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:43 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-47679837-ccb5-44a0-a608-249354f83da4 tempest-GroupsTest-1290518108 None] Acquiring lock "cinder-quobyte-cd91fd17-48f8-488f-9f6f-e48831415004" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:43 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-47679837-ccb5-44a0-a608-249354f83da4 tempest-GroupsTest-1290518108 None] Lock "cinder-quobyte-cd91fd17-48f8-488f-9f6f-e48831415004" acquired by "delete_volume" :: waited 0.022s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:43 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b119ee9-b53b-43c7-a9ec-b5f32f3c7816]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-47679837-ccb5-44a0-a608-249354f83da4 tempest-GroupsTest-1290518108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cd91fd17-48f8-488f-9f6f-e48831415004 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:44 devstack sudo[92702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cd91fd17-48f8-488f-9f6f-e48831415004 Sep 23 00:15:44 devstack sudo[92702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:44 devstack sudo[92702]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-47679837-ccb5-44a0-a608-249354f83da4 tempest-GroupsTest-1290518108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cd91fd17-48f8-488f-9f6f-e48831415004" returned: 0 in 0.580s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-47679837-ccb5-44a0-a608-249354f83da4 tempest-GroupsTest-1290518108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cd91fd17-48f8-488f-9f6f-e48831415004 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-18bde2c1-b96d-4f97-9be4-dc7e6d43b7ca tempest-VolumesSnapshotTestJSON-1723175258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-18bde2c1-b96d-4f97-9be4-dc7e6d43b7ca tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:44 devstack sudo[92707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cd91fd17-48f8-488f-9f6f-e48831415004 Sep 23 00:15:44 devstack sudo[92707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:44 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-18bde2c1-b96d-4f97-9be4-dc7e6d43b7ca tempest-VolumesSnapshotTestJSON-1723175258 None] Creating offline snapshot 93cff1e2-caa6-4cf3-b0b5-9263c261f0ae of volume 43b96489-7914-433d-baad-a261d97ef2bf {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:15:44 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7593f7-c53f-4355-ab43-ae84b69705af]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-18bde2c1-b96d-4f97-9be4-dc7e6d43b7ca tempest-VolumesSnapshotTestJSON-1723175258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-43b96489-7914-433d-baad-a261d97ef2bf {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:44 devstack sudo[92709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-43b96489-7914-433d-baad-a261d97ef2bf Sep 23 00:15:44 devstack sudo[92709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:44 devstack sudo[92707]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-47679837-ccb5-44a0-a608-249354f83da4 tempest-GroupsTest-1290518108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cd91fd17-48f8-488f-9f6f-e48831415004" returned: 0 in 0.358s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:44 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-47679837-ccb5-44a0-a608-249354f83da4 tempest-GroupsTest-1290518108 None] Lock "cinder-quobyte-cd91fd17-48f8-488f-9f6f-e48831415004" released by "delete_volume" :: held 1.015s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:45 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-47679837-ccb5-44a0-a608-249354f83da4 tempest-GroupsTest-1290518108 None] Created reservations ['80a9d416-6bef-4b85-8b83-e8fca7da7193'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:15:45 devstack cinder-volume[86591]: WARNING cinder.quota [None req-47679837-ccb5-44a0-a608-249354f83da4 tempest-GroupsTest-1290518108 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-516610700 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-516610700, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:15:45 devstack cinder-volume[86591]: WARNING cinder.quota [None req-47679837-ccb5-44a0-a608-249354f83da4 tempest-GroupsTest-1290518108 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-516610700 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-516610700, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:15:45 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-47679837-ccb5-44a0-a608-249354f83da4 tempest-GroupsTest-1290518108 None] Created reservations ['99bcfd6e-81e0-4ac7-a943-38ed280de001', '14586849-837d-4cfd-978a-a68898e283ba', '97b26238-8e0f-4248-b35c-e8c120f8e853', '6fa63238-1304-47cb-810a-35a03cfa30db'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:15:45 devstack sudo[92709]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-18bde2c1-b96d-4f97-9be4-dc7e6d43b7ca tempest-VolumesSnapshotTestJSON-1723175258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-43b96489-7914-433d-baad-a261d97ef2bf" returned: 0 in 0.622s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-18bde2c1-b96d-4f97-9be4-dc7e6d43b7ca tempest-VolumesSnapshotTestJSON-1723175258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-43b96489-7914-433d-baad-a261d97ef2bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-43b96489-7914-433d-baad-a261d97ef2bf.93cff1e2-caa6-4cf3-b0b5-9263c261f0ae 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:45 devstack sudo[92720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-43b96489-7914-433d-baad-a261d97ef2bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-43b96489-7914-433d-baad-a261d97ef2bf.93cff1e2-caa6-4cf3-b0b5-9263c261f0ae 1G Sep 23 00:15:45 devstack sudo[92720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:45 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-47679837-ccb5-44a0-a608-249354f83da4 tempest-GroupsTest-1290518108 None] Created reservations ['96e0180e-972c-411f-8335-c800019419b7', '7a72cc3a-53ae-412f-88f5-28330aaf6181', '531f9c41-61e1-4d6e-9826-8bcdcf277578', '681f265e-ac48-4839-a2c8-7c66a9a031d1'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:15:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-47679837-ccb5-44a0-a608-249354f83da4 tempest-GroupsTest-1290518108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-47679837-ccb5-44a0-a608-249354f83da4 tempest-GroupsTest-1290518108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.015s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:45 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-47679837-ccb5-44a0-a608-249354f83da4 tempest-GroupsTest-1290518108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:45 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-47679837-ccb5-44a0-a608-249354f83da4 tempest-GroupsTest-1290518108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-47679837-ccb5-44a0-a608-249354f83da4 tempest-GroupsTest-1290518108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-47679837-ccb5-44a0-a608-249354f83da4 tempest-GroupsTest-1290518108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:45 devstack sudo[92726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:15:45 devstack sudo[92726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:45 devstack sudo[92720]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-18bde2c1-b96d-4f97-9be4-dc7e6d43b7ca tempest-VolumesSnapshotTestJSON-1723175258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-43b96489-7914-433d-baad-a261d97ef2bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-43b96489-7914-433d-baad-a261d97ef2bf.93cff1e2-caa6-4cf3-b0b5-9263c261f0ae 1G" returned: 0 in 0.790s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-18bde2c1-b96d-4f97-9be4-dc7e6d43b7ca tempest-VolumesSnapshotTestJSON-1723175258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43b96489-7914-433d-baad-a261d97ef2bf -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-43b96489-7914-433d-baad-a261d97ef2bf.93cff1e2-caa6-4cf3-b0b5-9263c261f0ae {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:46 devstack sudo[92733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43b96489-7914-433d-baad-a261d97ef2bf -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-43b96489-7914-433d-baad-a261d97ef2bf.93cff1e2-caa6-4cf3-b0b5-9263c261f0ae Sep 23 00:15:46 devstack sudo[92733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:46 devstack sudo[92726]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-47679837-ccb5-44a0-a608-249354f83da4 tempest-GroupsTest-1290518108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.417s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:46 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-47679837-ccb5-44a0-a608-249354f83da4 tempest-GroupsTest-1290518108 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:15:46 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-47679837-ccb5-44a0-a608-249354f83da4 tempest-GroupsTest-1290518108 None] Delete group completed successfully. Sep 23 00:15:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-bddcbe5d-4bcc-4fcc-a69f-9752f51ec70b req-2acd1bc1-aa7c-407c-a38b-cb9642a8ef09 tempest-ServerActionsTestOtherA-1121932693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:46 devstack sudo[92733]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-18bde2c1-b96d-4f97-9be4-dc7e6d43b7ca tempest-VolumesSnapshotTestJSON-1723175258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43b96489-7914-433d-baad-a261d97ef2bf -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-43b96489-7914-433d-baad-a261d97ef2bf.93cff1e2-caa6-4cf3-b0b5-9263c261f0ae" returned: 0 in 0.435s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:46 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-18bde2c1-b96d-4f97-9be4-dc7e6d43b7ca tempest-VolumesSnapshotTestJSON-1723175258 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-43b96489-7914-433d-baad-a261d97ef2bf.93cff1e2-caa6-4cf3-b0b5-9263c261f0ae is being set with open permissions: ugo+rw Sep 23 00:15:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-18bde2c1-b96d-4f97-9be4-dc7e6d43b7ca tempest-VolumesSnapshotTestJSON-1723175258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-43b96489-7914-433d-baad-a261d97ef2bf.93cff1e2-caa6-4cf3-b0b5-9263c261f0ae {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:46 devstack sudo[92744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-43b96489-7914-433d-baad-a261d97ef2bf.93cff1e2-caa6-4cf3-b0b5-9263c261f0ae Sep 23 00:15:46 devstack sudo[92744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:46 devstack sudo[92744]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-18bde2c1-b96d-4f97-9be4-dc7e6d43b7ca tempest-VolumesSnapshotTestJSON-1723175258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-43b96489-7914-433d-baad-a261d97ef2bf.93cff1e2-caa6-4cf3-b0b5-9263c261f0ae" returned: 0 in 0.319s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-18bde2c1-b96d-4f97-9be4-dc7e6d43b7ca tempest-VolumesSnapshotTestJSON-1723175258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-43b96489-7914-433d-baad-a261d97ef2bf.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:46 devstack sudo[92747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-43b96489-7914-433d-baad-a261d97ef2bf.info Sep 23 00:15:46 devstack sudo[92747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:47 devstack sudo[92747]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-18bde2c1-b96d-4f97-9be4-dc7e6d43b7ca tempest-VolumesSnapshotTestJSON-1723175258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-43b96489-7914-433d-baad-a261d97ef2bf.info" returned: 0 in 0.371s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:47 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-18bde2c1-b96d-4f97-9be4-dc7e6d43b7ca tempest-VolumesSnapshotTestJSON-1723175258 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-43b96489-7914-433d-baad-a261d97ef2bf.info is being set with open permissions: ugo+rw Sep 23 00:15:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-18bde2c1-b96d-4f97-9be4-dc7e6d43b7ca tempest-VolumesSnapshotTestJSON-1723175258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-43b96489-7914-433d-baad-a261d97ef2bf.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:47 devstack sudo[92750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-43b96489-7914-433d-baad-a261d97ef2bf.info Sep 23 00:15:47 devstack sudo[92750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:47 devstack sudo[92750]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-18bde2c1-b96d-4f97-9be4-dc7e6d43b7ca tempest-VolumesSnapshotTestJSON-1723175258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-43b96489-7914-433d-baad-a261d97ef2bf.info" returned: 0 in 0.424s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-18bde2c1-b96d-4f97-9be4-dc7e6d43b7ca tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.097s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-bddcbe5d-4bcc-4fcc-a69f-9752f51ec70b req-2acd1bc1-aa7c-407c-a38b-cb9642a8ef09 tempest-ServerActionsTestOtherA-1121932693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.322s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-bddcbe5d-4bcc-4fcc-a69f-9752f51ec70b req-2acd1bc1-aa7c-407c-a38b-cb9642a8ef09 tempest-ServerActionsTestOtherA-1121932693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-bddcbe5d-4bcc-4fcc-a69f-9752f51ec70b req-2acd1bc1-aa7c-407c-a38b-cb9642a8ef09 tempest-ServerActionsTestOtherA-1121932693 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974', 'name': 'volume-1815be18-5aab-4633-8ca2-69aaaa6fb514', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b8e4d4f1-aaa7-4182-a76d-198b52668fa3', 'enforce_multipath': True} {{(pid=86591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:15:47 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-18bde2c1-b96d-4f97-9be4-dc7e6d43b7ca tempest-VolumesSnapshotTestJSON-1723175258 None] Create snapshot completed successfully Sep 23 00:15:47 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-bddcbe5d-4bcc-4fcc-a69f-9752f51ec70b req-2acd1bc1-aa7c-407c-a38b-cb9642a8ef09 tempest-ServerActionsTestOtherA-1121932693 None] attachment_update completed successfully. Sep 23 00:15:48 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-10b56cca-42d3-421d-9684-58287daa33ad tempest-VolumesSnapshotTestJSON-1723175258 None] Acquiring lock "cinder-93cff1e2-caa6-4cf3-b0b5-9263c261f0ae-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:48 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-10b56cca-42d3-421d-9684-58287daa33ad tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "cinder-93cff1e2-caa6-4cf3-b0b5-9263c261f0ae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:48 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-10b56cca-42d3-421d-9684-58287daa33ad tempest-VolumesSnapshotTestJSON-1723175258 None] Acquiring lock "cinder-quobyte-43b96489-7914-433d-baad-a261d97ef2bf" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:48 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-10b56cca-42d3-421d-9684-58287daa33ad tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "cinder-quobyte-43b96489-7914-433d-baad-a261d97ef2bf" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:48 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-10b56cca-42d3-421d-9684-58287daa33ad tempest-VolumesSnapshotTestJSON-1723175258 None] Acquiring lock "cinder-quobyte-93cff1e2-caa6-4cf3-b0b5-9263c261f0ae" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:48 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-10b56cca-42d3-421d-9684-58287daa33ad tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "cinder-quobyte-93cff1e2-caa6-4cf3-b0b5-9263c261f0ae" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:48 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-10b56cca-42d3-421d-9684-58287daa33ad tempest-VolumesSnapshotTestJSON-1723175258 None] Deleting offline snapshot 93cff1e2-caa6-4cf3-b0b5-9263c261f0ae of volume 43b96489-7914-433d-baad-a261d97ef2bf {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:15:48 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-10b56cca-42d3-421d-9684-58287daa33ad tempest-VolumesSnapshotTestJSON-1723175258 None] snapshot_file for this snap is: volume-43b96489-7914-433d-baad-a261d97ef2bf.93cff1e2-caa6-4cf3-b0b5-9263c261f0ae {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:15:48 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6536c51-bbd9-40c0-984c-d650ed168a2d]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-10b56cca-42d3-421d-9684-58287daa33ad tempest-VolumesSnapshotTestJSON-1723175258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-43b96489-7914-433d-baad-a261d97ef2bf.93cff1e2-caa6-4cf3-b0b5-9263c261f0ae {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:48 devstack sudo[92851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-43b96489-7914-433d-baad-a261d97ef2bf.93cff1e2-caa6-4cf3-b0b5-9263c261f0ae Sep 23 00:15:48 devstack sudo[92851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:49 devstack sudo[92851]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-10b56cca-42d3-421d-9684-58287daa33ad tempest-VolumesSnapshotTestJSON-1723175258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-43b96489-7914-433d-baad-a261d97ef2bf.93cff1e2-caa6-4cf3-b0b5-9263c261f0ae" returned: 0 in 0.711s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:49 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-10b56cca-42d3-421d-9684-58287daa33ad tempest-VolumesSnapshotTestJSON-1723175258 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43b96489-7914-433d-baad-a261d97ef2bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:15:49 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe810be-aec8-496e-8881-da72f6fa9af0]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-10b56cca-42d3-421d-9684-58287daa33ad tempest-VolumesSnapshotTestJSON-1723175258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-43b96489-7914-433d-baad-a261d97ef2bf {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:49 devstack sudo[93172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-43b96489-7914-433d-baad-a261d97ef2bf Sep 23 00:15:49 devstack sudo[93172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:49 devstack sudo[93172]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-10b56cca-42d3-421d-9684-58287daa33ad tempest-VolumesSnapshotTestJSON-1723175258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-43b96489-7914-433d-baad-a261d97ef2bf" returned: 0 in 0.531s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-10b56cca-42d3-421d-9684-58287daa33ad tempest-VolumesSnapshotTestJSON-1723175258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-43b96489-7914-433d-baad-a261d97ef2bf.93cff1e2-caa6-4cf3-b0b5-9263c261f0ae {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:49 devstack sudo[93177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-43b96489-7914-433d-baad-a261d97ef2bf.93cff1e2-caa6-4cf3-b0b5-9263c261f0ae Sep 23 00:15:49 devstack sudo[93177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:50 devstack sudo[93177]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-10b56cca-42d3-421d-9684-58287daa33ad tempest-VolumesSnapshotTestJSON-1723175258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-43b96489-7914-433d-baad-a261d97ef2bf.93cff1e2-caa6-4cf3-b0b5-9263c261f0ae" returned: 0 in 0.450s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-10b56cca-42d3-421d-9684-58287daa33ad tempest-VolumesSnapshotTestJSON-1723175258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-43b96489-7914-433d-baad-a261d97ef2bf.93cff1e2-caa6-4cf3-b0b5-9263c261f0ae {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:50 devstack sudo[93183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-43b96489-7914-433d-baad-a261d97ef2bf.93cff1e2-caa6-4cf3-b0b5-9263c261f0ae Sep 23 00:15:50 devstack sudo[93183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:50 devstack sudo[93183]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-10b56cca-42d3-421d-9684-58287daa33ad tempest-VolumesSnapshotTestJSON-1723175258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-43b96489-7914-433d-baad-a261d97ef2bf.93cff1e2-caa6-4cf3-b0b5-9263c261f0ae" returned: 0 in 0.428s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:50 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-10b56cca-42d3-421d-9684-58287daa33ad tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "cinder-quobyte-93cff1e2-caa6-4cf3-b0b5-9263c261f0ae" released by "_delete_snapshot" :: held 2.311s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:50 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-10b56cca-42d3-421d-9684-58287daa33ad tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "cinder-quobyte-43b96489-7914-433d-baad-a261d97ef2bf" released by "delete_snapshot" :: held 2.341s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:50 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-10b56cca-42d3-421d-9684-58287daa33ad tempest-VolumesSnapshotTestJSON-1723175258 None] Created reservations ['056080f7-6632-439c-9ba5-0e9f4e87081b', 'a1a5a4ac-76e8-4e48-bfbf-0f12bda7573c', 'f5ce6273-6cdd-4c73-b81a-80e183b6597a', 'ac71c848-486d-462d-9f3c-5c8a70efec65'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:15:50 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-10b56cca-42d3-421d-9684-58287daa33ad tempest-VolumesSnapshotTestJSON-1723175258 None] Delete snapshot completed successfully. Sep 23 00:15:50 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-10b56cca-42d3-421d-9684-58287daa33ad tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "cinder-93cff1e2-caa6-4cf3-b0b5-9263c261f0ae-delete_snapshot" released by "delete_snapshot" :: held 2.619s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:51 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-e2c87a12-fa56-446f-9684-76418d462bf9 req-9b684f3e-c863-4a0c-b505-4f8f01127745 tempest-ServerActionsTestOtherA-1121932693 None] Terminate volume connection completed successfully. Sep 23 00:15:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-e2c87a12-fa56-446f-9684-76418d462bf9 req-9b684f3e-c863-4a0c-b505-4f8f01127745 tempest-ServerActionsTestOtherA-1121932693 None] Deleting attachment b8e4d4f1-aaa7-4182-a76d-198b52668fa3. {{(pid=86591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:15:52 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2324c8a-4535-41a9-bb39-781f4fdab247 tempest-VolumesSnapshotTestJSON-1723175258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:15:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c2324c8a-4535-41a9-bb39-781f4fdab247 tempest-VolumesSnapshotTestJSON-1723175258 None] Flow 'volume_create_manager' (c9dbc0e7-4c86-4b12-9dea-e0d3e30811d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:15:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c2324c8a-4535-41a9-bb39-781f4fdab247 tempest-VolumesSnapshotTestJSON-1723175258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97319b77-75f5-4af7-9561-9ed7fbf99261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c2324c8a-4535-41a9-bb39-781f4fdab247 tempest-VolumesSnapshotTestJSON-1723175258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97319b77-75f5-4af7-9561-9ed7fbf99261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:15:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-349141619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b04c68a9-ed43-4961-aac7-800c94def5cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf7cafdac732417c8e137325cfbd0195',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:52Z,use_quota=True,user_id='2f5c64ce686b4e50896d496f23e2a61f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c2324c8a-4535-41a9-bb39-781f4fdab247 tempest-VolumesSnapshotTestJSON-1723175258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f92d8adc-2f58-425d-ace8-17aab2055609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c2324c8a-4535-41a9-bb39-781f4fdab247 tempest-VolumesSnapshotTestJSON-1723175258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f92d8adc-2f58-425d-ace8-17aab2055609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c2324c8a-4535-41a9-bb39-781f4fdab247 tempest-VolumesSnapshotTestJSON-1723175258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39231095-293c-44a7-97ce-1ea60ed20392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c2324c8a-4535-41a9-bb39-781f4fdab247 tempest-VolumesSnapshotTestJSON-1723175258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39231095-293c-44a7-97ce-1ea60ed20392) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b04c68a9-ed43-4961-aac7-800c94def5cc', 'volume_name': 'volume-b04c68a9-ed43-4961-aac7-800c94def5cc', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c2324c8a-4535-41a9-bb39-781f4fdab247 tempest-VolumesSnapshotTestJSON-1723175258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4a8bc25-87a6-4461-ae17-ee744fae49e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c2324c8a-4535-41a9-bb39-781f4fdab247 tempest-VolumesSnapshotTestJSON-1723175258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4a8bc25-87a6-4461-ae17-ee744fae49e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c2324c8a-4535-41a9-bb39-781f4fdab247 tempest-VolumesSnapshotTestJSON-1723175258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3ef988d-80bb-4e13-95b6-8b205ecff93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:52 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-c2324c8a-4535-41a9-bb39-781f4fdab247 tempest-VolumesSnapshotTestJSON-1723175258 None] Volume b04c68a9-ed43-4961-aac7-800c94def5cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b04c68a9-ed43-4961-aac7-800c94def5cc', 'volume_size': 1} Sep 23 00:15:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c2324c8a-4535-41a9-bb39-781f4fdab247 tempest-VolumesSnapshotTestJSON-1723175258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c2324c8a-4535-41a9-bb39-781f4fdab247 tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:52 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c2324c8a-4535-41a9-bb39-781f4fdab247 tempest-VolumesSnapshotTestJSON-1723175258 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:15:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-349141619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b04c68a9-ed43-4961-aac7-800c94def5cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf7cafdac732417c8e137325cfbd0195',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:52Z,use_quota=True,user_id='2f5c64ce686b4e50896d496f23e2a61f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:15:52 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-c2324c8a-4535-41a9-bb39-781f4fdab247 tempest-VolumesSnapshotTestJSON-1723175258 None] Creating volume b04c68a9-ed43-4961-aac7-800c94def5cc {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:15:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c2324c8a-4535-41a9-bb39-781f4fdab247 tempest-VolumesSnapshotTestJSON-1723175258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c2324c8a-4535-41a9-bb39-781f4fdab247 tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:52 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c2324c8a-4535-41a9-bb39-781f4fdab247 tempest-VolumesSnapshotTestJSON-1723175258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:52 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c2324c8a-4535-41a9-bb39-781f4fdab247 tempest-VolumesSnapshotTestJSON-1723175258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c2324c8a-4535-41a9-bb39-781f4fdab247 tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:52 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c2324c8a-4535-41a9-bb39-781f4fdab247 tempest-VolumesSnapshotTestJSON-1723175258 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:15:52 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-c2324c8a-4535-41a9-bb39-781f4fdab247 tempest-VolumesSnapshotTestJSON-1723175258 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:15:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c2324c8a-4535-41a9-bb39-781f4fdab247 tempest-VolumesSnapshotTestJSON-1723175258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b04c68a9-ed43-4961-aac7-800c94def5cc 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:52 devstack sudo[93232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b04c68a9-ed43-4961-aac7-800c94def5cc 1073741824 Sep 23 00:15:52 devstack sudo[93232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:53 devstack sudo[93232]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c2324c8a-4535-41a9-bb39-781f4fdab247 tempest-VolumesSnapshotTestJSON-1723175258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b04c68a9-ed43-4961-aac7-800c94def5cc 1073741824" returned: 0 in 0.774s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c2324c8a-4535-41a9-bb39-781f4fdab247 tempest-VolumesSnapshotTestJSON-1723175258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b04c68a9-ed43-4961-aac7-800c94def5cc {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:53 devstack sudo[93256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b04c68a9-ed43-4961-aac7-800c94def5cc Sep 23 00:15:53 devstack sudo[93256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-e2c87a12-fa56-446f-9684-76418d462bf9 req-38ce26cb-bc8f-4550-a2db-5b382b4fe21c tempest-ServerActionsTestOtherA-1121932693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:53 devstack sudo[93256]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c2324c8a-4535-41a9-bb39-781f4fdab247 tempest-VolumesSnapshotTestJSON-1723175258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b04c68a9-ed43-4961-aac7-800c94def5cc" returned: 0 in 0.435s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:53 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c2324c8a-4535-41a9-bb39-781f4fdab247 tempest-VolumesSnapshotTestJSON-1723175258 None] <== create_volume: return (1305ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:15:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c2324c8a-4535-41a9-bb39-781f4fdab247 tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.308s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-e2c87a12-fa56-446f-9684-76418d462bf9 req-38ce26cb-bc8f-4550-a2db-5b382b4fe21c tempest-ServerActionsTestOtherA-1121932693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.325s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-e2c87a12-fa56-446f-9684-76418d462bf9 req-38ce26cb-bc8f-4550-a2db-5b382b4fe21c tempest-ServerActionsTestOtherA-1121932693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c2324c8a-4535-41a9-bb39-781f4fdab247 tempest-VolumesSnapshotTestJSON-1723175258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3ef988d-80bb-4e13-95b6-8b205ecff93d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b04c68a9-ed43-4961-aac7-800c94def5cc', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c2324c8a-4535-41a9-bb39-781f4fdab247 tempest-VolumesSnapshotTestJSON-1723175258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87e36f8d-56f9-4be1-9639-bbf1892f30ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:54 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-c2324c8a-4535-41a9-bb39-781f4fdab247 tempest-VolumesSnapshotTestJSON-1723175258 None] Volume volume-b04c68a9-ed43-4961-aac7-800c94def5cc (b04c68a9-ed43-4961-aac7-800c94def5cc): created successfully Sep 23 00:15:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c2324c8a-4535-41a9-bb39-781f4fdab247 tempest-VolumesSnapshotTestJSON-1723175258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87e36f8d-56f9-4be1-9639-bbf1892f30ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c2324c8a-4535-41a9-bb39-781f4fdab247 tempest-VolumesSnapshotTestJSON-1723175258 None] Flow 'volume_create_manager' (c9dbc0e7-4c86-4b12-9dea-e0d3e30811d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:15:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-e2c87a12-fa56-446f-9684-76418d462bf9 req-38ce26cb-bc8f-4550-a2db-5b382b4fe21c tempest-ServerActionsTestOtherA-1121932693 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974', 'name': 'volume-1815be18-5aab-4633-8ca2-69aaaa6fb514', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ab5dd8ee-a780-4cc9-bafd-c90d7bc996a7', 'enforce_multipath': True} {{(pid=86591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:15:54 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-c2324c8a-4535-41a9-bb39-781f4fdab247 tempest-VolumesSnapshotTestJSON-1723175258 None] Created volume successfully. Sep 23 00:15:54 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-e2c87a12-fa56-446f-9684-76418d462bf9 req-38ce26cb-bc8f-4550-a2db-5b382b4fe21c tempest-ServerActionsTestOtherA-1121932693 None] attachment_update completed successfully. Sep 23 00:15:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4c225c22-771b-44b1-a4fe-84d4aced18f7 tempest-VolumesSnapshotTestJSON-1723175258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4c225c22-771b-44b1-a4fe-84d4aced18f7 tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:55 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-4c225c22-771b-44b1-a4fe-84d4aced18f7 tempest-VolumesSnapshotTestJSON-1723175258 None] Creating offline snapshot 37f1b613-758c-4755-9217-5353b1609300 of volume b04c68a9-ed43-4961-aac7-800c94def5cc {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:15:55 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1bd3632-7264-48d1-b9ca-b0dc84ee3870]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4c225c22-771b-44b1-a4fe-84d4aced18f7 tempest-VolumesSnapshotTestJSON-1723175258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b04c68a9-ed43-4961-aac7-800c94def5cc {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:55 devstack sudo[93270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b04c68a9-ed43-4961-aac7-800c94def5cc Sep 23 00:15:55 devstack sudo[93270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:55 devstack sudo[93270]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4c225c22-771b-44b1-a4fe-84d4aced18f7 tempest-VolumesSnapshotTestJSON-1723175258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b04c68a9-ed43-4961-aac7-800c94def5cc" returned: 0 in 0.896s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4c225c22-771b-44b1-a4fe-84d4aced18f7 tempest-VolumesSnapshotTestJSON-1723175258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b04c68a9-ed43-4961-aac7-800c94def5cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b04c68a9-ed43-4961-aac7-800c94def5cc.37f1b613-758c-4755-9217-5353b1609300 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:56 devstack sudo[93289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b04c68a9-ed43-4961-aac7-800c94def5cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b04c68a9-ed43-4961-aac7-800c94def5cc.37f1b613-758c-4755-9217-5353b1609300 1G Sep 23 00:15:56 devstack sudo[93289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:56 devstack sudo[93289]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4c225c22-771b-44b1-a4fe-84d4aced18f7 tempest-VolumesSnapshotTestJSON-1723175258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b04c68a9-ed43-4961-aac7-800c94def5cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b04c68a9-ed43-4961-aac7-800c94def5cc.37f1b613-758c-4755-9217-5353b1609300 1G" returned: 0 in 0.713s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4c225c22-771b-44b1-a4fe-84d4aced18f7 tempest-VolumesSnapshotTestJSON-1723175258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b04c68a9-ed43-4961-aac7-800c94def5cc -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b04c68a9-ed43-4961-aac7-800c94def5cc.37f1b613-758c-4755-9217-5353b1609300 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:56 devstack sudo[93403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b04c68a9-ed43-4961-aac7-800c94def5cc -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b04c68a9-ed43-4961-aac7-800c94def5cc.37f1b613-758c-4755-9217-5353b1609300 Sep 23 00:15:56 devstack sudo[93403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:57 devstack sudo[93403]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4c225c22-771b-44b1-a4fe-84d4aced18f7 tempest-VolumesSnapshotTestJSON-1723175258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b04c68a9-ed43-4961-aac7-800c94def5cc -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b04c68a9-ed43-4961-aac7-800c94def5cc.37f1b613-758c-4755-9217-5353b1609300" returned: 0 in 0.612s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:57 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-4c225c22-771b-44b1-a4fe-84d4aced18f7 tempest-VolumesSnapshotTestJSON-1723175258 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b04c68a9-ed43-4961-aac7-800c94def5cc.37f1b613-758c-4755-9217-5353b1609300 is being set with open permissions: ugo+rw Sep 23 00:15:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4c225c22-771b-44b1-a4fe-84d4aced18f7 tempest-VolumesSnapshotTestJSON-1723175258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b04c68a9-ed43-4961-aac7-800c94def5cc.37f1b613-758c-4755-9217-5353b1609300 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:57 devstack sudo[93740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b04c68a9-ed43-4961-aac7-800c94def5cc.37f1b613-758c-4755-9217-5353b1609300 Sep 23 00:15:57 devstack sudo[93740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:57 devstack sudo[93740]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4c225c22-771b-44b1-a4fe-84d4aced18f7 tempest-VolumesSnapshotTestJSON-1723175258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b04c68a9-ed43-4961-aac7-800c94def5cc.37f1b613-758c-4755-9217-5353b1609300" returned: 0 in 0.416s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4c225c22-771b-44b1-a4fe-84d4aced18f7 tempest-VolumesSnapshotTestJSON-1723175258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b04c68a9-ed43-4961-aac7-800c94def5cc.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:57 devstack sudo[93756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b04c68a9-ed43-4961-aac7-800c94def5cc.info Sep 23 00:15:57 devstack sudo[93756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:58 devstack sudo[93756]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4c225c22-771b-44b1-a4fe-84d4aced18f7 tempest-VolumesSnapshotTestJSON-1723175258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b04c68a9-ed43-4961-aac7-800c94def5cc.info" returned: 0 in 0.532s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:58 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-4c225c22-771b-44b1-a4fe-84d4aced18f7 tempest-VolumesSnapshotTestJSON-1723175258 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b04c68a9-ed43-4961-aac7-800c94def5cc.info is being set with open permissions: ugo+rw Sep 23 00:15:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4c225c22-771b-44b1-a4fe-84d4aced18f7 tempest-VolumesSnapshotTestJSON-1723175258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b04c68a9-ed43-4961-aac7-800c94def5cc.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:58 devstack sudo[93759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b04c68a9-ed43-4961-aac7-800c94def5cc.info Sep 23 00:15:58 devstack sudo[93759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:58 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-f7c76bcb-937a-4817-9313-328b456a31de tempest-GroupsV320Test-1898407032 None] Group tempest-GroupsV320Test-Group-360096969: creating Sep 23 00:15:58 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-f7c76bcb-937a-4817-9313-328b456a31de tempest-GroupsV320Test-1898407032 None] Group tempest-GroupsV320Test-Group-360096969: created successfully Sep 23 00:15:58 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-f7c76bcb-937a-4817-9313-328b456a31de tempest-GroupsV320Test-1898407032 None] Create group completed successfully. Sep 23 00:15:58 devstack sudo[93759]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4c225c22-771b-44b1-a4fe-84d4aced18f7 tempest-VolumesSnapshotTestJSON-1723175258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b04c68a9-ed43-4961-aac7-800c94def5cc.info" returned: 0 in 0.404s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4c225c22-771b-44b1-a4fe-84d4aced18f7 tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.756s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:58 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-4c225c22-771b-44b1-a4fe-84d4aced18f7 tempest-VolumesSnapshotTestJSON-1723175258 None] Create snapshot completed successfully Sep 23 00:16:00 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-919b539a-8a33-409c-ac21-2b03eba4630f tempest-GroupsV320Test-1898407032 None] Created reservations ['9c1ebe67-30bc-4ab0-ab78-edc2a3c93be8'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:16:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-919b539a-8a33-409c-ac21-2b03eba4630f tempest-GroupsV320Test-1898407032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-919b539a-8a33-409c-ac21-2b03eba4630f tempest-GroupsV320Test-1898407032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:00 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-919b539a-8a33-409c-ac21-2b03eba4630f tempest-GroupsV320Test-1898407032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:16:00 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-919b539a-8a33-409c-ac21-2b03eba4630f tempest-GroupsV320Test-1898407032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:16:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-919b539a-8a33-409c-ac21-2b03eba4630f tempest-GroupsV320Test-1898407032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-919b539a-8a33-409c-ac21-2b03eba4630f tempest-GroupsV320Test-1898407032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:00 devstack sudo[93799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:16:00 devstack sudo[93799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:00 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-18c0de92-ba11-4a50-aba2-589e29fa8c2f tempest-VolumesSnapshotTestJSON-1723175258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:16:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-18c0de92-ba11-4a50-aba2-589e29fa8c2f tempest-VolumesSnapshotTestJSON-1723175258 None] Flow 'volume_create_manager' (593e4138-5134-49ff-82d5-c67c6b9f6b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:16:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-18c0de92-ba11-4a50-aba2-589e29fa8c2f tempest-VolumesSnapshotTestJSON-1723175258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2323420f-50d4-43d4-9783-ceee1691969d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-18c0de92-ba11-4a50-aba2-589e29fa8c2f tempest-VolumesSnapshotTestJSON-1723175258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2323420f-50d4-43d4-9783-ceee1691969d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:16:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2072770394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fc72228-50e2-44f2-a164-980228386d4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf7cafdac732417c8e137325cfbd0195',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:01Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=37f1b613-758c-4755-9217-5353b1609300,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:01Z,use_quota=True,user_id='2f5c64ce686b4e50896d496f23e2a61f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-18c0de92-ba11-4a50-aba2-589e29fa8c2f tempest-VolumesSnapshotTestJSON-1723175258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11c005c6-0ea3-4902-9dc6-094a5d2265c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-18c0de92-ba11-4a50-aba2-589e29fa8c2f tempest-VolumesSnapshotTestJSON-1723175258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11c005c6-0ea3-4902-9dc6-094a5d2265c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-18c0de92-ba11-4a50-aba2-589e29fa8c2f tempest-VolumesSnapshotTestJSON-1723175258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1a3857e-878d-45e1-90f1-41afd77f0cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-18c0de92-ba11-4a50-aba2-589e29fa8c2f tempest-VolumesSnapshotTestJSON-1723175258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1a3857e-878d-45e1-90f1-41afd77f0cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3fc72228-50e2-44f2-a164-980228386d4b', 'volume_name': 'volume-3fc72228-50e2-44f2-a164-980228386d4b', 'volume_size': 2, 'snapshot_id': '37f1b613-758c-4755-9217-5353b1609300'}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-18c0de92-ba11-4a50-aba2-589e29fa8c2f tempest-VolumesSnapshotTestJSON-1723175258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0953bf7a-c3a4-4151-b790-0a912f7f1527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-18c0de92-ba11-4a50-aba2-589e29fa8c2f tempest-VolumesSnapshotTestJSON-1723175258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0953bf7a-c3a4-4151-b790-0a912f7f1527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-18c0de92-ba11-4a50-aba2-589e29fa8c2f tempest-VolumesSnapshotTestJSON-1723175258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3673873d-5041-4e54-b356-fa45c6a63198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:01 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-18c0de92-ba11-4a50-aba2-589e29fa8c2f tempest-VolumesSnapshotTestJSON-1723175258 None] Volume 3fc72228-50e2-44f2-a164-980228386d4b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3fc72228-50e2-44f2-a164-980228386d4b', 'volume_size': 2, 'snapshot_id': '37f1b613-758c-4755-9217-5353b1609300'} Sep 23 00:16:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-18c0de92-ba11-4a50-aba2-589e29fa8c2f tempest-VolumesSnapshotTestJSON-1723175258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-18c0de92-ba11-4a50-aba2-589e29fa8c2f tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:01 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-18c0de92-ba11-4a50-aba2-589e29fa8c2f tempest-VolumesSnapshotTestJSON-1723175258 None] Acquiring lock "cinder-quobyte-37f1b613-758c-4755-9217-5353b1609300-3fc72228-50e2-44f2-a164-980228386d4b" by "_create_volume_from_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:01 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-18c0de92-ba11-4a50-aba2-589e29fa8c2f tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "cinder-quobyte-37f1b613-758c-4755-9217-5353b1609300-3fc72228-50e2-44f2-a164-980228386d4b" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-18c0de92-ba11-4a50-aba2-589e29fa8c2f tempest-VolumesSnapshotTestJSON-1723175258 None] Creating volume 3fc72228-50e2-44f2-a164-980228386d4b from snapshot 37f1b613-758c-4755-9217-5353b1609300 {{(pid=86591) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 00:16:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-18c0de92-ba11-4a50-aba2-589e29fa8c2f tempest-VolumesSnapshotTestJSON-1723175258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-18c0de92-ba11-4a50-aba2-589e29fa8c2f tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-18c0de92-ba11-4a50-aba2-589e29fa8c2f tempest-VolumesSnapshotTestJSON-1723175258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:16:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-18c0de92-ba11-4a50-aba2-589e29fa8c2f tempest-VolumesSnapshotTestJSON-1723175258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:16:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-18c0de92-ba11-4a50-aba2-589e29fa8c2f tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-18c0de92-ba11-4a50-aba2-589e29fa8c2f tempest-VolumesSnapshotTestJSON-1723175258 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:16:01 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-18c0de92-ba11-4a50-aba2-589e29fa8c2f tempest-VolumesSnapshotTestJSON-1723175258 None] Acquiring lock "cinder-quobyte-3fc72228-50e2-44f2-a164-980228386d4b" by "_copy_volume_from_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:01 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-18c0de92-ba11-4a50-aba2-589e29fa8c2f tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "cinder-quobyte-3fc72228-50e2-44f2-a164-980228386d4b" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-18c0de92-ba11-4a50-aba2-589e29fa8c2f tempest-VolumesSnapshotTestJSON-1723175258 None] snapshot: 37f1b613-758c-4755-9217-5353b1609300, volume: 3fc72228-50e2-44f2-a164-980228386d4b, {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:16:01 devstack sudo[93799]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-18c0de92-ba11-4a50-aba2-589e29fa8c2f tempest-VolumesSnapshotTestJSON-1723175258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-18c0de92-ba11-4a50-aba2-589e29fa8c2f tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-18c0de92-ba11-4a50-aba2-589e29fa8c2f tempest-VolumesSnapshotTestJSON-1723175258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:16:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-18c0de92-ba11-4a50-aba2-589e29fa8c2f tempest-VolumesSnapshotTestJSON-1723175258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:16:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-18c0de92-ba11-4a50-aba2-589e29fa8c2f tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-919b539a-8a33-409c-ac21-2b03eba4630f tempest-GroupsV320Test-1898407032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.689s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:01 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-919b539a-8a33-409c-ac21-2b03eba4630f tempest-GroupsV320Test-1898407032 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:16:01 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-919b539a-8a33-409c-ac21-2b03eba4630f tempest-GroupsV320Test-1898407032 None] Delete group completed successfully. Sep 23 00:16:01 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5d6da3-9eff-4e3f-a3ad-f67dca907745]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-18c0de92-ba11-4a50-aba2-589e29fa8c2f tempest-VolumesSnapshotTestJSON-1723175258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b04c68a9-ed43-4961-aac7-800c94def5cc.37f1b613-758c-4755-9217-5353b1609300 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:01 devstack sudo[93804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b04c68a9-ed43-4961-aac7-800c94def5cc.37f1b613-758c-4755-9217-5353b1609300 Sep 23 00:16:01 devstack sudo[93804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:02 devstack sudo[93804]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-18c0de92-ba11-4a50-aba2-589e29fa8c2f tempest-VolumesSnapshotTestJSON-1723175258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b04c68a9-ed43-4961-aac7-800c94def5cc.37f1b613-758c-4755-9217-5353b1609300" returned: 0 in 0.921s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:02 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-18c0de92-ba11-4a50-aba2-589e29fa8c2f tempest-VolumesSnapshotTestJSON-1723175258 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b04c68a9-ed43-4961-aac7-800c94def5cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:16:02 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b84f3a-b852-47a4-ae89-4d865253e2b8]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-18c0de92-ba11-4a50-aba2-589e29fa8c2f tempest-VolumesSnapshotTestJSON-1723175258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b04c68a9-ed43-4961-aac7-800c94def5cc {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:02 devstack sudo[93810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b04c68a9-ed43-4961-aac7-800c94def5cc Sep 23 00:16:02 devstack sudo[93810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:03 devstack sudo[93810]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-18c0de92-ba11-4a50-aba2-589e29fa8c2f tempest-VolumesSnapshotTestJSON-1723175258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b04c68a9-ed43-4961-aac7-800c94def5cc" returned: 0 in 0.646s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:03 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-18c0de92-ba11-4a50-aba2-589e29fa8c2f tempest-VolumesSnapshotTestJSON-1723175258 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b04c68a9-ed43-4961-aac7-800c94def5cc {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:16:03 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-18c0de92-ba11-4a50-aba2-589e29fa8c2f tempest-VolumesSnapshotTestJSON-1723175258 None] Creating direct copy from snapshot {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:16:03 devstack cinder-volume[86591]: DEBUG cinder.utils [None req-18c0de92-ba11-4a50-aba2-589e29fa8c2f tempest-VolumesSnapshotTestJSON-1723175258 None] Path /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fc72228-50e2-44f2-a164-980228386d4b not found in is_blk_device check {{(pid=86591) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:16:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-18c0de92-ba11-4a50-aba2-589e29fa8c2f tempest-VolumesSnapshotTestJSON-1723175258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b04c68a9-ed43-4961-aac7-800c94def5cc /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fc72228-50e2-44f2-a164-980228386d4b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:03 devstack sudo[93816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b04c68a9-ed43-4961-aac7-800c94def5cc /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fc72228-50e2-44f2-a164-980228386d4b Sep 23 00:16:03 devstack sudo[93816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:11 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:UPDATE=86,cinder:SELECT=92,cinder:DELETE=5,cinder:INSERT=17 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:16:11 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:UPDATE=82,cinder:DELETE=5,cinder:SELECT=97,cinder:INSERT=18 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:16:16 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:16:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:16:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:16:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:16 devstack sudo[93816]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-18c0de92-ba11-4a50-aba2-589e29fa8c2f tempest-VolumesSnapshotTestJSON-1723175258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b04c68a9-ed43-4961-aac7-800c94def5cc /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fc72228-50e2-44f2-a164-980228386d4b" returned: 0 in 13.602s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:16 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-18c0de92-ba11-4a50-aba2-589e29fa8c2f tempest-VolumesSnapshotTestJSON-1723175258 None] Image conversion details: src /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b04c68a9-ed43-4961-aac7-800c94def5cc, size 1024.00 MB, duration 13.60 sec, destination /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fc72228-50e2-44f2-a164-980228386d4b {{(pid=86591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:16:16 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-18c0de92-ba11-4a50-aba2-589e29fa8c2f tempest-VolumesSnapshotTestJSON-1723175258 None] Converted 1024.00 MB image at 75.27 MB/s Sep 23 00:16:16 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-18c0de92-ba11-4a50-aba2-589e29fa8c2f tempest-VolumesSnapshotTestJSON-1723175258 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fc72228-50e2-44f2-a164-980228386d4b is being set with open permissions: ugo+rw Sep 23 00:16:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-18c0de92-ba11-4a50-aba2-589e29fa8c2f tempest-VolumesSnapshotTestJSON-1723175258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fc72228-50e2-44f2-a164-980228386d4b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:16 devstack sudo[93903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:16:16 devstack sudo[93903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:16 devstack sudo[93904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fc72228-50e2-44f2-a164-980228386d4b Sep 23 00:16:16 devstack sudo[93904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:17 devstack sudo[93903]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.357s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:17 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:16:17 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running periodic task VolumeManager._thread_info {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:16:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] thread count: 29 {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:16:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] thread info: [<_MainThread(MainThread, started 135440660459648)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:16:17 devstack sudo[93904]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-18c0de92-ba11-4a50-aba2-589e29fa8c2f tempest-VolumesSnapshotTestJSON-1723175258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fc72228-50e2-44f2-a164-980228386d4b" returned: 0 in 0.426s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-18c0de92-ba11-4a50-aba2-589e29fa8c2f tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "cinder-quobyte-3fc72228-50e2-44f2-a164-980228386d4b" released by "_copy_volume_from_snapshot" :: held 15.809s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-18c0de92-ba11-4a50-aba2-589e29fa8c2f tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "cinder-quobyte-37f1b613-758c-4755-9217-5353b1609300-3fc72228-50e2-44f2-a164-980228386d4b" released by "_create_volume_from_snapshot" :: held 15.912s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-18c0de92-ba11-4a50-aba2-589e29fa8c2f tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 15.947s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-18c0de92-ba11-4a50-aba2-589e29fa8c2f tempest-VolumesSnapshotTestJSON-1723175258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3673873d-5041-4e54-b356-fa45c6a63198) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fc72228-50e2-44f2-a164-980228386d4b', 'volume_size': 2, 'snapshot_id': '37f1b613-758c-4755-9217-5353b1609300'}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-18c0de92-ba11-4a50-aba2-589e29fa8c2f tempest-VolumesSnapshotTestJSON-1723175258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f960bfda-1dae-4177-917e-f40a5f3190cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:17 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-18c0de92-ba11-4a50-aba2-589e29fa8c2f tempest-VolumesSnapshotTestJSON-1723175258 None] Volume volume-3fc72228-50e2-44f2-a164-980228386d4b (3fc72228-50e2-44f2-a164-980228386d4b): created successfully Sep 23 00:16:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-18c0de92-ba11-4a50-aba2-589e29fa8c2f tempest-VolumesSnapshotTestJSON-1723175258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f960bfda-1dae-4177-917e-f40a5f3190cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-18c0de92-ba11-4a50-aba2-589e29fa8c2f tempest-VolumesSnapshotTestJSON-1723175258 None] Flow 'volume_create_manager' (593e4138-5134-49ff-82d5-c67c6b9f6b07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:16:17 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-18c0de92-ba11-4a50-aba2-589e29fa8c2f tempest-VolumesSnapshotTestJSON-1723175258 None] Created volume successfully. Sep 23 00:16:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-63b03356-0eed-4a0a-afd8-98757bfd11f4 tempest-VolumesSnapshotTestJSON-1723175258 None] Acquiring lock "cinder-3fc72228-50e2-44f2-a164-980228386d4b-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-63b03356-0eed-4a0a-afd8-98757bfd11f4 tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "cinder-3fc72228-50e2-44f2-a164-980228386d4b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-63b03356-0eed-4a0a-afd8-98757bfd11f4 tempest-VolumesSnapshotTestJSON-1723175258 None] Acquiring lock "cinder-quobyte-3fc72228-50e2-44f2-a164-980228386d4b" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-63b03356-0eed-4a0a-afd8-98757bfd11f4 tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "cinder-quobyte-3fc72228-50e2-44f2-a164-980228386d4b" acquired by "delete_volume" :: waited 0.018s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:17 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5eccb7-ab10-4314-975b-c71af6877806]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-63b03356-0eed-4a0a-afd8-98757bfd11f4 tempest-VolumesSnapshotTestJSON-1723175258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fc72228-50e2-44f2-a164-980228386d4b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:18 devstack sudo[93909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fc72228-50e2-44f2-a164-980228386d4b Sep 23 00:16:18 devstack sudo[93909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:18 devstack sudo[93909]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-63b03356-0eed-4a0a-afd8-98757bfd11f4 tempest-VolumesSnapshotTestJSON-1723175258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fc72228-50e2-44f2-a164-980228386d4b" returned: 0 in 0.602s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-63b03356-0eed-4a0a-afd8-98757bfd11f4 tempest-VolumesSnapshotTestJSON-1723175258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fc72228-50e2-44f2-a164-980228386d4b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:18 devstack sudo[93914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fc72228-50e2-44f2-a164-980228386d4b Sep 23 00:16:18 devstack sudo[93914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:18 devstack sudo[93914]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-63b03356-0eed-4a0a-afd8-98757bfd11f4 tempest-VolumesSnapshotTestJSON-1723175258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fc72228-50e2-44f2-a164-980228386d4b" returned: 0 in 0.337s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-63b03356-0eed-4a0a-afd8-98757bfd11f4 tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "cinder-quobyte-3fc72228-50e2-44f2-a164-980228386d4b" released by "delete_volume" :: held 1.003s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:18 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-63b03356-0eed-4a0a-afd8-98757bfd11f4 tempest-VolumesSnapshotTestJSON-1723175258 None] Created reservations ['e81b8e3d-acb7-4423-b092-7fcc399a661d', '41f8cf8d-3e80-4848-9484-4808321b9368', 'f036567f-548e-45d7-942f-86aaa47e3aa6', 'a7ab7df7-d382-40d0-9b89-9ebfac22e83d'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:16:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-63b03356-0eed-4a0a-afd8-98757bfd11f4 tempest-VolumesSnapshotTestJSON-1723175258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-63b03356-0eed-4a0a-afd8-98757bfd11f4 tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:18 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-63b03356-0eed-4a0a-afd8-98757bfd11f4 tempest-VolumesSnapshotTestJSON-1723175258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:16:18 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-63b03356-0eed-4a0a-afd8-98757bfd11f4 tempest-VolumesSnapshotTestJSON-1723175258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:16:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-63b03356-0eed-4a0a-afd8-98757bfd11f4 tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-63b03356-0eed-4a0a-afd8-98757bfd11f4 tempest-VolumesSnapshotTestJSON-1723175258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:19 devstack sudo[93917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:16:19 devstack sudo[93917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:19 devstack sudo[93917]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-63b03356-0eed-4a0a-afd8-98757bfd11f4 tempest-VolumesSnapshotTestJSON-1723175258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.358s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:19 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-63b03356-0eed-4a0a-afd8-98757bfd11f4 tempest-VolumesSnapshotTestJSON-1723175258 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:16:19 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-63b03356-0eed-4a0a-afd8-98757bfd11f4 tempest-VolumesSnapshotTestJSON-1723175258 None] Deleted volume successfully. Sep 23 00:16:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-63b03356-0eed-4a0a-afd8-98757bfd11f4 tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "cinder-3fc72228-50e2-44f2-a164-980228386d4b-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:19 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f3cda1c-ca35-4bdc-8aa0-d6520092d88e tempest-SnapshotsActionsTest-1089900372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:16:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9f3cda1c-ca35-4bdc-8aa0-d6520092d88e tempest-SnapshotsActionsTest-1089900372 None] Flow 'volume_create_manager' (1bee6201-6e3f-4562-ae47-8166df4eef15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:16:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9f3cda1c-ca35-4bdc-8aa0-d6520092d88e tempest-SnapshotsActionsTest-1089900372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10dfc231-0226-4f5a-93db-355c087e28bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9f3cda1c-ca35-4bdc-8aa0-d6520092d88e tempest-SnapshotsActionsTest-1089900372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10dfc231-0226-4f5a-93db-355c087e28bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:16:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1135189711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff12e24b-1371-4c6d-80ae-f7902f3c6373,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5449f983a1394fe89cb60c85fc78d1b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:20Z,use_quota=True,user_id='f48531233adc4f92ab6f8ad9e95f11ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9f3cda1c-ca35-4bdc-8aa0-d6520092d88e tempest-SnapshotsActionsTest-1089900372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f35d6aa-da48-415e-918f-227f1f78a893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9f3cda1c-ca35-4bdc-8aa0-d6520092d88e tempest-SnapshotsActionsTest-1089900372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f35d6aa-da48-415e-918f-227f1f78a893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9f3cda1c-ca35-4bdc-8aa0-d6520092d88e tempest-SnapshotsActionsTest-1089900372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6641741a-b9f0-4bee-bf76-4d8b0c4b998c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9f3cda1c-ca35-4bdc-8aa0-d6520092d88e tempest-SnapshotsActionsTest-1089900372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6641741a-b9f0-4bee-bf76-4d8b0c4b998c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff12e24b-1371-4c6d-80ae-f7902f3c6373', 'volume_name': 'volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9f3cda1c-ca35-4bdc-8aa0-d6520092d88e tempest-SnapshotsActionsTest-1089900372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cbf00f3-c566-4c05-905e-933a0ef8a1ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9f3cda1c-ca35-4bdc-8aa0-d6520092d88e tempest-SnapshotsActionsTest-1089900372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cbf00f3-c566-4c05-905e-933a0ef8a1ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9f3cda1c-ca35-4bdc-8aa0-d6520092d88e tempest-SnapshotsActionsTest-1089900372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (954bebf1-4e0d-4ae9-b459-34ac03976b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:20 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-9f3cda1c-ca35-4bdc-8aa0-d6520092d88e tempest-SnapshotsActionsTest-1089900372 None] Volume ff12e24b-1371-4c6d-80ae-f7902f3c6373: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373', 'volume_size': 1} Sep 23 00:16:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9f3cda1c-ca35-4bdc-8aa0-d6520092d88e tempest-SnapshotsActionsTest-1089900372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9f3cda1c-ca35-4bdc-8aa0-d6520092d88e tempest-SnapshotsActionsTest-1089900372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:20 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9f3cda1c-ca35-4bdc-8aa0-d6520092d88e tempest-SnapshotsActionsTest-1089900372 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:16:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1135189711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff12e24b-1371-4c6d-80ae-f7902f3c6373,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5449f983a1394fe89cb60c85fc78d1b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:20Z,use_quota=True,user_id='f48531233adc4f92ab6f8ad9e95f11ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:16:20 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-9f3cda1c-ca35-4bdc-8aa0-d6520092d88e tempest-SnapshotsActionsTest-1089900372 None] Creating volume ff12e24b-1371-4c6d-80ae-f7902f3c6373 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:16:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9f3cda1c-ca35-4bdc-8aa0-d6520092d88e tempest-SnapshotsActionsTest-1089900372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9f3cda1c-ca35-4bdc-8aa0-d6520092d88e tempest-SnapshotsActionsTest-1089900372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:20 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9f3cda1c-ca35-4bdc-8aa0-d6520092d88e tempest-SnapshotsActionsTest-1089900372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:16:20 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9f3cda1c-ca35-4bdc-8aa0-d6520092d88e tempest-SnapshotsActionsTest-1089900372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:16:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9f3cda1c-ca35-4bdc-8aa0-d6520092d88e tempest-SnapshotsActionsTest-1089900372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:20 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9f3cda1c-ca35-4bdc-8aa0-d6520092d88e tempest-SnapshotsActionsTest-1089900372 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:16:20 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-9f3cda1c-ca35-4bdc-8aa0-d6520092d88e tempest-SnapshotsActionsTest-1089900372 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:16:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9f3cda1c-ca35-4bdc-8aa0-d6520092d88e tempest-SnapshotsActionsTest-1089900372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:20 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-af8e0988-f50c-4c40-bf1e-5bc2c6f06d76 tempest-VolumesSnapshotTestJSON-1723175258 None] Acquiring lock "cinder-37f1b613-758c-4755-9217-5353b1609300-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:20 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-af8e0988-f50c-4c40-bf1e-5bc2c6f06d76 tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "cinder-37f1b613-758c-4755-9217-5353b1609300-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:20 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-af8e0988-f50c-4c40-bf1e-5bc2c6f06d76 tempest-VolumesSnapshotTestJSON-1723175258 None] Acquiring lock "cinder-quobyte-b04c68a9-ed43-4961-aac7-800c94def5cc" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:20 devstack sudo[93920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373 1073741824 Sep 23 00:16:20 devstack sudo[93920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:20 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-af8e0988-f50c-4c40-bf1e-5bc2c6f06d76 tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "cinder-quobyte-b04c68a9-ed43-4961-aac7-800c94def5cc" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:20 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-af8e0988-f50c-4c40-bf1e-5bc2c6f06d76 tempest-VolumesSnapshotTestJSON-1723175258 None] Acquiring lock "cinder-quobyte-37f1b613-758c-4755-9217-5353b1609300" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:20 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-af8e0988-f50c-4c40-bf1e-5bc2c6f06d76 tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "cinder-quobyte-37f1b613-758c-4755-9217-5353b1609300" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:20 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-af8e0988-f50c-4c40-bf1e-5bc2c6f06d76 tempest-VolumesSnapshotTestJSON-1723175258 None] Deleting offline snapshot 37f1b613-758c-4755-9217-5353b1609300 of volume b04c68a9-ed43-4961-aac7-800c94def5cc {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:16:20 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-af8e0988-f50c-4c40-bf1e-5bc2c6f06d76 tempest-VolumesSnapshotTestJSON-1723175258 None] snapshot_file for this snap is: volume-b04c68a9-ed43-4961-aac7-800c94def5cc.37f1b613-758c-4755-9217-5353b1609300 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:16:20 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2fa6c91-493e-4522-8881-9b9c2c2a573e]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-af8e0988-f50c-4c40-bf1e-5bc2c6f06d76 tempest-VolumesSnapshotTestJSON-1723175258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b04c68a9-ed43-4961-aac7-800c94def5cc.37f1b613-758c-4755-9217-5353b1609300 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:20 devstack sudo[93922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b04c68a9-ed43-4961-aac7-800c94def5cc.37f1b613-758c-4755-9217-5353b1609300 Sep 23 00:16:20 devstack sudo[93922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:20 devstack sudo[93920]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9f3cda1c-ca35-4bdc-8aa0-d6520092d88e tempest-SnapshotsActionsTest-1089900372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373 1073741824" returned: 0 in 0.665s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:20 devstack sudo[93922]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-af8e0988-f50c-4c40-bf1e-5bc2c6f06d76 tempest-VolumesSnapshotTestJSON-1723175258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b04c68a9-ed43-4961-aac7-800c94def5cc.37f1b613-758c-4755-9217-5353b1609300" returned: 0 in 0.536s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:20 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-af8e0988-f50c-4c40-bf1e-5bc2c6f06d76 tempest-VolumesSnapshotTestJSON-1723175258 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b04c68a9-ed43-4961-aac7-800c94def5cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:16:20 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f0f6c4-c344-47c9-99c5-97f44bdaec42]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-af8e0988-f50c-4c40-bf1e-5bc2c6f06d76 tempest-VolumesSnapshotTestJSON-1723175258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b04c68a9-ed43-4961-aac7-800c94def5cc {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9f3cda1c-ca35-4bdc-8aa0-d6520092d88e tempest-SnapshotsActionsTest-1089900372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:20 devstack sudo[93932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373 Sep 23 00:16:20 devstack sudo[93932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:21 devstack sudo[93931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b04c68a9-ed43-4961-aac7-800c94def5cc Sep 23 00:16:21 devstack sudo[93931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:21 devstack sudo[93932]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9f3cda1c-ca35-4bdc-8aa0-d6520092d88e tempest-SnapshotsActionsTest-1089900372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373" returned: 0 in 0.438s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:21 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9f3cda1c-ca35-4bdc-8aa0-d6520092d88e tempest-SnapshotsActionsTest-1089900372 None] <== create_volume: return (1227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:16:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9f3cda1c-ca35-4bdc-8aa0-d6520092d88e tempest-SnapshotsActionsTest-1089900372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.230s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9f3cda1c-ca35-4bdc-8aa0-d6520092d88e tempest-SnapshotsActionsTest-1089900372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (954bebf1-4e0d-4ae9-b459-34ac03976b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9f3cda1c-ca35-4bdc-8aa0-d6520092d88e tempest-SnapshotsActionsTest-1089900372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50a63516-79b9-4b14-b932-58f31c196294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:21 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-9f3cda1c-ca35-4bdc-8aa0-d6520092d88e tempest-SnapshotsActionsTest-1089900372 None] Volume volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373 (ff12e24b-1371-4c6d-80ae-f7902f3c6373): created successfully Sep 23 00:16:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9f3cda1c-ca35-4bdc-8aa0-d6520092d88e tempest-SnapshotsActionsTest-1089900372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50a63516-79b9-4b14-b932-58f31c196294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9f3cda1c-ca35-4bdc-8aa0-d6520092d88e tempest-SnapshotsActionsTest-1089900372 None] Flow 'volume_create_manager' (1bee6201-6e3f-4562-ae47-8166df4eef15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:16:21 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-9f3cda1c-ca35-4bdc-8aa0-d6520092d88e tempest-SnapshotsActionsTest-1089900372 None] Created volume successfully. Sep 23 00:16:21 devstack sudo[93931]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-af8e0988-f50c-4c40-bf1e-5bc2c6f06d76 tempest-VolumesSnapshotTestJSON-1723175258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b04c68a9-ed43-4961-aac7-800c94def5cc" returned: 0 in 0.780s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-af8e0988-f50c-4c40-bf1e-5bc2c6f06d76 tempest-VolumesSnapshotTestJSON-1723175258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b04c68a9-ed43-4961-aac7-800c94def5cc.37f1b613-758c-4755-9217-5353b1609300 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:21 devstack sudo[93939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b04c68a9-ed43-4961-aac7-800c94def5cc.37f1b613-758c-4755-9217-5353b1609300 Sep 23 00:16:21 devstack sudo[93939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:22 devstack sudo[93939]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-af8e0988-f50c-4c40-bf1e-5bc2c6f06d76 tempest-VolumesSnapshotTestJSON-1723175258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b04c68a9-ed43-4961-aac7-800c94def5cc.37f1b613-758c-4755-9217-5353b1609300" returned: 0 in 0.534s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-af8e0988-f50c-4c40-bf1e-5bc2c6f06d76 tempest-VolumesSnapshotTestJSON-1723175258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b04c68a9-ed43-4961-aac7-800c94def5cc.37f1b613-758c-4755-9217-5353b1609300 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:22 devstack sudo[93944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b04c68a9-ed43-4961-aac7-800c94def5cc.37f1b613-758c-4755-9217-5353b1609300 Sep 23 00:16:22 devstack sudo[93944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-aaf76051-eb8c-4780-b66e-cb9652e7a46b tempest-SnapshotsActionsTest-1089900372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-aaf76051-eb8c-4780-b66e-cb9652e7a46b tempest-SnapshotsActionsTest-1089900372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:22 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-aaf76051-eb8c-4780-b66e-cb9652e7a46b tempest-SnapshotsActionsTest-1089900372 None] Creating offline snapshot f03e245d-7359-4b78-9102-891b4c3dae62 of volume ff12e24b-1371-4c6d-80ae-f7902f3c6373 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:16:22 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa360590-2cc8-4d9b-bc30-d7e138b52aad]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-aaf76051-eb8c-4780-b66e-cb9652e7a46b tempest-SnapshotsActionsTest-1089900372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:22 devstack sudo[93944]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-af8e0988-f50c-4c40-bf1e-5bc2c6f06d76 tempest-VolumesSnapshotTestJSON-1723175258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b04c68a9-ed43-4961-aac7-800c94def5cc.37f1b613-758c-4755-9217-5353b1609300" returned: 0 in 0.435s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:22 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-af8e0988-f50c-4c40-bf1e-5bc2c6f06d76 tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "cinder-quobyte-37f1b613-758c-4755-9217-5353b1609300" released by "_delete_snapshot" :: held 2.482s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:22 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-af8e0988-f50c-4c40-bf1e-5bc2c6f06d76 tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "cinder-quobyte-b04c68a9-ed43-4961-aac7-800c94def5cc" released by "delete_snapshot" :: held 2.526s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:22 devstack sudo[93947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373 Sep 23 00:16:22 devstack sudo[93947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:22 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-af8e0988-f50c-4c40-bf1e-5bc2c6f06d76 tempest-VolumesSnapshotTestJSON-1723175258 None] Created reservations ['e83b5583-fc02-40d2-a8c3-686f85dd7445', '8300a956-8fce-439c-8aa1-b8867e468c1f', '8632f493-d30f-4d06-b15f-beba2596cfc0', 'ecd05caa-2b21-478d-87e8-8bafb90b0d29'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:16:22 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-af8e0988-f50c-4c40-bf1e-5bc2c6f06d76 tempest-VolumesSnapshotTestJSON-1723175258 None] Delete snapshot completed successfully. Sep 23 00:16:22 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-af8e0988-f50c-4c40-bf1e-5bc2c6f06d76 tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "cinder-37f1b613-758c-4755-9217-5353b1609300-delete_snapshot" released by "delete_snapshot" :: held 2.767s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:23 devstack sudo[93947]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-aaf76051-eb8c-4780-b66e-cb9652e7a46b tempest-SnapshotsActionsTest-1089900372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373" returned: 0 in 0.554s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-aaf76051-eb8c-4780-b66e-cb9652e7a46b tempest-SnapshotsActionsTest-1089900372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.f03e245d-7359-4b78-9102-891b4c3dae62 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:23 devstack sudo[93952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.f03e245d-7359-4b78-9102-891b4c3dae62 1G Sep 23 00:16:23 devstack sudo[93952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:23 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ebccc161-e317-4771-a15b-dfc1f13a6457 tempest-VolumesSnapshotTestJSON-1723175258 None] Acquiring lock "cinder-b04c68a9-ed43-4961-aac7-800c94def5cc-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:23 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ebccc161-e317-4771-a15b-dfc1f13a6457 tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "cinder-b04c68a9-ed43-4961-aac7-800c94def5cc-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:23 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ebccc161-e317-4771-a15b-dfc1f13a6457 tempest-VolumesSnapshotTestJSON-1723175258 None] Acquiring lock "cinder-quobyte-b04c68a9-ed43-4961-aac7-800c94def5cc" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:23 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ebccc161-e317-4771-a15b-dfc1f13a6457 tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "cinder-quobyte-b04c68a9-ed43-4961-aac7-800c94def5cc" acquired by "delete_volume" :: waited 0.026s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:23 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c04414-edb2-4ba6-9dd0-271966095c8b]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ebccc161-e317-4771-a15b-dfc1f13a6457 tempest-VolumesSnapshotTestJSON-1723175258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b04c68a9-ed43-4961-aac7-800c94def5cc {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:23 devstack sudo[93952]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-aaf76051-eb8c-4780-b66e-cb9652e7a46b tempest-SnapshotsActionsTest-1089900372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.f03e245d-7359-4b78-9102-891b4c3dae62 1G" returned: 0 in 0.716s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-aaf76051-eb8c-4780-b66e-cb9652e7a46b tempest-SnapshotsActionsTest-1089900372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.f03e245d-7359-4b78-9102-891b4c3dae62 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:23 devstack sudo[93962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.f03e245d-7359-4b78-9102-891b4c3dae62 Sep 23 00:16:23 devstack sudo[93962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:23 devstack sudo[93960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b04c68a9-ed43-4961-aac7-800c94def5cc Sep 23 00:16:23 devstack sudo[93960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:24 devstack sudo[93962]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-aaf76051-eb8c-4780-b66e-cb9652e7a46b tempest-SnapshotsActionsTest-1089900372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.f03e245d-7359-4b78-9102-891b4c3dae62" returned: 0 in 0.419s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:24 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-aaf76051-eb8c-4780-b66e-cb9652e7a46b tempest-SnapshotsActionsTest-1089900372 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.f03e245d-7359-4b78-9102-891b4c3dae62 is being set with open permissions: ugo+rw Sep 23 00:16:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-aaf76051-eb8c-4780-b66e-cb9652e7a46b tempest-SnapshotsActionsTest-1089900372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.f03e245d-7359-4b78-9102-891b4c3dae62 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:24 devstack sudo[93971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.f03e245d-7359-4b78-9102-891b4c3dae62 Sep 23 00:16:24 devstack sudo[93971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:24 devstack sudo[93960]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ebccc161-e317-4771-a15b-dfc1f13a6457 tempest-VolumesSnapshotTestJSON-1723175258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b04c68a9-ed43-4961-aac7-800c94def5cc" returned: 0 in 0.582s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ebccc161-e317-4771-a15b-dfc1f13a6457 tempest-VolumesSnapshotTestJSON-1723175258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b04c68a9-ed43-4961-aac7-800c94def5cc {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:24 devstack sudo[93973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b04c68a9-ed43-4961-aac7-800c94def5cc Sep 23 00:16:24 devstack sudo[93973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:24 devstack sudo[93971]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-aaf76051-eb8c-4780-b66e-cb9652e7a46b tempest-SnapshotsActionsTest-1089900372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.f03e245d-7359-4b78-9102-891b4c3dae62" returned: 0 in 0.328s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-aaf76051-eb8c-4780-b66e-cb9652e7a46b tempest-SnapshotsActionsTest-1089900372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:24 devstack sudo[93973]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ebccc161-e317-4771-a15b-dfc1f13a6457 tempest-VolumesSnapshotTestJSON-1723175258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b04c68a9-ed43-4961-aac7-800c94def5cc" returned: 0 in 0.357s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:24 devstack sudo[93978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.info Sep 23 00:16:24 devstack sudo[93978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:24 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ebccc161-e317-4771-a15b-dfc1f13a6457 tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "cinder-quobyte-b04c68a9-ed43-4961-aac7-800c94def5cc" released by "delete_volume" :: held 1.060s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:24 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-ebccc161-e317-4771-a15b-dfc1f13a6457 tempest-VolumesSnapshotTestJSON-1723175258 None] Created reservations ['41947220-cbe7-4807-939b-9d5768a19e4b', 'e779a44e-2b14-41d8-8c15-2d686824136a', '3c535a81-2668-474c-80c0-7d826d559ffd', 'db1be86c-3cbb-48e0-bbbe-f6f5424b3d92'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:16:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ebccc161-e317-4771-a15b-dfc1f13a6457 tempest-VolumesSnapshotTestJSON-1723175258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ebccc161-e317-4771-a15b-dfc1f13a6457 tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:24 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ebccc161-e317-4771-a15b-dfc1f13a6457 tempest-VolumesSnapshotTestJSON-1723175258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:16:24 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ebccc161-e317-4771-a15b-dfc1f13a6457 tempest-VolumesSnapshotTestJSON-1723175258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:16:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ebccc161-e317-4771-a15b-dfc1f13a6457 tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ebccc161-e317-4771-a15b-dfc1f13a6457 tempest-VolumesSnapshotTestJSON-1723175258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:24 devstack sudo[93981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:16:24 devstack sudo[93981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:24 devstack sudo[93978]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-aaf76051-eb8c-4780-b66e-cb9652e7a46b tempest-SnapshotsActionsTest-1089900372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.info" returned: 0 in 0.344s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:24 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-aaf76051-eb8c-4780-b66e-cb9652e7a46b tempest-SnapshotsActionsTest-1089900372 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.info is being set with open permissions: ugo+rw Sep 23 00:16:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-aaf76051-eb8c-4780-b66e-cb9652e7a46b tempest-SnapshotsActionsTest-1089900372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:25 devstack sudo[93983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.info Sep 23 00:16:25 devstack sudo[93983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:25 devstack sudo[93981]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ebccc161-e317-4771-a15b-dfc1f13a6457 tempest-VolumesSnapshotTestJSON-1723175258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.365s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:25 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-ebccc161-e317-4771-a15b-dfc1f13a6457 tempest-VolumesSnapshotTestJSON-1723175258 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:16:25 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-ebccc161-e317-4771-a15b-dfc1f13a6457 tempest-VolumesSnapshotTestJSON-1723175258 None] Deleted volume successfully. Sep 23 00:16:25 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ebccc161-e317-4771-a15b-dfc1f13a6457 tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "cinder-b04c68a9-ed43-4961-aac7-800c94def5cc-delete_volume" released by "delete_volume" :: held 1.784s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:25 devstack sudo[93983]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-aaf76051-eb8c-4780-b66e-cb9652e7a46b tempest-SnapshotsActionsTest-1089900372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.info" returned: 0 in 0.388s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-aaf76051-eb8c-4780-b66e-cb9652e7a46b tempest-SnapshotsActionsTest-1089900372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.908s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:25 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-aaf76051-eb8c-4780-b66e-cb9652e7a46b tempest-SnapshotsActionsTest-1089900372 None] Create snapshot completed successfully Sep 23 00:16:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-688bc275-dc89-48d1-8fec-099fee5aa4f3 tempest-SnapshotsActionsTest-1089900372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-688bc275-dc89-48d1-8fec-099fee5aa4f3 tempest-SnapshotsActionsTest-1089900372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:26 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-688bc275-dc89-48d1-8fec-099fee5aa4f3 tempest-SnapshotsActionsTest-1089900372 None] Creating offline snapshot 17fbd751-10a3-491b-94cc-1155f8c0ac4f of volume ff12e24b-1371-4c6d-80ae-f7902f3c6373 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:16:27 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-04f17599-8c51-4157-b72a-a4674b6783d5 tempest-VolumesSnapshotTestJSON-1723175258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:16:27 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-04f17599-8c51-4157-b72a-a4674b6783d5 tempest-VolumesSnapshotTestJSON-1723175258 None] Flow 'volume_create_manager' (034bb204-44e9-434f-9161-bb01d3e09cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:16:27 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-04f17599-8c51-4157-b72a-a4674b6783d5 tempest-VolumesSnapshotTestJSON-1723175258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51c16f29-d585-42cc-9429-c7686c888d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:27 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a86b56-fd80-47b2-aa98-4f669400d87d]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-688bc275-dc89-48d1-8fec-099fee5aa4f3 tempest-SnapshotsActionsTest-1089900372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.f03e245d-7359-4b78-9102-891b4c3dae62 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:27 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-04f17599-8c51-4157-b72a-a4674b6783d5 tempest-VolumesSnapshotTestJSON-1723175258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51c16f29-d585-42cc-9429-c7686c888d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:16:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1651460365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a74ec57-8a00-4075-b0a8-033649a4fc4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf7cafdac732417c8e137325cfbd0195',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:27Z,use_quota=True,user_id='2f5c64ce686b4e50896d496f23e2a61f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:27 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-04f17599-8c51-4157-b72a-a4674b6783d5 tempest-VolumesSnapshotTestJSON-1723175258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fdd3a46-a10c-4322-a43f-679b019d43bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:27 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-04f17599-8c51-4157-b72a-a4674b6783d5 tempest-VolumesSnapshotTestJSON-1723175258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fdd3a46-a10c-4322-a43f-679b019d43bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:27 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-04f17599-8c51-4157-b72a-a4674b6783d5 tempest-VolumesSnapshotTestJSON-1723175258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4407574-30c9-410a-bd1d-352e94cb58ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:27 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-04f17599-8c51-4157-b72a-a4674b6783d5 tempest-VolumesSnapshotTestJSON-1723175258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4407574-30c9-410a-bd1d-352e94cb58ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a74ec57-8a00-4075-b0a8-033649a4fc4d', 'volume_name': 'volume-6a74ec57-8a00-4075-b0a8-033649a4fc4d', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:27 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-04f17599-8c51-4157-b72a-a4674b6783d5 tempest-VolumesSnapshotTestJSON-1723175258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39b66f84-b1d0-4a27-8bea-9c9133ff93de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:27 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-04f17599-8c51-4157-b72a-a4674b6783d5 tempest-VolumesSnapshotTestJSON-1723175258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39b66f84-b1d0-4a27-8bea-9c9133ff93de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:27 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-04f17599-8c51-4157-b72a-a4674b6783d5 tempest-VolumesSnapshotTestJSON-1723175258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bfe40de-51ed-4dd6-a86a-01190e7c6f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:27 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-04f17599-8c51-4157-b72a-a4674b6783d5 tempest-VolumesSnapshotTestJSON-1723175258 None] Volume 6a74ec57-8a00-4075-b0a8-033649a4fc4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a74ec57-8a00-4075-b0a8-033649a4fc4d', 'volume_size': 1} Sep 23 00:16:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-04f17599-8c51-4157-b72a-a4674b6783d5 tempest-VolumesSnapshotTestJSON-1723175258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:27 devstack sudo[94004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.f03e245d-7359-4b78-9102-891b4c3dae62 Sep 23 00:16:27 devstack sudo[94004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:27 devstack sudo[94004]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-688bc275-dc89-48d1-8fec-099fee5aa4f3 tempest-SnapshotsActionsTest-1089900372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.f03e245d-7359-4b78-9102-891b4c3dae62" returned: 0 in 0.439s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:27 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-688bc275-dc89-48d1-8fec-099fee5aa4f3 tempest-SnapshotsActionsTest-1089900372 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:16:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-688bc275-dc89-48d1-8fec-099fee5aa4f3 tempest-SnapshotsActionsTest-1089900372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.f03e245d-7359-4b78-9102-891b4c3dae62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.17fbd751-10a3-491b-94cc-1155f8c0ac4f 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:27 devstack sudo[94010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.f03e245d-7359-4b78-9102-891b4c3dae62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.17fbd751-10a3-491b-94cc-1155f8c0ac4f 1G Sep 23 00:16:27 devstack sudo[94010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:28 devstack sudo[94010]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-688bc275-dc89-48d1-8fec-099fee5aa4f3 tempest-SnapshotsActionsTest-1089900372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.f03e245d-7359-4b78-9102-891b4c3dae62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.17fbd751-10a3-491b-94cc-1155f8c0ac4f 1G" returned: 0 in 0.621s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-688bc275-dc89-48d1-8fec-099fee5aa4f3 tempest-SnapshotsActionsTest-1089900372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.f03e245d-7359-4b78-9102-891b4c3dae62 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.17fbd751-10a3-491b-94cc-1155f8c0ac4f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:28 devstack sudo[94018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.f03e245d-7359-4b78-9102-891b4c3dae62 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.17fbd751-10a3-491b-94cc-1155f8c0ac4f Sep 23 00:16:28 devstack sudo[94018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:28 devstack sudo[94018]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-688bc275-dc89-48d1-8fec-099fee5aa4f3 tempest-SnapshotsActionsTest-1089900372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.f03e245d-7359-4b78-9102-891b4c3dae62 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.17fbd751-10a3-491b-94cc-1155f8c0ac4f" returned: 0 in 0.342s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:28 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-688bc275-dc89-48d1-8fec-099fee5aa4f3 tempest-SnapshotsActionsTest-1089900372 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.17fbd751-10a3-491b-94cc-1155f8c0ac4f is being set with open permissions: ugo+rw Sep 23 00:16:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-688bc275-dc89-48d1-8fec-099fee5aa4f3 tempest-SnapshotsActionsTest-1089900372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.17fbd751-10a3-491b-94cc-1155f8c0ac4f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:28 devstack sudo[94024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.17fbd751-10a3-491b-94cc-1155f8c0ac4f Sep 23 00:16:28 devstack sudo[94024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:28 devstack sudo[94024]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-688bc275-dc89-48d1-8fec-099fee5aa4f3 tempest-SnapshotsActionsTest-1089900372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.17fbd751-10a3-491b-94cc-1155f8c0ac4f" returned: 0 in 0.312s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-688bc275-dc89-48d1-8fec-099fee5aa4f3 tempest-SnapshotsActionsTest-1089900372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.910s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-04f17599-8c51-4157-b72a-a4674b6783d5 tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.697s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:28 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-04f17599-8c51-4157-b72a-a4674b6783d5 tempest-VolumesSnapshotTestJSON-1723175258 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:16:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1651460365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a74ec57-8a00-4075-b0a8-033649a4fc4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf7cafdac732417c8e137325cfbd0195',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:27Z,use_quota=True,user_id='2f5c64ce686b4e50896d496f23e2a61f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:16:28 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-04f17599-8c51-4157-b72a-a4674b6783d5 tempest-VolumesSnapshotTestJSON-1723175258 None] Creating volume 6a74ec57-8a00-4075-b0a8-033649a4fc4d {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:16:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-04f17599-8c51-4157-b72a-a4674b6783d5 tempest-VolumesSnapshotTestJSON-1723175258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-04f17599-8c51-4157-b72a-a4674b6783d5 tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:28 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-04f17599-8c51-4157-b72a-a4674b6783d5 tempest-VolumesSnapshotTestJSON-1723175258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:16:28 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-04f17599-8c51-4157-b72a-a4674b6783d5 tempest-VolumesSnapshotTestJSON-1723175258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:16:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-04f17599-8c51-4157-b72a-a4674b6783d5 tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:28 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-04f17599-8c51-4157-b72a-a4674b6783d5 tempest-VolumesSnapshotTestJSON-1723175258 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:16:28 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-04f17599-8c51-4157-b72a-a4674b6783d5 tempest-VolumesSnapshotTestJSON-1723175258 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:16:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-04f17599-8c51-4157-b72a-a4674b6783d5 tempest-VolumesSnapshotTestJSON-1723175258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6a74ec57-8a00-4075-b0a8-033649a4fc4d 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:28 devstack sudo[94027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6a74ec57-8a00-4075-b0a8-033649a4fc4d 1073741824 Sep 23 00:16:28 devstack sudo[94027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:28 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-688bc275-dc89-48d1-8fec-099fee5aa4f3 tempest-SnapshotsActionsTest-1089900372 None] Create snapshot completed successfully Sep 23 00:16:29 devstack sudo[94027]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-04f17599-8c51-4157-b72a-a4674b6783d5 tempest-VolumesSnapshotTestJSON-1723175258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6a74ec57-8a00-4075-b0a8-033649a4fc4d 1073741824" returned: 0 in 1.054s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-04f17599-8c51-4157-b72a-a4674b6783d5 tempest-VolumesSnapshotTestJSON-1723175258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6a74ec57-8a00-4075-b0a8-033649a4fc4d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:30 devstack sudo[94094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6a74ec57-8a00-4075-b0a8-033649a4fc4d Sep 23 00:16:30 devstack sudo[94094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:30 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9f5e30a5-cb68-4440-8c0c-674fcaae8629 tempest-SnapshotsActionsTest-1442922860 None] Acquiring lock "cinder-17fbd751-10a3-491b-94cc-1155f8c0ac4f-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:30 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9f5e30a5-cb68-4440-8c0c-674fcaae8629 tempest-SnapshotsActionsTest-1442922860 None] Lock "cinder-17fbd751-10a3-491b-94cc-1155f8c0ac4f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:30 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9f5e30a5-cb68-4440-8c0c-674fcaae8629 tempest-SnapshotsActionsTest-1442922860 None] Acquiring lock "cinder-quobyte-ff12e24b-1371-4c6d-80ae-f7902f3c6373" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:30 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9f5e30a5-cb68-4440-8c0c-674fcaae8629 tempest-SnapshotsActionsTest-1442922860 None] Lock "cinder-quobyte-ff12e24b-1371-4c6d-80ae-f7902f3c6373" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:30 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9f5e30a5-cb68-4440-8c0c-674fcaae8629 tempest-SnapshotsActionsTest-1442922860 None] Acquiring lock "cinder-quobyte-17fbd751-10a3-491b-94cc-1155f8c0ac4f" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:30 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9f5e30a5-cb68-4440-8c0c-674fcaae8629 tempest-SnapshotsActionsTest-1442922860 None] Lock "cinder-quobyte-17fbd751-10a3-491b-94cc-1155f8c0ac4f" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:30 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-9f5e30a5-cb68-4440-8c0c-674fcaae8629 tempest-SnapshotsActionsTest-1442922860 None] Deleting offline snapshot 17fbd751-10a3-491b-94cc-1155f8c0ac4f of volume ff12e24b-1371-4c6d-80ae-f7902f3c6373 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:16:30 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-9f5e30a5-cb68-4440-8c0c-674fcaae8629 tempest-SnapshotsActionsTest-1442922860 None] snapshot_file for this snap is: volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.17fbd751-10a3-491b-94cc-1155f8c0ac4f {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:16:30 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[5945c442-0517-4783-aa21-fd4c9e4c64e4]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9f5e30a5-cb68-4440-8c0c-674fcaae8629 tempest-SnapshotsActionsTest-1442922860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.17fbd751-10a3-491b-94cc-1155f8c0ac4f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:30 devstack sudo[94094]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-04f17599-8c51-4157-b72a-a4674b6783d5 tempest-VolumesSnapshotTestJSON-1723175258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6a74ec57-8a00-4075-b0a8-033649a4fc4d" returned: 0 in 0.437s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:30 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-04f17599-8c51-4157-b72a-a4674b6783d5 tempest-VolumesSnapshotTestJSON-1723175258 None] <== create_volume: return (1587ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:16:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-04f17599-8c51-4157-b72a-a4674b6783d5 tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.592s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:30 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-04f17599-8c51-4157-b72a-a4674b6783d5 tempest-VolumesSnapshotTestJSON-1723175258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bfe40de-51ed-4dd6-a86a-01190e7c6f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a74ec57-8a00-4075-b0a8-033649a4fc4d', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:30 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-04f17599-8c51-4157-b72a-a4674b6783d5 tempest-VolumesSnapshotTestJSON-1723175258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (128ade79-e9da-4e2b-a7bc-bbc96c19032e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:30 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-04f17599-8c51-4157-b72a-a4674b6783d5 tempest-VolumesSnapshotTestJSON-1723175258 None] Volume volume-6a74ec57-8a00-4075-b0a8-033649a4fc4d (6a74ec57-8a00-4075-b0a8-033649a4fc4d): created successfully Sep 23 00:16:30 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-04f17599-8c51-4157-b72a-a4674b6783d5 tempest-VolumesSnapshotTestJSON-1723175258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (128ade79-e9da-4e2b-a7bc-bbc96c19032e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:30 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-04f17599-8c51-4157-b72a-a4674b6783d5 tempest-VolumesSnapshotTestJSON-1723175258 None] Flow 'volume_create_manager' (034bb204-44e9-434f-9161-bb01d3e09cf6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:16:30 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-04f17599-8c51-4157-b72a-a4674b6783d5 tempest-VolumesSnapshotTestJSON-1723175258 None] Created volume successfully. Sep 23 00:16:30 devstack sudo[94099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.17fbd751-10a3-491b-94cc-1155f8c0ac4f Sep 23 00:16:30 devstack sudo[94099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:30 devstack sudo[94099]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9f5e30a5-cb68-4440-8c0c-674fcaae8629 tempest-SnapshotsActionsTest-1442922860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.17fbd751-10a3-491b-94cc-1155f8c0ac4f" returned: 0 in 0.620s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:31 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-9f5e30a5-cb68-4440-8c0c-674fcaae8629 tempest-SnapshotsActionsTest-1442922860 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:16:31 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd2a904-2ce6-4a6b-b2a6-188efdce0176]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9f5e30a5-cb68-4440-8c0c-674fcaae8629 tempest-SnapshotsActionsTest-1442922860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.f03e245d-7359-4b78-9102-891b4c3dae62 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:31 devstack sudo[94110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.f03e245d-7359-4b78-9102-891b4c3dae62 Sep 23 00:16:31 devstack sudo[94110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-69db886a-eed8-473e-8052-a5fb1442b07a tempest-VolumesSnapshotTestJSON-1723175258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-69db886a-eed8-473e-8052-a5fb1442b07a tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:31 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-69db886a-eed8-473e-8052-a5fb1442b07a tempest-VolumesSnapshotTestJSON-1723175258 None] Creating offline snapshot 5cb24c6d-b65c-4f09-9995-417a5706a10d of volume 6a74ec57-8a00-4075-b0a8-033649a4fc4d {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:16:31 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4444706-2d33-4336-821e-cb5622b69c9b]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-69db886a-eed8-473e-8052-a5fb1442b07a tempest-VolumesSnapshotTestJSON-1723175258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6a74ec57-8a00-4075-b0a8-033649a4fc4d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:31 devstack sudo[94110]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9f5e30a5-cb68-4440-8c0c-674fcaae8629 tempest-SnapshotsActionsTest-1442922860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.f03e245d-7359-4b78-9102-891b4c3dae62" returned: 0 in 0.608s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:31 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-9f5e30a5-cb68-4440-8c0c-674fcaae8629 tempest-SnapshotsActionsTest-1442922860 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:16:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9f5e30a5-cb68-4440-8c0c-674fcaae8629 tempest-SnapshotsActionsTest-1442922860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.17fbd751-10a3-491b-94cc-1155f8c0ac4f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:31 devstack sudo[94117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.17fbd751-10a3-491b-94cc-1155f8c0ac4f Sep 23 00:16:31 devstack sudo[94117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:31 devstack sudo[94114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6a74ec57-8a00-4075-b0a8-033649a4fc4d Sep 23 00:16:31 devstack sudo[94114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:32 devstack sudo[94114]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-69db886a-eed8-473e-8052-a5fb1442b07a tempest-VolumesSnapshotTestJSON-1723175258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6a74ec57-8a00-4075-b0a8-033649a4fc4d" returned: 0 in 0.491s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-69db886a-eed8-473e-8052-a5fb1442b07a tempest-VolumesSnapshotTestJSON-1723175258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6a74ec57-8a00-4075-b0a8-033649a4fc4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6a74ec57-8a00-4075-b0a8-033649a4fc4d.5cb24c6d-b65c-4f09-9995-417a5706a10d 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:32 devstack sudo[94126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6a74ec57-8a00-4075-b0a8-033649a4fc4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6a74ec57-8a00-4075-b0a8-033649a4fc4d.5cb24c6d-b65c-4f09-9995-417a5706a10d 1G Sep 23 00:16:32 devstack sudo[94126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:32 devstack sudo[94117]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9f5e30a5-cb68-4440-8c0c-674fcaae8629 tempest-SnapshotsActionsTest-1442922860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.17fbd751-10a3-491b-94cc-1155f8c0ac4f" returned: 0 in 0.492s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9f5e30a5-cb68-4440-8c0c-674fcaae8629 tempest-SnapshotsActionsTest-1442922860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.17fbd751-10a3-491b-94cc-1155f8c0ac4f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:32 devstack sudo[94128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.17fbd751-10a3-491b-94cc-1155f8c0ac4f Sep 23 00:16:32 devstack sudo[94128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:32 devstack sudo[94128]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9f5e30a5-cb68-4440-8c0c-674fcaae8629 tempest-SnapshotsActionsTest-1442922860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.17fbd751-10a3-491b-94cc-1155f8c0ac4f" returned: 0 in 0.381s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:32 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9f5e30a5-cb68-4440-8c0c-674fcaae8629 tempest-SnapshotsActionsTest-1442922860 None] Lock "cinder-quobyte-17fbd751-10a3-491b-94cc-1155f8c0ac4f" released by "_delete_snapshot" :: held 2.349s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:32 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9f5e30a5-cb68-4440-8c0c-674fcaae8629 tempest-SnapshotsActionsTest-1442922860 None] Lock "cinder-quobyte-ff12e24b-1371-4c6d-80ae-f7902f3c6373" released by "delete_snapshot" :: held 2.396s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:32 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-9f5e30a5-cb68-4440-8c0c-674fcaae8629 tempest-SnapshotsActionsTest-1442922860 None] Created reservations ['f1c7e624-60cf-4701-ba24-18be079c5c1d', '5b702876-215b-4b3c-ab9d-f597ecdc5fdf', 'd1278b5f-65b6-427c-94ac-e9d3e33c1f2c', '907bea90-83ee-4f59-9fed-9729e52fdc02'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:16:32 devstack sudo[94126]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-69db886a-eed8-473e-8052-a5fb1442b07a tempest-VolumesSnapshotTestJSON-1723175258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6a74ec57-8a00-4075-b0a8-033649a4fc4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6a74ec57-8a00-4075-b0a8-033649a4fc4d.5cb24c6d-b65c-4f09-9995-417a5706a10d 1G" returned: 0 in 0.723s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-69db886a-eed8-473e-8052-a5fb1442b07a tempest-VolumesSnapshotTestJSON-1723175258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a74ec57-8a00-4075-b0a8-033649a4fc4d -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6a74ec57-8a00-4075-b0a8-033649a4fc4d.5cb24c6d-b65c-4f09-9995-417a5706a10d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:32 devstack sudo[94135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a74ec57-8a00-4075-b0a8-033649a4fc4d -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6a74ec57-8a00-4075-b0a8-033649a4fc4d.5cb24c6d-b65c-4f09-9995-417a5706a10d Sep 23 00:16:32 devstack sudo[94135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:32 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-9f5e30a5-cb68-4440-8c0c-674fcaae8629 tempest-SnapshotsActionsTest-1442922860 None] Delete snapshot completed successfully. Sep 23 00:16:32 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9f5e30a5-cb68-4440-8c0c-674fcaae8629 tempest-SnapshotsActionsTest-1442922860 None] Lock "cinder-17fbd751-10a3-491b-94cc-1155f8c0ac4f-delete_snapshot" released by "delete_snapshot" :: held 2.710s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:33 devstack sudo[94135]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-69db886a-eed8-473e-8052-a5fb1442b07a tempest-VolumesSnapshotTestJSON-1723175258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a74ec57-8a00-4075-b0a8-033649a4fc4d -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6a74ec57-8a00-4075-b0a8-033649a4fc4d.5cb24c6d-b65c-4f09-9995-417a5706a10d" returned: 0 in 0.404s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:33 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-69db886a-eed8-473e-8052-a5fb1442b07a tempest-VolumesSnapshotTestJSON-1723175258 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6a74ec57-8a00-4075-b0a8-033649a4fc4d.5cb24c6d-b65c-4f09-9995-417a5706a10d is being set with open permissions: ugo+rw Sep 23 00:16:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-69db886a-eed8-473e-8052-a5fb1442b07a tempest-VolumesSnapshotTestJSON-1723175258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6a74ec57-8a00-4075-b0a8-033649a4fc4d.5cb24c6d-b65c-4f09-9995-417a5706a10d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:33 devstack sudo[94140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6a74ec57-8a00-4075-b0a8-033649a4fc4d.5cb24c6d-b65c-4f09-9995-417a5706a10d Sep 23 00:16:33 devstack sudo[94140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:33 devstack sudo[94140]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-69db886a-eed8-473e-8052-a5fb1442b07a tempest-VolumesSnapshotTestJSON-1723175258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6a74ec57-8a00-4075-b0a8-033649a4fc4d.5cb24c6d-b65c-4f09-9995-417a5706a10d" returned: 0 in 0.502s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-69db886a-eed8-473e-8052-a5fb1442b07a tempest-VolumesSnapshotTestJSON-1723175258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6a74ec57-8a00-4075-b0a8-033649a4fc4d.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:33 devstack sudo[94143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6a74ec57-8a00-4075-b0a8-033649a4fc4d.info Sep 23 00:16:33 devstack sudo[94143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-49652ebe-2143-4063-92bf-348814396098 tempest-SnapshotsActionsTest-1089900372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:34 devstack sudo[94143]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-69db886a-eed8-473e-8052-a5fb1442b07a tempest-VolumesSnapshotTestJSON-1723175258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6a74ec57-8a00-4075-b0a8-033649a4fc4d.info" returned: 0 in 0.504s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:34 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-69db886a-eed8-473e-8052-a5fb1442b07a tempest-VolumesSnapshotTestJSON-1723175258 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6a74ec57-8a00-4075-b0a8-033649a4fc4d.info is being set with open permissions: ugo+rw Sep 23 00:16:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-69db886a-eed8-473e-8052-a5fb1442b07a tempest-VolumesSnapshotTestJSON-1723175258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6a74ec57-8a00-4075-b0a8-033649a4fc4d.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:34 devstack sudo[94147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6a74ec57-8a00-4075-b0a8-033649a4fc4d.info Sep 23 00:16:34 devstack sudo[94147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:34 devstack sudo[94147]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-69db886a-eed8-473e-8052-a5fb1442b07a tempest-VolumesSnapshotTestJSON-1723175258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6a74ec57-8a00-4075-b0a8-033649a4fc4d.info" returned: 0 in 0.428s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-69db886a-eed8-473e-8052-a5fb1442b07a tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.244s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-49652ebe-2143-4063-92bf-348814396098 tempest-SnapshotsActionsTest-1089900372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.641s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:34 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-49652ebe-2143-4063-92bf-348814396098 tempest-SnapshotsActionsTest-1089900372 None] Creating offline snapshot 7c429e2b-3c35-4607-96b7-6321a4078112 of volume ff12e24b-1371-4c6d-80ae-f7902f3c6373 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:16:34 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-69db886a-eed8-473e-8052-a5fb1442b07a tempest-VolumesSnapshotTestJSON-1723175258 None] Create snapshot completed successfully Sep 23 00:16:34 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[288d05ef-5f22-4aae-a4a6-f1221e4a2d34]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-49652ebe-2143-4063-92bf-348814396098 tempest-SnapshotsActionsTest-1089900372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.f03e245d-7359-4b78-9102-891b4c3dae62 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:35 devstack sudo[94150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.f03e245d-7359-4b78-9102-891b4c3dae62 Sep 23 00:16:35 devstack sudo[94150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:35 devstack sudo[94150]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-49652ebe-2143-4063-92bf-348814396098 tempest-SnapshotsActionsTest-1089900372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.f03e245d-7359-4b78-9102-891b4c3dae62" returned: 0 in 0.602s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:35 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-49652ebe-2143-4063-92bf-348814396098 tempest-SnapshotsActionsTest-1089900372 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:16:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-49652ebe-2143-4063-92bf-348814396098 tempest-SnapshotsActionsTest-1089900372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.f03e245d-7359-4b78-9102-891b4c3dae62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.7c429e2b-3c35-4607-96b7-6321a4078112 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:35 devstack sudo[94155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.f03e245d-7359-4b78-9102-891b4c3dae62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.7c429e2b-3c35-4607-96b7-6321a4078112 1G Sep 23 00:16:35 devstack sudo[94155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:36 devstack sudo[94155]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-49652ebe-2143-4063-92bf-348814396098 tempest-SnapshotsActionsTest-1089900372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.f03e245d-7359-4b78-9102-891b4c3dae62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.7c429e2b-3c35-4607-96b7-6321a4078112 1G" returned: 0 in 0.818s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-49652ebe-2143-4063-92bf-348814396098 tempest-SnapshotsActionsTest-1089900372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.f03e245d-7359-4b78-9102-891b4c3dae62 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.7c429e2b-3c35-4607-96b7-6321a4078112 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:36 devstack sudo[94162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.f03e245d-7359-4b78-9102-891b4c3dae62 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.7c429e2b-3c35-4607-96b7-6321a4078112 Sep 23 00:16:36 devstack sudo[94162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:36 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-403302a5-2e04-4a76-9897-8275f5da6fea tempest-VolumesSnapshotTestJSON-1723175258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:16:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-403302a5-2e04-4a76-9897-8275f5da6fea tempest-VolumesSnapshotTestJSON-1723175258 None] Flow 'volume_create_manager' (ab36f8d7-6f28-4705-808a-15aa50bcc65a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:16:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-403302a5-2e04-4a76-9897-8275f5da6fea tempest-VolumesSnapshotTestJSON-1723175258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f065192-fc63-427b-a1af-47cacd0dc7df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-403302a5-2e04-4a76-9897-8275f5da6fea tempest-VolumesSnapshotTestJSON-1723175258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f065192-fc63-427b-a1af-47cacd0dc7df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:16:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1039114876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01d84555-8dd1-4d79-8cc8-73cd662ff797,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf7cafdac732417c8e137325cfbd0195',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5cb24c6d-b65c-4f09-9995-417a5706a10d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:37Z,use_quota=True,user_id='2f5c64ce686b4e50896d496f23e2a61f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-403302a5-2e04-4a76-9897-8275f5da6fea tempest-VolumesSnapshotTestJSON-1723175258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e00024e6-f9d3-4e40-aede-60f261ea28d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-403302a5-2e04-4a76-9897-8275f5da6fea tempest-VolumesSnapshotTestJSON-1723175258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e00024e6-f9d3-4e40-aede-60f261ea28d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-403302a5-2e04-4a76-9897-8275f5da6fea tempest-VolumesSnapshotTestJSON-1723175258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d6b982f-f12a-400f-9b79-d524d0237df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-403302a5-2e04-4a76-9897-8275f5da6fea tempest-VolumesSnapshotTestJSON-1723175258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d6b982f-f12a-400f-9b79-d524d0237df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '01d84555-8dd1-4d79-8cc8-73cd662ff797', 'volume_name': 'volume-01d84555-8dd1-4d79-8cc8-73cd662ff797', 'volume_size': 1, 'snapshot_id': '5cb24c6d-b65c-4f09-9995-417a5706a10d'}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-403302a5-2e04-4a76-9897-8275f5da6fea tempest-VolumesSnapshotTestJSON-1723175258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd444f21-cd86-4b87-ba94-5edc51f70cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-403302a5-2e04-4a76-9897-8275f5da6fea tempest-VolumesSnapshotTestJSON-1723175258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd444f21-cd86-4b87-ba94-5edc51f70cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-403302a5-2e04-4a76-9897-8275f5da6fea tempest-VolumesSnapshotTestJSON-1723175258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (100ee0cc-d841-4b8d-8b43-ec73688ba8d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:36 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-403302a5-2e04-4a76-9897-8275f5da6fea tempest-VolumesSnapshotTestJSON-1723175258 None] Volume 01d84555-8dd1-4d79-8cc8-73cd662ff797: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-01d84555-8dd1-4d79-8cc8-73cd662ff797', 'volume_size': 1, 'snapshot_id': '5cb24c6d-b65c-4f09-9995-417a5706a10d'} Sep 23 00:16:36 devstack sudo[94162]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-403302a5-2e04-4a76-9897-8275f5da6fea tempest-VolumesSnapshotTestJSON-1723175258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-49652ebe-2143-4063-92bf-348814396098 tempest-SnapshotsActionsTest-1089900372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.f03e245d-7359-4b78-9102-891b4c3dae62 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.7c429e2b-3c35-4607-96b7-6321a4078112" returned: 0 in 0.575s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:36 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-49652ebe-2143-4063-92bf-348814396098 tempest-SnapshotsActionsTest-1089900372 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.7c429e2b-3c35-4607-96b7-6321a4078112 is being set with open permissions: ugo+rw Sep 23 00:16:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-49652ebe-2143-4063-92bf-348814396098 tempest-SnapshotsActionsTest-1089900372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.7c429e2b-3c35-4607-96b7-6321a4078112 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:36 devstack sudo[94168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.7c429e2b-3c35-4607-96b7-6321a4078112 Sep 23 00:16:36 devstack sudo[94168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:37 devstack sudo[94168]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-49652ebe-2143-4063-92bf-348814396098 tempest-SnapshotsActionsTest-1089900372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.7c429e2b-3c35-4607-96b7-6321a4078112" returned: 0 in 0.355s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-49652ebe-2143-4063-92bf-348814396098 tempest-SnapshotsActionsTest-1089900372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.556s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-403302a5-2e04-4a76-9897-8275f5da6fea tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.421s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:37 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-403302a5-2e04-4a76-9897-8275f5da6fea tempest-VolumesSnapshotTestJSON-1723175258 None] Acquiring lock "cinder-quobyte-5cb24c6d-b65c-4f09-9995-417a5706a10d-01d84555-8dd1-4d79-8cc8-73cd662ff797" by "_create_volume_from_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:37 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-403302a5-2e04-4a76-9897-8275f5da6fea tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "cinder-quobyte-5cb24c6d-b65c-4f09-9995-417a5706a10d-01d84555-8dd1-4d79-8cc8-73cd662ff797" acquired by "_create_volume_from_snapshot" :: waited 0.039s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-403302a5-2e04-4a76-9897-8275f5da6fea tempest-VolumesSnapshotTestJSON-1723175258 None] Creating volume 01d84555-8dd1-4d79-8cc8-73cd662ff797 from snapshot 5cb24c6d-b65c-4f09-9995-417a5706a10d {{(pid=86591) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 00:16:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-403302a5-2e04-4a76-9897-8275f5da6fea tempest-VolumesSnapshotTestJSON-1723175258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-403302a5-2e04-4a76-9897-8275f5da6fea tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-403302a5-2e04-4a76-9897-8275f5da6fea tempest-VolumesSnapshotTestJSON-1723175258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:16:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-403302a5-2e04-4a76-9897-8275f5da6fea tempest-VolumesSnapshotTestJSON-1723175258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:16:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-403302a5-2e04-4a76-9897-8275f5da6fea tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-403302a5-2e04-4a76-9897-8275f5da6fea tempest-VolumesSnapshotTestJSON-1723175258 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:16:37 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-403302a5-2e04-4a76-9897-8275f5da6fea tempest-VolumesSnapshotTestJSON-1723175258 None] Acquiring lock "cinder-quobyte-01d84555-8dd1-4d79-8cc8-73cd662ff797" by "_copy_volume_from_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:37 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-49652ebe-2143-4063-92bf-348814396098 tempest-SnapshotsActionsTest-1089900372 None] Create snapshot completed successfully Sep 23 00:16:37 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-403302a5-2e04-4a76-9897-8275f5da6fea tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "cinder-quobyte-01d84555-8dd1-4d79-8cc8-73cd662ff797" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-403302a5-2e04-4a76-9897-8275f5da6fea tempest-VolumesSnapshotTestJSON-1723175258 None] snapshot: 5cb24c6d-b65c-4f09-9995-417a5706a10d, volume: 01d84555-8dd1-4d79-8cc8-73cd662ff797, {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:16:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-403302a5-2e04-4a76-9897-8275f5da6fea tempest-VolumesSnapshotTestJSON-1723175258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-403302a5-2e04-4a76-9897-8275f5da6fea tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-403302a5-2e04-4a76-9897-8275f5da6fea tempest-VolumesSnapshotTestJSON-1723175258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:16:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-403302a5-2e04-4a76-9897-8275f5da6fea tempest-VolumesSnapshotTestJSON-1723175258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:16:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-403302a5-2e04-4a76-9897-8275f5da6fea tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:37 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[104f186e-b9a3-44d9-8bfd-be3c268ba2a4]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-403302a5-2e04-4a76-9897-8275f5da6fea tempest-VolumesSnapshotTestJSON-1723175258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6a74ec57-8a00-4075-b0a8-033649a4fc4d.5cb24c6d-b65c-4f09-9995-417a5706a10d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:37 devstack sudo[94173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6a74ec57-8a00-4075-b0a8-033649a4fc4d.5cb24c6d-b65c-4f09-9995-417a5706a10d Sep 23 00:16:37 devstack sudo[94173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:38 devstack sudo[94173]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-403302a5-2e04-4a76-9897-8275f5da6fea tempest-VolumesSnapshotTestJSON-1723175258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6a74ec57-8a00-4075-b0a8-033649a4fc4d.5cb24c6d-b65c-4f09-9995-417a5706a10d" returned: 0 in 0.514s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:38 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-403302a5-2e04-4a76-9897-8275f5da6fea tempest-VolumesSnapshotTestJSON-1723175258 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a74ec57-8a00-4075-b0a8-033649a4fc4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:16:38 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[526e865d-a584-4486-a02b-b01a73ae88e2]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-403302a5-2e04-4a76-9897-8275f5da6fea tempest-VolumesSnapshotTestJSON-1723175258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6a74ec57-8a00-4075-b0a8-033649a4fc4d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:38 devstack sudo[94180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6a74ec57-8a00-4075-b0a8-033649a4fc4d Sep 23 00:16:38 devstack sudo[94180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:38 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c3e11c34-c809-4b7d-bba2-c8db1f474e05 tempest-SnapshotsActionsTest-1442922860 None] Acquiring lock "cinder-7c429e2b-3c35-4607-96b7-6321a4078112-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:38 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c3e11c34-c809-4b7d-bba2-c8db1f474e05 tempest-SnapshotsActionsTest-1442922860 None] Lock "cinder-7c429e2b-3c35-4607-96b7-6321a4078112-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:38 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c3e11c34-c809-4b7d-bba2-c8db1f474e05 tempest-SnapshotsActionsTest-1442922860 None] Acquiring lock "cinder-quobyte-ff12e24b-1371-4c6d-80ae-f7902f3c6373" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:38 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c3e11c34-c809-4b7d-bba2-c8db1f474e05 tempest-SnapshotsActionsTest-1442922860 None] Lock "cinder-quobyte-ff12e24b-1371-4c6d-80ae-f7902f3c6373" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:38 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c3e11c34-c809-4b7d-bba2-c8db1f474e05 tempest-SnapshotsActionsTest-1442922860 None] Acquiring lock "cinder-quobyte-7c429e2b-3c35-4607-96b7-6321a4078112" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:38 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c3e11c34-c809-4b7d-bba2-c8db1f474e05 tempest-SnapshotsActionsTest-1442922860 None] Lock "cinder-quobyte-7c429e2b-3c35-4607-96b7-6321a4078112" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:38 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-c3e11c34-c809-4b7d-bba2-c8db1f474e05 tempest-SnapshotsActionsTest-1442922860 None] Deleting offline snapshot 7c429e2b-3c35-4607-96b7-6321a4078112 of volume ff12e24b-1371-4c6d-80ae-f7902f3c6373 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:16:38 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-c3e11c34-c809-4b7d-bba2-c8db1f474e05 tempest-SnapshotsActionsTest-1442922860 None] snapshot_file for this snap is: volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.7c429e2b-3c35-4607-96b7-6321a4078112 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:16:38 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b4fcbf-9fe6-4834-9943-9c26a66201fd]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c3e11c34-c809-4b7d-bba2-c8db1f474e05 tempest-SnapshotsActionsTest-1442922860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.7c429e2b-3c35-4607-96b7-6321a4078112 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:38 devstack sudo[94180]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-403302a5-2e04-4a76-9897-8275f5da6fea tempest-VolumesSnapshotTestJSON-1723175258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6a74ec57-8a00-4075-b0a8-033649a4fc4d" returned: 0 in 0.677s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:38 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-403302a5-2e04-4a76-9897-8275f5da6fea tempest-VolumesSnapshotTestJSON-1723175258 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6a74ec57-8a00-4075-b0a8-033649a4fc4d {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:16:38 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-403302a5-2e04-4a76-9897-8275f5da6fea tempest-VolumesSnapshotTestJSON-1723175258 None] Creating direct copy from snapshot {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:16:38 devstack cinder-volume[86591]: DEBUG cinder.utils [None req-403302a5-2e04-4a76-9897-8275f5da6fea tempest-VolumesSnapshotTestJSON-1723175258 None] Path /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-01d84555-8dd1-4d79-8cc8-73cd662ff797 not found in is_blk_device check {{(pid=86591) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:16:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-403302a5-2e04-4a76-9897-8275f5da6fea tempest-VolumesSnapshotTestJSON-1723175258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6a74ec57-8a00-4075-b0a8-033649a4fc4d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-01d84555-8dd1-4d79-8cc8-73cd662ff797 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:38 devstack sudo[94189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6a74ec57-8a00-4075-b0a8-033649a4fc4d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-01d84555-8dd1-4d79-8cc8-73cd662ff797 Sep 23 00:16:38 devstack sudo[94189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:38 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-18262124-1c29-4550-aaa5-77060946573a req-b7e38daf-2036-47f6-9f59-dc3549896168 tempest-ServerActionsTestOtherA-1121932693 None] Terminate volume connection completed successfully. Sep 23 00:16:38 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-18262124-1c29-4550-aaa5-77060946573a req-b7e38daf-2036-47f6-9f59-dc3549896168 tempest-ServerActionsTestOtherA-1121932693 None] Deleting attachment ab5dd8ee-a780-4cc9-bafd-c90d7bc996a7. {{(pid=86591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:16:38 devstack sudo[94187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.7c429e2b-3c35-4607-96b7-6321a4078112 Sep 23 00:16:38 devstack sudo[94187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:39 devstack sudo[94187]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c3e11c34-c809-4b7d-bba2-c8db1f474e05 tempest-SnapshotsActionsTest-1442922860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.7c429e2b-3c35-4607-96b7-6321a4078112" returned: 0 in 0.538s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:39 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-c3e11c34-c809-4b7d-bba2-c8db1f474e05 tempest-SnapshotsActionsTest-1442922860 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:16:39 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a141268-58fd-458b-820b-494631547045]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c3e11c34-c809-4b7d-bba2-c8db1f474e05 tempest-SnapshotsActionsTest-1442922860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.f03e245d-7359-4b78-9102-891b4c3dae62 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:39 devstack sudo[94202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.f03e245d-7359-4b78-9102-891b4c3dae62 Sep 23 00:16:39 devstack sudo[94202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:40 devstack sudo[94202]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c3e11c34-c809-4b7d-bba2-c8db1f474e05 tempest-SnapshotsActionsTest-1442922860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.f03e245d-7359-4b78-9102-891b4c3dae62" returned: 0 in 1.270s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:40 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-c3e11c34-c809-4b7d-bba2-c8db1f474e05 tempest-SnapshotsActionsTest-1442922860 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:16:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c3e11c34-c809-4b7d-bba2-c8db1f474e05 tempest-SnapshotsActionsTest-1442922860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.7c429e2b-3c35-4607-96b7-6321a4078112 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:40 devstack sudo[94224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.7c429e2b-3c35-4607-96b7-6321a4078112 Sep 23 00:16:40 devstack sudo[94224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:42 devstack sudo[94224]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c3e11c34-c809-4b7d-bba2-c8db1f474e05 tempest-SnapshotsActionsTest-1442922860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.7c429e2b-3c35-4607-96b7-6321a4078112" returned: 0 in 1.966s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c3e11c34-c809-4b7d-bba2-c8db1f474e05 tempest-SnapshotsActionsTest-1442922860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.7c429e2b-3c35-4607-96b7-6321a4078112 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:42 devstack sudo[94243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.7c429e2b-3c35-4607-96b7-6321a4078112 Sep 23 00:16:42 devstack sudo[94243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:43 devstack sudo[94243]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c3e11c34-c809-4b7d-bba2-c8db1f474e05 tempest-SnapshotsActionsTest-1442922860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.7c429e2b-3c35-4607-96b7-6321a4078112" returned: 0 in 1.135s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:43 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c3e11c34-c809-4b7d-bba2-c8db1f474e05 tempest-SnapshotsActionsTest-1442922860 None] Lock "cinder-quobyte-7c429e2b-3c35-4607-96b7-6321a4078112" released by "_delete_snapshot" :: held 5.138s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:43 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c3e11c34-c809-4b7d-bba2-c8db1f474e05 tempest-SnapshotsActionsTest-1442922860 None] Lock "cinder-quobyte-ff12e24b-1371-4c6d-80ae-f7902f3c6373" released by "delete_snapshot" :: held 5.185s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:44 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-c3e11c34-c809-4b7d-bba2-c8db1f474e05 tempest-SnapshotsActionsTest-1442922860 None] Created reservations ['d8c0db17-3be0-4789-a308-3d78b0c2f117', '026e0945-f11b-43d4-8840-2801c9ae2d4d', '52af3cec-989a-4570-a907-e6f085e6cd67', '573e9a37-490f-43ad-95db-88469e528054'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:16:44 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-c3e11c34-c809-4b7d-bba2-c8db1f474e05 tempest-SnapshotsActionsTest-1442922860 None] Delete snapshot completed successfully. Sep 23 00:16:44 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c3e11c34-c809-4b7d-bba2-c8db1f474e05 tempest-SnapshotsActionsTest-1442922860 None] Lock "cinder-7c429e2b-3c35-4607-96b7-6321a4078112-delete_snapshot" released by "delete_snapshot" :: held 5.731s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-46447919-e477-4fda-bf1c-f5f2c748c49d tempest-SnapshotsActionsTest-1089900372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:49 devstack sudo[94189]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-403302a5-2e04-4a76-9897-8275f5da6fea tempest-VolumesSnapshotTestJSON-1723175258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6a74ec57-8a00-4075-b0a8-033649a4fc4d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-01d84555-8dd1-4d79-8cc8-73cd662ff797" returned: 0 in 10.450s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:49 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-403302a5-2e04-4a76-9897-8275f5da6fea tempest-VolumesSnapshotTestJSON-1723175258 None] Image conversion details: src /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6a74ec57-8a00-4075-b0a8-033649a4fc4d, size 1024.00 MB, duration 10.45 sec, destination /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-01d84555-8dd1-4d79-8cc8-73cd662ff797 {{(pid=86591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:16:49 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-403302a5-2e04-4a76-9897-8275f5da6fea tempest-VolumesSnapshotTestJSON-1723175258 None] Converted 1024.00 MB image at 97.98 MB/s Sep 23 00:16:49 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-403302a5-2e04-4a76-9897-8275f5da6fea tempest-VolumesSnapshotTestJSON-1723175258 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-01d84555-8dd1-4d79-8cc8-73cd662ff797 is being set with open permissions: ugo+rw Sep 23 00:16:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-403302a5-2e04-4a76-9897-8275f5da6fea tempest-VolumesSnapshotTestJSON-1723175258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-01d84555-8dd1-4d79-8cc8-73cd662ff797 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:49 devstack sudo[94293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-01d84555-8dd1-4d79-8cc8-73cd662ff797 Sep 23 00:16:49 devstack sudo[94293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:49 devstack sudo[94293]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-403302a5-2e04-4a76-9897-8275f5da6fea tempest-VolumesSnapshotTestJSON-1723175258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-01d84555-8dd1-4d79-8cc8-73cd662ff797" returned: 0 in 0.285s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:49 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-403302a5-2e04-4a76-9897-8275f5da6fea tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "cinder-quobyte-01d84555-8dd1-4d79-8cc8-73cd662ff797" released by "_copy_volume_from_snapshot" :: held 12.083s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:49 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-403302a5-2e04-4a76-9897-8275f5da6fea tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "cinder-quobyte-5cb24c6d-b65c-4f09-9995-417a5706a10d-01d84555-8dd1-4d79-8cc8-73cd662ff797" released by "_create_volume_from_snapshot" :: held 12.176s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-403302a5-2e04-4a76-9897-8275f5da6fea tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.217s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-46447919-e477-4fda-bf1c-f5f2c748c49d tempest-SnapshotsActionsTest-1089900372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.218s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:49 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-46447919-e477-4fda-bf1c-f5f2c748c49d tempest-SnapshotsActionsTest-1089900372 None] Creating offline snapshot 99f42d73-59ef-424a-81ae-17a207940f15 of volume ff12e24b-1371-4c6d-80ae-f7902f3c6373 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:16:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-403302a5-2e04-4a76-9897-8275f5da6fea tempest-VolumesSnapshotTestJSON-1723175258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (100ee0cc-d841-4b8d-8b43-ec73688ba8d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01d84555-8dd1-4d79-8cc8-73cd662ff797', 'volume_size': 1, 'snapshot_id': '5cb24c6d-b65c-4f09-9995-417a5706a10d'}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-403302a5-2e04-4a76-9897-8275f5da6fea tempest-VolumesSnapshotTestJSON-1723175258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23bb979f-0435-4d54-88b8-573c62431964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:49 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2ab708-ac09-4a2a-bfa3-e293c374b937]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-46447919-e477-4fda-bf1c-f5f2c748c49d tempest-SnapshotsActionsTest-1089900372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.f03e245d-7359-4b78-9102-891b4c3dae62 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:49 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-403302a5-2e04-4a76-9897-8275f5da6fea tempest-VolumesSnapshotTestJSON-1723175258 None] Volume volume-01d84555-8dd1-4d79-8cc8-73cd662ff797 (01d84555-8dd1-4d79-8cc8-73cd662ff797): created successfully Sep 23 00:16:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-403302a5-2e04-4a76-9897-8275f5da6fea tempest-VolumesSnapshotTestJSON-1723175258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23bb979f-0435-4d54-88b8-573c62431964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-403302a5-2e04-4a76-9897-8275f5da6fea tempest-VolumesSnapshotTestJSON-1723175258 None] Flow 'volume_create_manager' (ab36f8d7-6f28-4705-808a-15aa50bcc65a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:16:49 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-403302a5-2e04-4a76-9897-8275f5da6fea tempest-VolumesSnapshotTestJSON-1723175258 None] Created volume successfully. Sep 23 00:16:49 devstack sudo[94296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.f03e245d-7359-4b78-9102-891b4c3dae62 Sep 23 00:16:49 devstack sudo[94296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:50 devstack sudo[94296]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-46447919-e477-4fda-bf1c-f5f2c748c49d tempest-SnapshotsActionsTest-1089900372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.f03e245d-7359-4b78-9102-891b4c3dae62" returned: 0 in 0.462s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:50 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-46447919-e477-4fda-bf1c-f5f2c748c49d tempest-SnapshotsActionsTest-1089900372 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:16:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-46447919-e477-4fda-bf1c-f5f2c748c49d tempest-SnapshotsActionsTest-1089900372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.f03e245d-7359-4b78-9102-891b4c3dae62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.99f42d73-59ef-424a-81ae-17a207940f15 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:50 devstack sudo[94302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.f03e245d-7359-4b78-9102-891b4c3dae62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.99f42d73-59ef-424a-81ae-17a207940f15 1G Sep 23 00:16:50 devstack sudo[94302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:50 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a88728cf-a656-402b-ab70-aaa1017cc6b8 tempest-VolumesSnapshotTestJSON-1723175258 None] Acquiring lock "cinder-01d84555-8dd1-4d79-8cc8-73cd662ff797-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:50 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a88728cf-a656-402b-ab70-aaa1017cc6b8 tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "cinder-01d84555-8dd1-4d79-8cc8-73cd662ff797-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:50 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a88728cf-a656-402b-ab70-aaa1017cc6b8 tempest-VolumesSnapshotTestJSON-1723175258 None] Acquiring lock "cinder-quobyte-01d84555-8dd1-4d79-8cc8-73cd662ff797" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:50 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a88728cf-a656-402b-ab70-aaa1017cc6b8 tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "cinder-quobyte-01d84555-8dd1-4d79-8cc8-73cd662ff797" acquired by "delete_volume" :: waited 0.024s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:50 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[77dafc28-0bcf-4412-8456-77b2cef3bd20]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a88728cf-a656-402b-ab70-aaa1017cc6b8 tempest-VolumesSnapshotTestJSON-1723175258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-01d84555-8dd1-4d79-8cc8-73cd662ff797 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:50 devstack sudo[94302]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-46447919-e477-4fda-bf1c-f5f2c748c49d tempest-SnapshotsActionsTest-1089900372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.f03e245d-7359-4b78-9102-891b4c3dae62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.99f42d73-59ef-424a-81ae-17a207940f15 1G" returned: 0 in 0.642s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-46447919-e477-4fda-bf1c-f5f2c748c49d tempest-SnapshotsActionsTest-1089900372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.f03e245d-7359-4b78-9102-891b4c3dae62 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.99f42d73-59ef-424a-81ae-17a207940f15 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:50 devstack sudo[94308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-01d84555-8dd1-4d79-8cc8-73cd662ff797 Sep 23 00:16:50 devstack sudo[94308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:50 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a56ee46-3478-4efd-b6cf-665b810482e8 tempest-ServerActionsTestOtherA-1121932693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:16:50 devstack sudo[94309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.f03e245d-7359-4b78-9102-891b4c3dae62 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.99f42d73-59ef-424a-81ae-17a207940f15 Sep 23 00:16:50 devstack sudo[94309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6a56ee46-3478-4efd-b6cf-665b810482e8 tempest-ServerActionsTestOtherA-1121932693 None] Flow 'volume_create_manager' (987c07f4-e40b-49a6-babe-f91adcbfa934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:16:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6a56ee46-3478-4efd-b6cf-665b810482e8 tempest-ServerActionsTestOtherA-1121932693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4270928d-c9c0-42f1-82b4-193e6bec1aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6a56ee46-3478-4efd-b6cf-665b810482e8 tempest-ServerActionsTestOtherA-1121932693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4270928d-c9c0-42f1-82b4-193e6bec1aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:16:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-715933538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e654e26-6fcb-46ac-8430-e20b758981e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c5fef9d68b149cabc95a584d36f2b4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:51Z,use_quota=True,user_id='0348bfc609ed457880d6167a905ecabf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6a56ee46-3478-4efd-b6cf-665b810482e8 tempest-ServerActionsTestOtherA-1121932693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (969b20a3-32c9-47c1-82c2-68e3adcdabac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6a56ee46-3478-4efd-b6cf-665b810482e8 tempest-ServerActionsTestOtherA-1121932693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (969b20a3-32c9-47c1-82c2-68e3adcdabac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6a56ee46-3478-4efd-b6cf-665b810482e8 tempest-ServerActionsTestOtherA-1121932693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a3f400e-2eb9-41f2-9452-57c1c7e0a1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:50 devstack cinder-volume[86591]: DEBUG cinder.image.glance [None req-6a56ee46-3478-4efd-b6cf-665b810482e8 tempest-ServerActionsTestOtherA-1121932693 None] Creating Keystone auth plugin from conf {{(pid=86591) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 00:16:51 devstack sudo[94308]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a88728cf-a656-402b-ab70-aaa1017cc6b8 tempest-VolumesSnapshotTestJSON-1723175258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-01d84555-8dd1-4d79-8cc8-73cd662ff797" returned: 0 in 0.497s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a88728cf-a656-402b-ab70-aaa1017cc6b8 tempest-VolumesSnapshotTestJSON-1723175258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-01d84555-8dd1-4d79-8cc8-73cd662ff797 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:51 devstack sudo[94318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-01d84555-8dd1-4d79-8cc8-73cd662ff797 Sep 23 00:16:51 devstack sudo[94318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:51 devstack sudo[94309]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-46447919-e477-4fda-bf1c-f5f2c748c49d tempest-SnapshotsActionsTest-1089900372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.f03e245d-7359-4b78-9102-891b4c3dae62 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.99f42d73-59ef-424a-81ae-17a207940f15" returned: 0 in 0.431s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:51 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-46447919-e477-4fda-bf1c-f5f2c748c49d tempest-SnapshotsActionsTest-1089900372 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.99f42d73-59ef-424a-81ae-17a207940f15 is being set with open permissions: ugo+rw Sep 23 00:16:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-46447919-e477-4fda-bf1c-f5f2c748c49d tempest-SnapshotsActionsTest-1089900372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.99f42d73-59ef-424a-81ae-17a207940f15 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:51 devstack sudo[94320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.99f42d73-59ef-424a-81ae-17a207940f15 Sep 23 00:16:51 devstack sudo[94320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6a56ee46-3478-4efd-b6cf-665b810482e8 tempest-ServerActionsTestOtherA-1121932693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a3f400e-2eb9-41f2-9452-57c1c7e0a1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1e654e26-6fcb-46ac-8430-e20b758981e8', 'volume_name': 'volume-1e654e26-6fcb-46ac-8430-e20b758981e8', 'volume_size': 1, 'image_id': 'acf635b7-10f9-4fce-8332-3b60fddafd4d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/acf635b7-10f9-4fce-8332-3b60fddafd4d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '91fff89797994a81952b7814d0d951c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'acf635b7-10f9-4fce-8332-3b60fddafd4d', 'created_at': datetime.datetime(2026, 9, 22, 22, 4, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 4, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/acf635b7-10f9-4fce-8332-3b60fddafd4d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6a56ee46-3478-4efd-b6cf-665b810482e8 tempest-ServerActionsTestOtherA-1121932693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03f22704-8643-4af3-a911-093ab8019c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6a56ee46-3478-4efd-b6cf-665b810482e8 tempest-ServerActionsTestOtherA-1121932693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03f22704-8643-4af3-a911-093ab8019c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6a56ee46-3478-4efd-b6cf-665b810482e8 tempest-ServerActionsTestOtherA-1121932693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16df6b99-dbb7-445c-83bb-de795e9dc1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:51 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-6a56ee46-3478-4efd-b6cf-665b810482e8 tempest-ServerActionsTestOtherA-1121932693 None] Volume 1e654e26-6fcb-46ac-8430-e20b758981e8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1e654e26-6fcb-46ac-8430-e20b758981e8', 'volume_size': 1, 'image_id': 'acf635b7-10f9-4fce-8332-3b60fddafd4d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/acf635b7-10f9-4fce-8332-3b60fddafd4d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '91fff89797994a81952b7814d0d951c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'acf635b7-10f9-4fce-8332-3b60fddafd4d', 'created_at': datetime.datetime(2026, 9, 22, 22, 4, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 4, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/acf635b7-10f9-4fce-8332-3b60fddafd4d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 23 00:16:51 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a56ee46-3478-4efd-b6cf-665b810482e8 tempest-ServerActionsTestOtherA-1121932693 None] Trying to clone 1e654e26-6fcb-46ac-8430-e20b758981e8 from image acf635b7-10f9-4fce-8332-3b60fddafd4d at location (None, [{'url': 'file:///opt/stack/data/glance/images/acf635b7-10f9-4fce-8332-3b60fddafd4d', 'metadata': {}}]). {{(pid=86591) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 00:16:51 devstack sudo[94318]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a88728cf-a656-402b-ab70-aaa1017cc6b8 tempest-VolumesSnapshotTestJSON-1723175258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-01d84555-8dd1-4d79-8cc8-73cd662ff797" returned: 0 in 0.388s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:51 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a88728cf-a656-402b-ab70-aaa1017cc6b8 tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "cinder-quobyte-01d84555-8dd1-4d79-8cc8-73cd662ff797" released by "delete_volume" :: held 0.956s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:51 devstack sudo[94320]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-46447919-e477-4fda-bf1c-f5f2c748c49d tempest-SnapshotsActionsTest-1089900372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.99f42d73-59ef-424a-81ae-17a207940f15" returned: 0 in 0.410s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-46447919-e477-4fda-bf1c-f5f2c748c49d tempest-SnapshotsActionsTest-1089900372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.111s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:51 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-46447919-e477-4fda-bf1c-f5f2c748c49d tempest-SnapshotsActionsTest-1089900372 None] Create snapshot completed successfully Sep 23 00:16:51 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-a88728cf-a656-402b-ab70-aaa1017cc6b8 tempest-VolumesSnapshotTestJSON-1723175258 None] Created reservations ['c8140cb3-cf6f-4b41-a66e-c576cd6d4c77', 'a9e8a151-d80e-4118-95e6-4a9b3723b408', 'af662e23-de86-4c25-8284-f9b2c06f6ae5', '552b9813-6c70-49a6-ba45-efe8b4316923'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:16:51 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-6a56ee46-3478-4efd-b6cf-665b810482e8 tempest-ServerActionsTestOtherA-1121932693 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_1zrlphdwdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86591) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 00:16:51 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-6a56ee46-3478-4efd-b6cf-665b810482e8 tempest-ServerActionsTestOtherA-1121932693 None] Image download 20.69 MB at 20.69 MB/s Sep 23 00:16:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a88728cf-a656-402b-ab70-aaa1017cc6b8 tempest-VolumesSnapshotTestJSON-1723175258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a88728cf-a656-402b-ab70-aaa1017cc6b8 tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:51 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a88728cf-a656-402b-ab70-aaa1017cc6b8 tempest-VolumesSnapshotTestJSON-1723175258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:16:51 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a88728cf-a656-402b-ab70-aaa1017cc6b8 tempest-VolumesSnapshotTestJSON-1723175258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:16:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a88728cf-a656-402b-ab70-aaa1017cc6b8 tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a88728cf-a656-402b-ab70-aaa1017cc6b8 tempest-VolumesSnapshotTestJSON-1723175258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:52 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[86808203-17c9-4170-8dd3-3cb03a227619]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6a56ee46-3478-4efd-b6cf-665b810482e8 tempest-ServerActionsTestOtherA-1121932693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_1zrlphdwdevstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:52 devstack sudo[94325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:16:52 devstack sudo[94325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:52 devstack sudo[94326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_1zrlphdwdevstack@QuobyteHD Sep 23 00:16:52 devstack sudo[94326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:52 devstack sudo[94325]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a88728cf-a656-402b-ab70-aaa1017cc6b8 tempest-VolumesSnapshotTestJSON-1723175258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.316s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:52 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-a88728cf-a656-402b-ab70-aaa1017cc6b8 tempest-VolumesSnapshotTestJSON-1723175258 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:16:52 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-a88728cf-a656-402b-ab70-aaa1017cc6b8 tempest-VolumesSnapshotTestJSON-1723175258 None] Deleted volume successfully. Sep 23 00:16:52 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a88728cf-a656-402b-ab70-aaa1017cc6b8 tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "cinder-01d84555-8dd1-4d79-8cc8-73cd662ff797-delete_volume" released by "delete_volume" :: held 1.807s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:52 devstack sudo[94326]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6a56ee46-3478-4efd-b6cf-665b810482e8 tempest-ServerActionsTestOtherA-1121932693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_1zrlphdwdevstack@QuobyteHD" returned: 0 in 0.462s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:52 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-6a56ee46-3478-4efd-b6cf-665b810482e8 tempest-ServerActionsTestOtherA-1121932693 None] Temporary image acf635b7-10f9-4fce-8332-3b60fddafd4d is fetched for user 0348bfc609ed457880d6167a905ecabf. {{(pid=86591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 00:16:52 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[39139260-6662-4f0b-80b2-71b67019d436]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6a56ee46-3478-4efd-b6cf-665b810482e8 tempest-ServerActionsTestOtherA-1121932693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_1zrlphdwdevstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:52 devstack sudo[94333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_1zrlphdwdevstack@QuobyteHD Sep 23 00:16:52 devstack sudo[94333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:52 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a60de0bf-0774-495f-acbd-bb4b878a1c43 tempest-SnapshotsActionsTest-1442922860 None] Acquiring lock "cinder-99f42d73-59ef-424a-81ae-17a207940f15-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:52 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a60de0bf-0774-495f-acbd-bb4b878a1c43 tempest-SnapshotsActionsTest-1442922860 None] Lock "cinder-99f42d73-59ef-424a-81ae-17a207940f15-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:52 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a60de0bf-0774-495f-acbd-bb4b878a1c43 tempest-SnapshotsActionsTest-1442922860 None] Acquiring lock "cinder-quobyte-ff12e24b-1371-4c6d-80ae-f7902f3c6373" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:52 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a60de0bf-0774-495f-acbd-bb4b878a1c43 tempest-SnapshotsActionsTest-1442922860 None] Lock "cinder-quobyte-ff12e24b-1371-4c6d-80ae-f7902f3c6373" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:52 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a60de0bf-0774-495f-acbd-bb4b878a1c43 tempest-SnapshotsActionsTest-1442922860 None] Acquiring lock "cinder-quobyte-99f42d73-59ef-424a-81ae-17a207940f15" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:53 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a42a0b3b-bfb8-43ea-b7ba-9558e471c4f3 tempest-VolumesSnapshotTestJSON-1723175258 None] Acquiring lock "cinder-5cb24c6d-b65c-4f09-9995-417a5706a10d-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:53 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a60de0bf-0774-495f-acbd-bb4b878a1c43 tempest-SnapshotsActionsTest-1442922860 None] Lock "cinder-quobyte-99f42d73-59ef-424a-81ae-17a207940f15" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:53 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-a60de0bf-0774-495f-acbd-bb4b878a1c43 tempest-SnapshotsActionsTest-1442922860 None] Deleting offline snapshot 99f42d73-59ef-424a-81ae-17a207940f15 of volume ff12e24b-1371-4c6d-80ae-f7902f3c6373 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:16:53 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-a60de0bf-0774-495f-acbd-bb4b878a1c43 tempest-SnapshotsActionsTest-1442922860 None] snapshot_file for this snap is: volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.99f42d73-59ef-424a-81ae-17a207940f15 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:16:53 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a36e491-8d6d-4c65-9dc7-3065d2aa38ff]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a60de0bf-0774-495f-acbd-bb4b878a1c43 tempest-SnapshotsActionsTest-1442922860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.99f42d73-59ef-424a-81ae-17a207940f15 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:53 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a42a0b3b-bfb8-43ea-b7ba-9558e471c4f3 tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "cinder-5cb24c6d-b65c-4f09-9995-417a5706a10d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.084s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:53 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a42a0b3b-bfb8-43ea-b7ba-9558e471c4f3 tempest-VolumesSnapshotTestJSON-1723175258 None] Acquiring lock "cinder-quobyte-6a74ec57-8a00-4075-b0a8-033649a4fc4d" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:53 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a42a0b3b-bfb8-43ea-b7ba-9558e471c4f3 tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "cinder-quobyte-6a74ec57-8a00-4075-b0a8-033649a4fc4d" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:53 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a42a0b3b-bfb8-43ea-b7ba-9558e471c4f3 tempest-VolumesSnapshotTestJSON-1723175258 None] Acquiring lock "cinder-quobyte-5cb24c6d-b65c-4f09-9995-417a5706a10d" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:53 devstack sudo[94333]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6a56ee46-3478-4efd-b6cf-665b810482e8 tempest-ServerActionsTestOtherA-1121932693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_1zrlphdwdevstack@QuobyteHD" returned: 0 in 0.577s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6a56ee46-3478-4efd-b6cf-665b810482e8 tempest-ServerActionsTestOtherA-1121932693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6a56ee46-3478-4efd-b6cf-665b810482e8 tempest-ServerActionsTestOtherA-1121932693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:53 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6a56ee46-3478-4efd-b6cf-665b810482e8 tempest-ServerActionsTestOtherA-1121932693 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:16:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-715933538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e654e26-6fcb-46ac-8430-e20b758981e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c5fef9d68b149cabc95a584d36f2b4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:51Z,use_quota=True,user_id='0348bfc609ed457880d6167a905ecabf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:16:53 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-6a56ee46-3478-4efd-b6cf-665b810482e8 tempest-ServerActionsTestOtherA-1121932693 None] Creating volume 1e654e26-6fcb-46ac-8430-e20b758981e8 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:16:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6a56ee46-3478-4efd-b6cf-665b810482e8 tempest-ServerActionsTestOtherA-1121932693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6a56ee46-3478-4efd-b6cf-665b810482e8 tempest-ServerActionsTestOtherA-1121932693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:53 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6a56ee46-3478-4efd-b6cf-665b810482e8 tempest-ServerActionsTestOtherA-1121932693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:16:53 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6a56ee46-3478-4efd-b6cf-665b810482e8 tempest-ServerActionsTestOtherA-1121932693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:16:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6a56ee46-3478-4efd-b6cf-665b810482e8 tempest-ServerActionsTestOtherA-1121932693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:53 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6a56ee46-3478-4efd-b6cf-665b810482e8 tempest-ServerActionsTestOtherA-1121932693 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:16:53 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-6a56ee46-3478-4efd-b6cf-665b810482e8 tempest-ServerActionsTestOtherA-1121932693 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:16:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6a56ee46-3478-4efd-b6cf-665b810482e8 tempest-ServerActionsTestOtherA-1121932693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1e654e26-6fcb-46ac-8430-e20b758981e8 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:53 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a42a0b3b-bfb8-43ea-b7ba-9558e471c4f3 tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "cinder-quobyte-5cb24c6d-b65c-4f09-9995-417a5706a10d" acquired by "_delete_snapshot" :: waited 0.058s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:53 devstack sudo[94339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1e654e26-6fcb-46ac-8430-e20b758981e8 1073741824 Sep 23 00:16:53 devstack sudo[94339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:53 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-a42a0b3b-bfb8-43ea-b7ba-9558e471c4f3 tempest-VolumesSnapshotTestJSON-1723175258 None] Deleting offline snapshot 5cb24c6d-b65c-4f09-9995-417a5706a10d of volume 6a74ec57-8a00-4075-b0a8-033649a4fc4d {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:16:53 devstack sudo[94336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.99f42d73-59ef-424a-81ae-17a207940f15 Sep 23 00:16:53 devstack sudo[94336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:53 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-a42a0b3b-bfb8-43ea-b7ba-9558e471c4f3 tempest-VolumesSnapshotTestJSON-1723175258 None] snapshot_file for this snap is: volume-6a74ec57-8a00-4075-b0a8-033649a4fc4d.5cb24c6d-b65c-4f09-9995-417a5706a10d {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:16:53 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[1948d35e-918b-4b29-b1d6-be6db72b24a1]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a42a0b3b-bfb8-43ea-b7ba-9558e471c4f3 tempest-VolumesSnapshotTestJSON-1723175258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6a74ec57-8a00-4075-b0a8-033649a4fc4d.5cb24c6d-b65c-4f09-9995-417a5706a10d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:53 devstack sudo[94342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6a74ec57-8a00-4075-b0a8-033649a4fc4d.5cb24c6d-b65c-4f09-9995-417a5706a10d Sep 23 00:16:53 devstack sudo[94342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:53 devstack sudo[94336]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a60de0bf-0774-495f-acbd-bb4b878a1c43 tempest-SnapshotsActionsTest-1442922860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.99f42d73-59ef-424a-81ae-17a207940f15" returned: 0 in 0.548s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:53 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-a60de0bf-0774-495f-acbd-bb4b878a1c43 tempest-SnapshotsActionsTest-1442922860 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:16:53 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a291e7f-23c7-44bf-bbc9-c2016e65e88b]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a60de0bf-0774-495f-acbd-bb4b878a1c43 tempest-SnapshotsActionsTest-1442922860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.f03e245d-7359-4b78-9102-891b4c3dae62 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:53 devstack sudo[94342]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a42a0b3b-bfb8-43ea-b7ba-9558e471c4f3 tempest-VolumesSnapshotTestJSON-1723175258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6a74ec57-8a00-4075-b0a8-033649a4fc4d.5cb24c6d-b65c-4f09-9995-417a5706a10d" returned: 0 in 0.570s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:53 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-a42a0b3b-bfb8-43ea-b7ba-9558e471c4f3 tempest-VolumesSnapshotTestJSON-1723175258 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a74ec57-8a00-4075-b0a8-033649a4fc4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:16:53 devstack sudo[94351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.f03e245d-7359-4b78-9102-891b4c3dae62 Sep 23 00:16:53 devstack sudo[94351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:53 devstack sudo[94339]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6a56ee46-3478-4efd-b6cf-665b810482e8 tempest-ServerActionsTestOtherA-1121932693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1e654e26-6fcb-46ac-8430-e20b758981e8 1073741824" returned: 0 in 0.713s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:53 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca833b7-9cc0-4137-b369-8e035823674f]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a42a0b3b-bfb8-43ea-b7ba-9558e471c4f3 tempest-VolumesSnapshotTestJSON-1723175258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6a74ec57-8a00-4075-b0a8-033649a4fc4d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6a56ee46-3478-4efd-b6cf-665b810482e8 tempest-ServerActionsTestOtherA-1121932693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1e654e26-6fcb-46ac-8430-e20b758981e8 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:54 devstack sudo[94357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1e654e26-6fcb-46ac-8430-e20b758981e8 Sep 23 00:16:54 devstack sudo[94357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:54 devstack sudo[94356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6a74ec57-8a00-4075-b0a8-033649a4fc4d Sep 23 00:16:54 devstack sudo[94356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:54 devstack sudo[94351]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a60de0bf-0774-495f-acbd-bb4b878a1c43 tempest-SnapshotsActionsTest-1442922860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.f03e245d-7359-4b78-9102-891b4c3dae62" returned: 0 in 0.715s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-a60de0bf-0774-495f-acbd-bb4b878a1c43 tempest-SnapshotsActionsTest-1442922860 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:16:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a60de0bf-0774-495f-acbd-bb4b878a1c43 tempest-SnapshotsActionsTest-1442922860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.99f42d73-59ef-424a-81ae-17a207940f15 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:54 devstack sudo[94357]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:54 devstack sudo[94364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.99f42d73-59ef-424a-81ae-17a207940f15 Sep 23 00:16:54 devstack sudo[94364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6a56ee46-3478-4efd-b6cf-665b810482e8 tempest-ServerActionsTestOtherA-1121932693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1e654e26-6fcb-46ac-8430-e20b758981e8" returned: 0 in 0.472s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6a56ee46-3478-4efd-b6cf-665b810482e8 tempest-ServerActionsTestOtherA-1121932693 None] <== create_volume: return (1286ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:16:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6a56ee46-3478-4efd-b6cf-665b810482e8 tempest-ServerActionsTestOtherA-1121932693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.291s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:54 devstack cinder-volume[86591]: DEBUG cinder.volume.volume_utils [None req-6a56ee46-3478-4efd-b6cf-665b810482e8 tempest-ServerActionsTestOtherA-1121932693 None] Attempting download of acf635b7-10f9-4fce-8332-3b60fddafd4d ((None, [{'url': 'file:///opt/stack/data/glance/images/acf635b7-10f9-4fce-8332-3b60fddafd4d', 'metadata': {}}])) to volume 1e654e26-6fcb-46ac-8430-e20b758981e8. {{(pid=86591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 00:16:54 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd90fda5-0291-4c4c-bf68-fb569aa844f8]: (4, 'raw') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6a56ee46-3478-4efd-b6cf-665b810482e8 tempest-ServerActionsTestOtherA-1121932693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_acf635b7-10f9-4fce-8332-3b60fddafd4d_j7ayxneh {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:54 devstack sudo[94368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_acf635b7-10f9-4fce-8332-3b60fddafd4d_j7ayxneh Sep 23 00:16:54 devstack sudo[94368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:54 devstack sudo[94356]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a42a0b3b-bfb8-43ea-b7ba-9558e471c4f3 tempest-VolumesSnapshotTestJSON-1723175258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6a74ec57-8a00-4075-b0a8-033649a4fc4d" returned: 0 in 0.895s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a42a0b3b-bfb8-43ea-b7ba-9558e471c4f3 tempest-VolumesSnapshotTestJSON-1723175258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6a74ec57-8a00-4075-b0a8-033649a4fc4d.5cb24c6d-b65c-4f09-9995-417a5706a10d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:54 devstack sudo[94375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6a74ec57-8a00-4075-b0a8-033649a4fc4d.5cb24c6d-b65c-4f09-9995-417a5706a10d Sep 23 00:16:54 devstack sudo[94375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:54 devstack sudo[94364]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a60de0bf-0774-495f-acbd-bb4b878a1c43 tempest-SnapshotsActionsTest-1442922860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.99f42d73-59ef-424a-81ae-17a207940f15" returned: 0 in 0.542s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a60de0bf-0774-495f-acbd-bb4b878a1c43 tempest-SnapshotsActionsTest-1442922860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.99f42d73-59ef-424a-81ae-17a207940f15 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:54 devstack sudo[94368]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:54 devstack sudo[94379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.99f42d73-59ef-424a-81ae-17a207940f15 Sep 23 00:16:54 devstack sudo[94379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6a56ee46-3478-4efd-b6cf-665b810482e8 tempest-ServerActionsTestOtherA-1121932693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_acf635b7-10f9-4fce-8332-3b60fddafd4d_j7ayxneh" returned: 0 in 0.456s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6a56ee46-3478-4efd-b6cf-665b810482e8 tempest-ServerActionsTestOtherA-1121932693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_acf635b7-10f9-4fce-8332-3b60fddafd4d_j7ayxneh {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:55 devstack sudo[94379]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a60de0bf-0774-495f-acbd-bb4b878a1c43 tempest-SnapshotsActionsTest-1442922860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.99f42d73-59ef-424a-81ae-17a207940f15" returned: 0 in 0.399s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:55 devstack sudo[94381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_acf635b7-10f9-4fce-8332-3b60fddafd4d_j7ayxneh Sep 23 00:16:55 devstack sudo[94381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:55 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a60de0bf-0774-495f-acbd-bb4b878a1c43 tempest-SnapshotsActionsTest-1442922860 None] Lock "cinder-quobyte-99f42d73-59ef-424a-81ae-17a207940f15" released by "_delete_snapshot" :: held 2.367s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:55 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a60de0bf-0774-495f-acbd-bb4b878a1c43 tempest-SnapshotsActionsTest-1442922860 None] Lock "cinder-quobyte-ff12e24b-1371-4c6d-80ae-f7902f3c6373" released by "delete_snapshot" :: held 2.411s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:55 devstack sudo[94375]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a42a0b3b-bfb8-43ea-b7ba-9558e471c4f3 tempest-VolumesSnapshotTestJSON-1723175258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6a74ec57-8a00-4075-b0a8-033649a4fc4d.5cb24c6d-b65c-4f09-9995-417a5706a10d" returned: 0 in 0.696s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a42a0b3b-bfb8-43ea-b7ba-9558e471c4f3 tempest-VolumesSnapshotTestJSON-1723175258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6a74ec57-8a00-4075-b0a8-033649a4fc4d.5cb24c6d-b65c-4f09-9995-417a5706a10d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:55 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-a60de0bf-0774-495f-acbd-bb4b878a1c43 tempest-SnapshotsActionsTest-1442922860 None] Created reservations ['07fd18ee-56bf-4355-8975-eb14b2ef15b4', '40eef9f0-0e69-4c0d-8bb1-1614405f64cc', 'f43038e5-f8ee-4c52-94e4-1ee240324078', '962277b3-028f-45a2-b832-fc8fdd62ca19'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:16:55 devstack sudo[94393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6a74ec57-8a00-4075-b0a8-033649a4fc4d.5cb24c6d-b65c-4f09-9995-417a5706a10d Sep 23 00:16:55 devstack sudo[94393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:55 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-a60de0bf-0774-495f-acbd-bb4b878a1c43 tempest-SnapshotsActionsTest-1442922860 None] Delete snapshot completed successfully. Sep 23 00:16:55 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a60de0bf-0774-495f-acbd-bb4b878a1c43 tempest-SnapshotsActionsTest-1442922860 None] Lock "cinder-99f42d73-59ef-424a-81ae-17a207940f15-delete_snapshot" released by "delete_snapshot" :: held 2.677s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:55 devstack sudo[94381]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6a56ee46-3478-4efd-b6cf-665b810482e8 tempest-ServerActionsTestOtherA-1121932693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_acf635b7-10f9-4fce-8332-3b60fddafd4d_j7ayxneh" returned: 1 in 0.684s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6a56ee46-3478-4efd-b6cf-665b810482e8 tempest-ServerActionsTestOtherA-1121932693 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_acf635b7-10f9-4fce-8332-3b60fddafd4d_j7ayxneh' failed. Not Retrying. {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:16:55 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25e5664-f0fa-46c8-badb-f4faad3e0333]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6a56ee46-3478-4efd-b6cf-665b810482e8 tempest-ServerActionsTestOtherA-1121932693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_1zrlphdwdevstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:55 devstack sudo[94397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_1zrlphdwdevstack@QuobyteHD Sep 23 00:16:55 devstack sudo[94397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:55 devstack sudo[94393]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a42a0b3b-bfb8-43ea-b7ba-9558e471c4f3 tempest-VolumesSnapshotTestJSON-1723175258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6a74ec57-8a00-4075-b0a8-033649a4fc4d.5cb24c6d-b65c-4f09-9995-417a5706a10d" returned: 0 in 0.345s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:55 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a42a0b3b-bfb8-43ea-b7ba-9558e471c4f3 tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "cinder-quobyte-5cb24c6d-b65c-4f09-9995-417a5706a10d" released by "_delete_snapshot" :: held 2.718s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:55 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a42a0b3b-bfb8-43ea-b7ba-9558e471c4f3 tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "cinder-quobyte-6a74ec57-8a00-4075-b0a8-033649a4fc4d" released by "delete_snapshot" :: held 2.789s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:56 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-a42a0b3b-bfb8-43ea-b7ba-9558e471c4f3 tempest-VolumesSnapshotTestJSON-1723175258 None] Created reservations ['cb409723-368b-4a04-9d8d-0a2d4d4dcfb1', '210c4eae-093e-414d-a7ea-b68388eb0c22', '2c748f0f-84a2-45a0-9614-d3ad54fe440a', '915321ed-0f2e-4a7c-b04e-dd405a3571aa'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:16:56 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-a42a0b3b-bfb8-43ea-b7ba-9558e471c4f3 tempest-VolumesSnapshotTestJSON-1723175258 None] Delete snapshot completed successfully. Sep 23 00:16:56 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a42a0b3b-bfb8-43ea-b7ba-9558e471c4f3 tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "cinder-5cb24c6d-b65c-4f09-9995-417a5706a10d-delete_snapshot" released by "delete_snapshot" :: held 3.022s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:56 devstack sudo[94397]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6a56ee46-3478-4efd-b6cf-665b810482e8 tempest-ServerActionsTestOtherA-1121932693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_1zrlphdwdevstack@QuobyteHD" returned: 0 in 0.495s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:56 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-6a56ee46-3478-4efd-b6cf-665b810482e8 tempest-ServerActionsTestOtherA-1121932693 None] acf635b7-10f9-4fce-8332-3b60fddafd4d was qcow2, converting to qcow2 {{(pid=86591) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 00:16:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6a56ee46-3478-4efd-b6cf-665b810482e8 tempest-ServerActionsTestOtherA-1121932693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_1zrlphdwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1e654e26-6fcb-46ac-8430-e20b758981e8 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:56 devstack sudo[94404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_1zrlphdwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1e654e26-6fcb-46ac-8430-e20b758981e8 Sep 23 00:16:56 devstack sudo[94404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:56 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-11a16268-2225-4e0b-bf01-08f76eb96831 tempest-AttachVolumeTestJSON-1775429087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:16:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-11a16268-2225-4e0b-bf01-08f76eb96831 tempest-AttachVolumeTestJSON-1775429087 None] Flow 'volume_create_manager' (a2413f21-8c8c-4a16-8783-34e2fbacf8ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:16:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-11a16268-2225-4e0b-bf01-08f76eb96831 tempest-AttachVolumeTestJSON-1775429087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b7bf53b-adf4-4cec-a9b3-5623319254d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-11a16268-2225-4e0b-bf01-08f76eb96831 tempest-AttachVolumeTestJSON-1775429087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b7bf53b-adf4-4cec-a9b3-5623319254d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1992986860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=590c0ac5-22f0-4a2a-85fd-ff39a46eca1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af53b1db3fee46049ab1e7d617ac9600',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:57Z,use_quota=True,user_id='2766cb7c74324c74a6c350b59e29f6f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-11a16268-2225-4e0b-bf01-08f76eb96831 tempest-AttachVolumeTestJSON-1775429087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cdfd2f3-c2bd-47d0-81f7-d17f1a20376d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-11a16268-2225-4e0b-bf01-08f76eb96831 tempest-AttachVolumeTestJSON-1775429087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cdfd2f3-c2bd-47d0-81f7-d17f1a20376d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-11a16268-2225-4e0b-bf01-08f76eb96831 tempest-AttachVolumeTestJSON-1775429087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0bdcf7a-377c-418d-b60f-619ffbabb3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-11a16268-2225-4e0b-bf01-08f76eb96831 tempest-AttachVolumeTestJSON-1775429087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0bdcf7a-377c-418d-b60f-619ffbabb3e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '590c0ac5-22f0-4a2a-85fd-ff39a46eca1b', 'volume_name': 'volume-590c0ac5-22f0-4a2a-85fd-ff39a46eca1b', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-11a16268-2225-4e0b-bf01-08f76eb96831 tempest-AttachVolumeTestJSON-1775429087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eff41baf-73d1-4d9e-b9b5-19acbad0d108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-11a16268-2225-4e0b-bf01-08f76eb96831 tempest-AttachVolumeTestJSON-1775429087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eff41baf-73d1-4d9e-b9b5-19acbad0d108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-11a16268-2225-4e0b-bf01-08f76eb96831 tempest-AttachVolumeTestJSON-1775429087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f073c23f-3e94-47cd-a4ee-75c38205b8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:56 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-11a16268-2225-4e0b-bf01-08f76eb96831 tempest-AttachVolumeTestJSON-1775429087 None] Volume 590c0ac5-22f0-4a2a-85fd-ff39a46eca1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-590c0ac5-22f0-4a2a-85fd-ff39a46eca1b', 'volume_size': 1} Sep 23 00:16:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-11a16268-2225-4e0b-bf01-08f76eb96831 tempest-AttachVolumeTestJSON-1775429087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-11a16268-2225-4e0b-bf01-08f76eb96831 tempest-AttachVolumeTestJSON-1775429087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:56 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-11a16268-2225-4e0b-bf01-08f76eb96831 tempest-AttachVolumeTestJSON-1775429087 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1992986860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=590c0ac5-22f0-4a2a-85fd-ff39a46eca1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af53b1db3fee46049ab1e7d617ac9600',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:57Z,use_quota=True,user_id='2766cb7c74324c74a6c350b59e29f6f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:16:56 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-11a16268-2225-4e0b-bf01-08f76eb96831 tempest-AttachVolumeTestJSON-1775429087 None] Creating volume 590c0ac5-22f0-4a2a-85fd-ff39a46eca1b {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:16:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-11a16268-2225-4e0b-bf01-08f76eb96831 tempest-AttachVolumeTestJSON-1775429087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-11a16268-2225-4e0b-bf01-08f76eb96831 tempest-AttachVolumeTestJSON-1775429087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:56 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-11a16268-2225-4e0b-bf01-08f76eb96831 tempest-AttachVolumeTestJSON-1775429087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:16:56 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-11a16268-2225-4e0b-bf01-08f76eb96831 tempest-AttachVolumeTestJSON-1775429087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:16:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-11a16268-2225-4e0b-bf01-08f76eb96831 tempest-AttachVolumeTestJSON-1775429087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:56 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-11a16268-2225-4e0b-bf01-08f76eb96831 tempest-AttachVolumeTestJSON-1775429087 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:16:56 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-11a16268-2225-4e0b-bf01-08f76eb96831 tempest-AttachVolumeTestJSON-1775429087 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:16:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-11a16268-2225-4e0b-bf01-08f76eb96831 tempest-AttachVolumeTestJSON-1775429087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-590c0ac5-22f0-4a2a-85fd-ff39a46eca1b 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:56 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8c59ec3c-6d8c-47ea-bc6f-c5cf6abfd300 tempest-VolumesSnapshotTestJSON-1723175258 None] Acquiring lock "cinder-6a74ec57-8a00-4075-b0a8-033649a4fc4d-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:56 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8c59ec3c-6d8c-47ea-bc6f-c5cf6abfd300 tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "cinder-6a74ec57-8a00-4075-b0a8-033649a4fc4d-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:56 devstack sudo[94412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-590c0ac5-22f0-4a2a-85fd-ff39a46eca1b 1073741824 Sep 23 00:16:56 devstack sudo[94412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:57 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8c59ec3c-6d8c-47ea-bc6f-c5cf6abfd300 tempest-VolumesSnapshotTestJSON-1723175258 None] Acquiring lock "cinder-quobyte-6a74ec57-8a00-4075-b0a8-033649a4fc4d" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:57 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8c59ec3c-6d8c-47ea-bc6f-c5cf6abfd300 tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "cinder-quobyte-6a74ec57-8a00-4075-b0a8-033649a4fc4d" acquired by "delete_volume" :: waited 0.032s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:57 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d9c558-0883-4f16-8ccd-a7c4298d5a9d]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8c59ec3c-6d8c-47ea-bc6f-c5cf6abfd300 tempest-VolumesSnapshotTestJSON-1723175258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6a74ec57-8a00-4075-b0a8-033649a4fc4d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6f3f564f-df1b-40b0-a08b-36b446db3121 tempest-SnapshotsActionsTest-1089900372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:57 devstack sudo[94422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6a74ec57-8a00-4075-b0a8-033649a4fc4d Sep 23 00:16:57 devstack sudo[94422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:57 devstack sudo[94412]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-11a16268-2225-4e0b-bf01-08f76eb96831 tempest-AttachVolumeTestJSON-1775429087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-590c0ac5-22f0-4a2a-85fd-ff39a46eca1b 1073741824" returned: 0 in 0.819s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-11a16268-2225-4e0b-bf01-08f76eb96831 tempest-AttachVolumeTestJSON-1775429087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-590c0ac5-22f0-4a2a-85fd-ff39a46eca1b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:57 devstack sudo[94440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-590c0ac5-22f0-4a2a-85fd-ff39a46eca1b Sep 23 00:16:57 devstack sudo[94440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:57 devstack sudo[94422]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8c59ec3c-6d8c-47ea-bc6f-c5cf6abfd300 tempest-VolumesSnapshotTestJSON-1723175258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6a74ec57-8a00-4075-b0a8-033649a4fc4d" returned: 0 in 0.638s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8c59ec3c-6d8c-47ea-bc6f-c5cf6abfd300 tempest-VolumesSnapshotTestJSON-1723175258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6a74ec57-8a00-4075-b0a8-033649a4fc4d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:57 devstack sudo[94442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6a74ec57-8a00-4075-b0a8-033649a4fc4d Sep 23 00:16:57 devstack sudo[94442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:58 devstack sudo[94440]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-11a16268-2225-4e0b-bf01-08f76eb96831 tempest-AttachVolumeTestJSON-1775429087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-590c0ac5-22f0-4a2a-85fd-ff39a46eca1b" returned: 0 in 0.438s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:58 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-11a16268-2225-4e0b-bf01-08f76eb96831 tempest-AttachVolumeTestJSON-1775429087 None] <== create_volume: return (1344ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:16:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-11a16268-2225-4e0b-bf01-08f76eb96831 tempest-AttachVolumeTestJSON-1775429087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.351s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:58 devstack sudo[94442]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6f3f564f-df1b-40b0-a08b-36b446db3121 tempest-SnapshotsActionsTest-1089900372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.996s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-11a16268-2225-4e0b-bf01-08f76eb96831 tempest-AttachVolumeTestJSON-1775429087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f073c23f-3e94-47cd-a4ee-75c38205b8b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-590c0ac5-22f0-4a2a-85fd-ff39a46eca1b', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-11a16268-2225-4e0b-bf01-08f76eb96831 tempest-AttachVolumeTestJSON-1775429087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e453d093-e2d0-4ca0-bc43-1722f2b1b240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8c59ec3c-6d8c-47ea-bc6f-c5cf6abfd300 tempest-VolumesSnapshotTestJSON-1723175258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6a74ec57-8a00-4075-b0a8-033649a4fc4d" returned: 0 in 0.457s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:58 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-6f3f564f-df1b-40b0-a08b-36b446db3121 tempest-SnapshotsActionsTest-1089900372 None] Creating offline snapshot 9fa7e071-6908-4749-bf55-857cc1b1a76b of volume ff12e24b-1371-4c6d-80ae-f7902f3c6373 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:16:58 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-11a16268-2225-4e0b-bf01-08f76eb96831 tempest-AttachVolumeTestJSON-1775429087 None] Volume volume-590c0ac5-22f0-4a2a-85fd-ff39a46eca1b (590c0ac5-22f0-4a2a-85fd-ff39a46eca1b): created successfully Sep 23 00:16:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-11a16268-2225-4e0b-bf01-08f76eb96831 tempest-AttachVolumeTestJSON-1775429087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e453d093-e2d0-4ca0-bc43-1722f2b1b240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-11a16268-2225-4e0b-bf01-08f76eb96831 tempest-AttachVolumeTestJSON-1775429087 None] Flow 'volume_create_manager' (a2413f21-8c8c-4a16-8783-34e2fbacf8ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:16:58 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8c59ec3c-6d8c-47ea-bc6f-c5cf6abfd300 tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "cinder-quobyte-6a74ec57-8a00-4075-b0a8-033649a4fc4d" released by "delete_volume" :: held 1.288s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:58 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a3cb6c-9db7-4e31-a90e-76a45c28fa32]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6f3f564f-df1b-40b0-a08b-36b446db3121 tempest-SnapshotsActionsTest-1089900372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.f03e245d-7359-4b78-9102-891b4c3dae62 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:58 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-11a16268-2225-4e0b-bf01-08f76eb96831 tempest-AttachVolumeTestJSON-1775429087 None] Created volume successfully. Sep 23 00:16:58 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-8c59ec3c-6d8c-47ea-bc6f-c5cf6abfd300 tempest-VolumesSnapshotTestJSON-1723175258 None] Created reservations ['f4763897-1b96-42f5-8a32-0ff0b4549d1b', '9e1d8003-331d-41e0-ae5e-2f2427c5a225', '839ef3dc-526c-4445-a16a-d3862b4ecb05', '58c57dfd-a778-45f1-a82a-a714a6b6ec69'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:16:58 devstack sudo[94446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.f03e245d-7359-4b78-9102-891b4c3dae62 Sep 23 00:16:58 devstack sudo[94446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8c59ec3c-6d8c-47ea-bc6f-c5cf6abfd300 tempest-VolumesSnapshotTestJSON-1723175258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8c59ec3c-6d8c-47ea-bc6f-c5cf6abfd300 tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:58 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-8c59ec3c-6d8c-47ea-bc6f-c5cf6abfd300 tempest-VolumesSnapshotTestJSON-1723175258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:16:58 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-8c59ec3c-6d8c-47ea-bc6f-c5cf6abfd300 tempest-VolumesSnapshotTestJSON-1723175258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:16:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8c59ec3c-6d8c-47ea-bc6f-c5cf6abfd300 tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8c59ec3c-6d8c-47ea-bc6f-c5cf6abfd300 tempest-VolumesSnapshotTestJSON-1723175258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:58 devstack sudo[94448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:16:58 devstack sudo[94448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:58 devstack sudo[94448]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:58 devstack sudo[94446]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6f3f564f-df1b-40b0-a08b-36b446db3121 tempest-SnapshotsActionsTest-1089900372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.f03e245d-7359-4b78-9102-891b4c3dae62" returned: 0 in 0.619s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8c59ec3c-6d8c-47ea-bc6f-c5cf6abfd300 tempest-VolumesSnapshotTestJSON-1723175258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.362s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:58 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-6f3f564f-df1b-40b0-a08b-36b446db3121 tempest-SnapshotsActionsTest-1089900372 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:16:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6f3f564f-df1b-40b0-a08b-36b446db3121 tempest-SnapshotsActionsTest-1089900372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.f03e245d-7359-4b78-9102-891b4c3dae62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.9fa7e071-6908-4749-bf55-857cc1b1a76b 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:58 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-8c59ec3c-6d8c-47ea-bc6f-c5cf6abfd300 tempest-VolumesSnapshotTestJSON-1723175258 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:16:58 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-8c59ec3c-6d8c-47ea-bc6f-c5cf6abfd300 tempest-VolumesSnapshotTestJSON-1723175258 None] Deleted volume successfully. Sep 23 00:16:58 devstack sudo[94458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.f03e245d-7359-4b78-9102-891b4c3dae62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.9fa7e071-6908-4749-bf55-857cc1b1a76b 1G Sep 23 00:16:58 devstack sudo[94458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:59 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8c59ec3c-6d8c-47ea-bc6f-c5cf6abfd300 tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "cinder-6a74ec57-8a00-4075-b0a8-033649a4fc4d-delete_volume" released by "delete_volume" :: held 2.146s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:59 devstack sudo[94404]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6a56ee46-3478-4efd-b6cf-665b810482e8 tempest-ServerActionsTestOtherA-1121932693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_1zrlphdwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1e654e26-6fcb-46ac-8430-e20b758981e8" returned: 0 in 3.074s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:59 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-6a56ee46-3478-4efd-b6cf-665b810482e8 tempest-ServerActionsTestOtherA-1121932693 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_1zrlphdwdevstack@QuobyteHD, size 112.00 MB, duration 3.08 sec, destination /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1e654e26-6fcb-46ac-8430-e20b758981e8 {{(pid=86591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:16:59 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-6a56ee46-3478-4efd-b6cf-665b810482e8 tempest-ServerActionsTestOtherA-1121932693 None] Converted 112.00 MB image at 36.40 MB/s Sep 23 00:16:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6a56ee46-3478-4efd-b6cf-665b810482e8 tempest-ServerActionsTestOtherA-1121932693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1e654e26-6fcb-46ac-8430-e20b758981e8 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:59 devstack sudo[94460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1e654e26-6fcb-46ac-8430-e20b758981e8 1G Sep 23 00:16:59 devstack sudo[94460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:59 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5ffb7d3a-82b8-481f-b13d-704788c19951 tempest-VolumesSnapshotTestJSON-1723175258 None] Acquiring lock "cinder-43b96489-7914-433d-baad-a261d97ef2bf-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:59 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5ffb7d3a-82b8-481f-b13d-704788c19951 tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "cinder-43b96489-7914-433d-baad-a261d97ef2bf-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:59 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5ffb7d3a-82b8-481f-b13d-704788c19951 tempest-VolumesSnapshotTestJSON-1723175258 None] Acquiring lock "cinder-quobyte-43b96489-7914-433d-baad-a261d97ef2bf" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:59 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5ffb7d3a-82b8-481f-b13d-704788c19951 tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "cinder-quobyte-43b96489-7914-433d-baad-a261d97ef2bf" acquired by "delete_volume" :: waited 0.028s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:59 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[7922c065-1fd4-48f7-8aa1-c5660fb393e6]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5ffb7d3a-82b8-481f-b13d-704788c19951 tempest-VolumesSnapshotTestJSON-1723175258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-43b96489-7914-433d-baad-a261d97ef2bf {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:59 devstack sudo[94458]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6f3f564f-df1b-40b0-a08b-36b446db3121 tempest-SnapshotsActionsTest-1089900372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.f03e245d-7359-4b78-9102-891b4c3dae62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.9fa7e071-6908-4749-bf55-857cc1b1a76b 1G" returned: 0 in 0.766s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6f3f564f-df1b-40b0-a08b-36b446db3121 tempest-SnapshotsActionsTest-1089900372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.f03e245d-7359-4b78-9102-891b4c3dae62 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.9fa7e071-6908-4749-bf55-857cc1b1a76b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:59 devstack sudo[94466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-43b96489-7914-433d-baad-a261d97ef2bf Sep 23 00:16:59 devstack sudo[94466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:59 devstack sudo[94478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.f03e245d-7359-4b78-9102-891b4c3dae62 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.9fa7e071-6908-4749-bf55-857cc1b1a76b Sep 23 00:16:59 devstack sudo[94460]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:59 devstack sudo[94478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6a56ee46-3478-4efd-b6cf-665b810482e8 tempest-ServerActionsTestOtherA-1121932693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1e654e26-6fcb-46ac-8430-e20b758981e8 1G" returned: 0 in 0.529s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:59 devstack cinder-volume[86591]: DEBUG cinder.volume.volume_utils [None req-6a56ee46-3478-4efd-b6cf-665b810482e8 tempest-ServerActionsTestOtherA-1121932693 None] Downloaded image acf635b7-10f9-4fce-8332-3b60fddafd4d ((None, [{'url': 'file:///opt/stack/data/glance/images/acf635b7-10f9-4fce-8332-3b60fddafd4d', 'metadata': {}}])) to volume 1e654e26-6fcb-46ac-8430-e20b758981e8 successfully. {{(pid=86591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 00:16:59 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-6a56ee46-3478-4efd-b6cf-665b810482e8 tempest-ServerActionsTestOtherA-1121932693 None] Temporary image acf635b7-10f9-4fce-8332-3b60fddafd4d for user 0348bfc609ed457880d6167a905ecabf is deleted. {{(pid=86591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 00:16:59 devstack cinder-volume[86591]: DEBUG cinder.volume.volume_utils [None req-6a56ee46-3478-4efd-b6cf-665b810482e8 tempest-ServerActionsTestOtherA-1121932693 None] Marking volume 1e654e26-6fcb-46ac-8430-e20b758981e8 as bootable. {{(pid=86591) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 00:16:59 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a56ee46-3478-4efd-b6cf-665b810482e8 tempest-ServerActionsTestOtherA-1121932693 None] Copying metadata from image acf635b7-10f9-4fce-8332-3b60fddafd4d to 1e654e26-6fcb-46ac-8430-e20b758981e8. {{(pid=86591) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 00:16:59 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a56ee46-3478-4efd-b6cf-665b810482e8 tempest-ServerActionsTestOtherA-1121932693 None] Creating volume glance metadata for volume 1e654e26-6fcb-46ac-8430-e20b758981e8 backed by image acf635b7-10f9-4fce-8332-3b60fddafd4d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'acf635b7-10f9-4fce-8332-3b60fddafd4d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86591) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 00:16:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6a56ee46-3478-4efd-b6cf-665b810482e8 tempest-ServerActionsTestOtherA-1121932693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16df6b99-dbb7-445c-83bb-de795e9dc1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e654e26-6fcb-46ac-8430-e20b758981e8', 'volume_size': 1, 'image_id': 'acf635b7-10f9-4fce-8332-3b60fddafd4d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/acf635b7-10f9-4fce-8332-3b60fddafd4d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '91fff89797994a81952b7814d0d951c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'acf635b7-10f9-4fce-8332-3b60fddafd4d', 'created_at': datetime.datetime(2026, 9, 22, 22, 4, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 4, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/acf635b7-10f9-4fce-8332-3b60fddafd4d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6a56ee46-3478-4efd-b6cf-665b810482e8 tempest-ServerActionsTestOtherA-1121932693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2afddc4-fa53-45b3-a36f-cbc121a2274d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:00 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-6a56ee46-3478-4efd-b6cf-665b810482e8 tempest-ServerActionsTestOtherA-1121932693 None] Volume volume-1e654e26-6fcb-46ac-8430-e20b758981e8 (1e654e26-6fcb-46ac-8430-e20b758981e8): created successfully Sep 23 00:17:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6a56ee46-3478-4efd-b6cf-665b810482e8 tempest-ServerActionsTestOtherA-1121932693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2afddc4-fa53-45b3-a36f-cbc121a2274d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6a56ee46-3478-4efd-b6cf-665b810482e8 tempest-ServerActionsTestOtherA-1121932693 None] Flow 'volume_create_manager' (987c07f4-e40b-49a6-babe-f91adcbfa934) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:17:00 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-6a56ee46-3478-4efd-b6cf-665b810482e8 tempest-ServerActionsTestOtherA-1121932693 None] Created volume successfully. Sep 23 00:17:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-12a55666-e7a0-41c4-9769-106dbcec6ed5 req-3161befe-2751-451c-84ad-8bc4ba340382 tempest-AttachVolumeTestJSON-1775429087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:00 devstack sudo[94466]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5ffb7d3a-82b8-481f-b13d-704788c19951 tempest-VolumesSnapshotTestJSON-1723175258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-43b96489-7914-433d-baad-a261d97ef2bf" returned: 0 in 0.569s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5ffb7d3a-82b8-481f-b13d-704788c19951 tempest-VolumesSnapshotTestJSON-1723175258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-43b96489-7914-433d-baad-a261d97ef2bf {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:00 devstack sudo[94487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-43b96489-7914-433d-baad-a261d97ef2bf Sep 23 00:17:00 devstack sudo[94487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:00 devstack sudo[94478]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6f3f564f-df1b-40b0-a08b-36b446db3121 tempest-SnapshotsActionsTest-1089900372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.f03e245d-7359-4b78-9102-891b4c3dae62 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.9fa7e071-6908-4749-bf55-857cc1b1a76b" returned: 0 in 0.524s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:00 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-6f3f564f-df1b-40b0-a08b-36b446db3121 tempest-SnapshotsActionsTest-1089900372 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.9fa7e071-6908-4749-bf55-857cc1b1a76b is being set with open permissions: ugo+rw Sep 23 00:17:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6f3f564f-df1b-40b0-a08b-36b446db3121 tempest-SnapshotsActionsTest-1089900372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.9fa7e071-6908-4749-bf55-857cc1b1a76b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:00 devstack sudo[94491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.9fa7e071-6908-4749-bf55-857cc1b1a76b Sep 23 00:17:00 devstack sudo[94491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:00 devstack sudo[94487]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5ffb7d3a-82b8-481f-b13d-704788c19951 tempest-VolumesSnapshotTestJSON-1723175258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-43b96489-7914-433d-baad-a261d97ef2bf" returned: 0 in 0.384s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:00 devstack sudo[94491]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6f3f564f-df1b-40b0-a08b-36b446db3121 tempest-SnapshotsActionsTest-1089900372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.9fa7e071-6908-4749-bf55-857cc1b1a76b" returned: 0 in 0.286s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:00 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5ffb7d3a-82b8-481f-b13d-704788c19951 tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "cinder-quobyte-43b96489-7914-433d-baad-a261d97ef2bf" released by "delete_volume" :: held 1.066s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6f3f564f-df1b-40b0-a08b-36b446db3121 tempest-SnapshotsActionsTest-1089900372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.421s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-12a55666-e7a0-41c4-9769-106dbcec6ed5 req-3161befe-2751-451c-84ad-8bc4ba340382 tempest-AttachVolumeTestJSON-1775429087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.534s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:00 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-6f3f564f-df1b-40b0-a08b-36b446db3121 tempest-SnapshotsActionsTest-1089900372 None] Create snapshot completed successfully Sep 23 00:17:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-12a55666-e7a0-41c4-9769-106dbcec6ed5 req-3161befe-2751-451c-84ad-8bc4ba340382 tempest-AttachVolumeTestJSON-1775429087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.110s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:00 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-5ffb7d3a-82b8-481f-b13d-704788c19951 tempest-VolumesSnapshotTestJSON-1723175258 None] Created reservations ['eb56d629-beae-43a8-9112-915fa205d9c5', '02d40269-4eb4-4840-9619-8610ebd60da1', '670740f6-6619-4df3-aadd-2b9a825bb078', '82810b53-9c6c-41cd-9b82-1408f24eaa4d'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:17:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-12a55666-e7a0-41c4-9769-106dbcec6ed5 req-3161befe-2751-451c-84ad-8bc4ba340382 tempest-AttachVolumeTestJSON-1775429087 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974', 'name': 'volume-590c0ac5-22f0-4a2a-85fd-ff39a46eca1b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6697c454-e0dc-42df-b7dd-df61cd07813d', 'enforce_multipath': True} {{(pid=86591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:17:00 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-12a55666-e7a0-41c4-9769-106dbcec6ed5 req-3161befe-2751-451c-84ad-8bc4ba340382 tempest-AttachVolumeTestJSON-1775429087 None] attachment_update completed successfully. Sep 23 00:17:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5ffb7d3a-82b8-481f-b13d-704788c19951 tempest-VolumesSnapshotTestJSON-1723175258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5ffb7d3a-82b8-481f-b13d-704788c19951 tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:00 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5ffb7d3a-82b8-481f-b13d-704788c19951 tempest-VolumesSnapshotTestJSON-1723175258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:17:00 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5ffb7d3a-82b8-481f-b13d-704788c19951 tempest-VolumesSnapshotTestJSON-1723175258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:17:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5ffb7d3a-82b8-481f-b13d-704788c19951 tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5ffb7d3a-82b8-481f-b13d-704788c19951 tempest-VolumesSnapshotTestJSON-1723175258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:00 devstack sudo[94495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:17:00 devstack sudo[94495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:01 devstack sudo[94495]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5ffb7d3a-82b8-481f-b13d-704788c19951 tempest-VolumesSnapshotTestJSON-1723175258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.285s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:01 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-5ffb7d3a-82b8-481f-b13d-704788c19951 tempest-VolumesSnapshotTestJSON-1723175258 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:17:01 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-5ffb7d3a-82b8-481f-b13d-704788c19951 tempest-VolumesSnapshotTestJSON-1723175258 None] Deleted volume successfully. Sep 23 00:17:01 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5ffb7d3a-82b8-481f-b13d-704788c19951 tempest-VolumesSnapshotTestJSON-1723175258 None] Lock "cinder-43b96489-7914-433d-baad-a261d97ef2bf-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:01 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b8948e27-5d97-46dc-b62c-fb0fe8e2073d tempest-SnapshotsActionsTest-1442922860 None] Acquiring lock "cinder-9fa7e071-6908-4749-bf55-857cc1b1a76b-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:01 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b8948e27-5d97-46dc-b62c-fb0fe8e2073d tempest-SnapshotsActionsTest-1442922860 None] Lock "cinder-9fa7e071-6908-4749-bf55-857cc1b1a76b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:01 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b8948e27-5d97-46dc-b62c-fb0fe8e2073d tempest-SnapshotsActionsTest-1442922860 None] Acquiring lock "cinder-quobyte-ff12e24b-1371-4c6d-80ae-f7902f3c6373" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:01 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b8948e27-5d97-46dc-b62c-fb0fe8e2073d tempest-SnapshotsActionsTest-1442922860 None] Lock "cinder-quobyte-ff12e24b-1371-4c6d-80ae-f7902f3c6373" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:01 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b8948e27-5d97-46dc-b62c-fb0fe8e2073d tempest-SnapshotsActionsTest-1442922860 None] Acquiring lock "cinder-quobyte-9fa7e071-6908-4749-bf55-857cc1b1a76b" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:01 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b8948e27-5d97-46dc-b62c-fb0fe8e2073d tempest-SnapshotsActionsTest-1442922860 None] Lock "cinder-quobyte-9fa7e071-6908-4749-bf55-857cc1b1a76b" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-b8948e27-5d97-46dc-b62c-fb0fe8e2073d tempest-SnapshotsActionsTest-1442922860 None] Deleting offline snapshot 9fa7e071-6908-4749-bf55-857cc1b1a76b of volume ff12e24b-1371-4c6d-80ae-f7902f3c6373 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:17:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-b8948e27-5d97-46dc-b62c-fb0fe8e2073d tempest-SnapshotsActionsTest-1442922860 None] snapshot_file for this snap is: volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.9fa7e071-6908-4749-bf55-857cc1b1a76b {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:17:01 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[54778c30-4d97-41d0-8f37-d69ec5d4392b]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b8948e27-5d97-46dc-b62c-fb0fe8e2073d tempest-SnapshotsActionsTest-1442922860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.9fa7e071-6908-4749-bf55-857cc1b1a76b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:01 devstack sudo[94910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.9fa7e071-6908-4749-bf55-857cc1b1a76b Sep 23 00:17:01 devstack sudo[94910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:02 devstack sudo[94910]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b8948e27-5d97-46dc-b62c-fb0fe8e2073d tempest-SnapshotsActionsTest-1442922860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.9fa7e071-6908-4749-bf55-857cc1b1a76b" returned: 0 in 0.691s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:02 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-b8948e27-5d97-46dc-b62c-fb0fe8e2073d tempest-SnapshotsActionsTest-1442922860 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:17:02 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45d3498-bdac-4826-96c2-933e28288803]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b8948e27-5d97-46dc-b62c-fb0fe8e2073d tempest-SnapshotsActionsTest-1442922860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.f03e245d-7359-4b78-9102-891b4c3dae62 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:02 devstack sudo[94952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.f03e245d-7359-4b78-9102-891b4c3dae62 Sep 23 00:17:02 devstack sudo[94952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:03 devstack sudo[94952]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b8948e27-5d97-46dc-b62c-fb0fe8e2073d tempest-SnapshotsActionsTest-1442922860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.f03e245d-7359-4b78-9102-891b4c3dae62" returned: 0 in 0.703s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:03 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-b8948e27-5d97-46dc-b62c-fb0fe8e2073d tempest-SnapshotsActionsTest-1442922860 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:17:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b8948e27-5d97-46dc-b62c-fb0fe8e2073d tempest-SnapshotsActionsTest-1442922860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.9fa7e071-6908-4749-bf55-857cc1b1a76b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:03 devstack sudo[94962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.9fa7e071-6908-4749-bf55-857cc1b1a76b Sep 23 00:17:03 devstack sudo[94962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:03 devstack sudo[94962]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b8948e27-5d97-46dc-b62c-fb0fe8e2073d tempest-SnapshotsActionsTest-1442922860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.9fa7e071-6908-4749-bf55-857cc1b1a76b" returned: 0 in 0.648s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b8948e27-5d97-46dc-b62c-fb0fe8e2073d tempest-SnapshotsActionsTest-1442922860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.9fa7e071-6908-4749-bf55-857cc1b1a76b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:03 devstack sudo[94969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.9fa7e071-6908-4749-bf55-857cc1b1a76b Sep 23 00:17:03 devstack sudo[94969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:04 devstack sudo[94969]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b8948e27-5d97-46dc-b62c-fb0fe8e2073d tempest-SnapshotsActionsTest-1442922860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.9fa7e071-6908-4749-bf55-857cc1b1a76b" returned: 0 in 0.652s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:04 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b8948e27-5d97-46dc-b62c-fb0fe8e2073d tempest-SnapshotsActionsTest-1442922860 None] Lock "cinder-quobyte-9fa7e071-6908-4749-bf55-857cc1b1a76b" released by "_delete_snapshot" :: held 2.907s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:04 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b8948e27-5d97-46dc-b62c-fb0fe8e2073d tempest-SnapshotsActionsTest-1442922860 None] Lock "cinder-quobyte-ff12e24b-1371-4c6d-80ae-f7902f3c6373" released by "delete_snapshot" :: held 2.946s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:04 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-b8948e27-5d97-46dc-b62c-fb0fe8e2073d tempest-SnapshotsActionsTest-1442922860 None] Created reservations ['3a675834-f90f-4264-bc22-92c5aeac21bd', '8a733f06-6b54-468a-8a10-5e10da8350ab', 'cc2346c4-4eaa-41a3-99d7-1d460dcfbce6', 'e02ef210-1b33-445d-a31c-d905a07a251b'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:17:04 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-b8948e27-5d97-46dc-b62c-fb0fe8e2073d tempest-SnapshotsActionsTest-1442922860 None] Delete snapshot completed successfully. Sep 23 00:17:04 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b8948e27-5d97-46dc-b62c-fb0fe8e2073d tempest-SnapshotsActionsTest-1442922860 None] Lock "cinder-9fa7e071-6908-4749-bf55-857cc1b1a76b-delete_snapshot" released by "delete_snapshot" :: held 3.364s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-2c51497f-886c-4fc1-b3f9-cb39d1b6014b req-0323ff92-0396-4f80-8306-a3e814c0bc24 tempest-ServerActionsTestOtherA-1121932693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-2c51497f-886c-4fc1-b3f9-cb39d1b6014b req-0323ff92-0396-4f80-8306-a3e814c0bc24 tempest-ServerActionsTestOtherA-1121932693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-2c51497f-886c-4fc1-b3f9-cb39d1b6014b req-0323ff92-0396-4f80-8306-a3e814c0bc24 tempest-ServerActionsTestOtherA-1121932693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.040s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-2c51497f-886c-4fc1-b3f9-cb39d1b6014b req-0323ff92-0396-4f80-8306-a3e814c0bc24 tempest-ServerActionsTestOtherA-1121932693 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974', 'name': 'volume-1e654e26-6fcb-46ac-8430-e20b758981e8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9bcbacaf-5545-4553-a038-8e003fe360b6', 'enforce_multipath': True} {{(pid=86591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:17:05 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e6485f8e-6a6c-4c02-8def-a704a7c482cc tempest-SnapshotsActionsTest-1089900372 None] Acquiring lock "cinder-f03e245d-7359-4b78-9102-891b4c3dae62-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:05 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e6485f8e-6a6c-4c02-8def-a704a7c482cc tempest-SnapshotsActionsTest-1089900372 None] Lock "cinder-f03e245d-7359-4b78-9102-891b4c3dae62-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:05 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e6485f8e-6a6c-4c02-8def-a704a7c482cc tempest-SnapshotsActionsTest-1089900372 None] Acquiring lock "cinder-quobyte-ff12e24b-1371-4c6d-80ae-f7902f3c6373" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:05 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e6485f8e-6a6c-4c02-8def-a704a7c482cc tempest-SnapshotsActionsTest-1089900372 None] Lock "cinder-quobyte-ff12e24b-1371-4c6d-80ae-f7902f3c6373" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:05 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e6485f8e-6a6c-4c02-8def-a704a7c482cc tempest-SnapshotsActionsTest-1089900372 None] Acquiring lock "cinder-quobyte-f03e245d-7359-4b78-9102-891b4c3dae62" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:05 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-2c51497f-886c-4fc1-b3f9-cb39d1b6014b req-0323ff92-0396-4f80-8306-a3e814c0bc24 tempest-ServerActionsTestOtherA-1121932693 None] attachment_update completed successfully. Sep 23 00:17:05 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e6485f8e-6a6c-4c02-8def-a704a7c482cc tempest-SnapshotsActionsTest-1089900372 None] Lock "cinder-quobyte-f03e245d-7359-4b78-9102-891b4c3dae62" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:05 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-e6485f8e-6a6c-4c02-8def-a704a7c482cc tempest-SnapshotsActionsTest-1089900372 None] Deleting offline snapshot f03e245d-7359-4b78-9102-891b4c3dae62 of volume ff12e24b-1371-4c6d-80ae-f7902f3c6373 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:17:05 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-e6485f8e-6a6c-4c02-8def-a704a7c482cc tempest-SnapshotsActionsTest-1089900372 None] snapshot_file for this snap is: volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.f03e245d-7359-4b78-9102-891b4c3dae62 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:17:05 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[5768b4d8-e321-4944-8d9a-974e364d0858]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e6485f8e-6a6c-4c02-8def-a704a7c482cc tempest-SnapshotsActionsTest-1089900372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.f03e245d-7359-4b78-9102-891b4c3dae62 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:06 devstack sudo[94986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.f03e245d-7359-4b78-9102-891b4c3dae62 Sep 23 00:17:06 devstack sudo[94986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:06 devstack sudo[94986]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e6485f8e-6a6c-4c02-8def-a704a7c482cc tempest-SnapshotsActionsTest-1089900372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.f03e245d-7359-4b78-9102-891b4c3dae62" returned: 0 in 0.591s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-e6485f8e-6a6c-4c02-8def-a704a7c482cc tempest-SnapshotsActionsTest-1089900372 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:17:06 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[579f6ee2-185f-4049-8645-45a300256be7]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e6485f8e-6a6c-4c02-8def-a704a7c482cc tempest-SnapshotsActionsTest-1089900372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:06 devstack sudo[94992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373 Sep 23 00:17:06 devstack sudo[94992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:07 devstack sudo[94992]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e6485f8e-6a6c-4c02-8def-a704a7c482cc tempest-SnapshotsActionsTest-1089900372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373" returned: 0 in 0.737s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e6485f8e-6a6c-4c02-8def-a704a7c482cc tempest-SnapshotsActionsTest-1089900372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.f03e245d-7359-4b78-9102-891b4c3dae62 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:07 devstack sudo[94998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.f03e245d-7359-4b78-9102-891b4c3dae62 Sep 23 00:17:07 devstack sudo[94998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:07 devstack sudo[94998]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e6485f8e-6a6c-4c02-8def-a704a7c482cc tempest-SnapshotsActionsTest-1089900372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.f03e245d-7359-4b78-9102-891b4c3dae62" returned: 0 in 0.487s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e6485f8e-6a6c-4c02-8def-a704a7c482cc tempest-SnapshotsActionsTest-1089900372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.f03e245d-7359-4b78-9102-891b4c3dae62 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:07 devstack sudo[95003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.f03e245d-7359-4b78-9102-891b4c3dae62 Sep 23 00:17:07 devstack sudo[95003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:08 devstack sudo[95003]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e6485f8e-6a6c-4c02-8def-a704a7c482cc tempest-SnapshotsActionsTest-1089900372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373.f03e245d-7359-4b78-9102-891b4c3dae62" returned: 0 in 0.382s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:08 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e6485f8e-6a6c-4c02-8def-a704a7c482cc tempest-SnapshotsActionsTest-1089900372 None] Lock "cinder-quobyte-f03e245d-7359-4b78-9102-891b4c3dae62" released by "_delete_snapshot" :: held 2.413s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:08 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e6485f8e-6a6c-4c02-8def-a704a7c482cc tempest-SnapshotsActionsTest-1089900372 None] Lock "cinder-quobyte-ff12e24b-1371-4c6d-80ae-f7902f3c6373" released by "delete_snapshot" :: held 2.457s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:08 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-e6485f8e-6a6c-4c02-8def-a704a7c482cc tempest-SnapshotsActionsTest-1089900372 None] Created reservations ['64c3fe18-ee78-4a7b-82f7-3765470d8ab6', 'b8b10611-c309-4cf7-b0c6-090187e9d0b4', 'c1413035-076a-4785-8ec6-375a76b75154', '40b8f125-3825-42c7-a01c-a3533d78128e'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:17:08 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-e6485f8e-6a6c-4c02-8def-a704a7c482cc tempest-SnapshotsActionsTest-1089900372 None] Delete snapshot completed successfully. Sep 23 00:17:08 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e6485f8e-6a6c-4c02-8def-a704a7c482cc tempest-SnapshotsActionsTest-1089900372 None] Lock "cinder-f03e245d-7359-4b78-9102-891b4c3dae62-delete_snapshot" released by "delete_snapshot" :: held 2.793s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:09 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0b9a6c9f-655f-4759-a129-d8af206fd881 tempest-SnapshotsActionsTest-1089900372 None] Acquiring lock "cinder-ff12e24b-1371-4c6d-80ae-f7902f3c6373-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:09 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0b9a6c9f-655f-4759-a129-d8af206fd881 tempest-SnapshotsActionsTest-1089900372 None] Lock "cinder-ff12e24b-1371-4c6d-80ae-f7902f3c6373-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:09 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0b9a6c9f-655f-4759-a129-d8af206fd881 tempest-SnapshotsActionsTest-1089900372 None] Acquiring lock "cinder-quobyte-ff12e24b-1371-4c6d-80ae-f7902f3c6373" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:09 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0b9a6c9f-655f-4759-a129-d8af206fd881 tempest-SnapshotsActionsTest-1089900372 None] Lock "cinder-quobyte-ff12e24b-1371-4c6d-80ae-f7902f3c6373" acquired by "delete_volume" :: waited 0.027s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:09 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4946aba-4fa0-4a24-95f3-0f2ab28e6ebb]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0b9a6c9f-655f-4759-a129-d8af206fd881 tempest-SnapshotsActionsTest-1089900372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:09 devstack sudo[95014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373 Sep 23 00:17:09 devstack sudo[95014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:10 devstack sudo[95014]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0b9a6c9f-655f-4759-a129-d8af206fd881 tempest-SnapshotsActionsTest-1089900372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373" returned: 0 in 0.516s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0b9a6c9f-655f-4759-a129-d8af206fd881 tempest-SnapshotsActionsTest-1089900372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:10 devstack sudo[95019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373 Sep 23 00:17:10 devstack sudo[95019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:10 devstack sudo[95019]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0b9a6c9f-655f-4759-a129-d8af206fd881 tempest-SnapshotsActionsTest-1089900372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ff12e24b-1371-4c6d-80ae-f7902f3c6373" returned: 0 in 0.375s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:10 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0b9a6c9f-655f-4759-a129-d8af206fd881 tempest-SnapshotsActionsTest-1089900372 None] Lock "cinder-quobyte-ff12e24b-1371-4c6d-80ae-f7902f3c6373" released by "delete_volume" :: held 1.026s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:10 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-0b9a6c9f-655f-4759-a129-d8af206fd881 tempest-SnapshotsActionsTest-1089900372 None] Created reservations ['6c3304ab-9787-4b65-80fa-40bf68274c3a', 'ef042bd8-c5ff-4b29-8df4-9869030dbbc2', 'a2d77dcf-c196-4a60-8f95-f607d5359132', '9411f3c8-8b5f-4e8a-ac90-596a920bac96'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:17:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0b9a6c9f-655f-4759-a129-d8af206fd881 tempest-SnapshotsActionsTest-1089900372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0b9a6c9f-655f-4759-a129-d8af206fd881 tempest-SnapshotsActionsTest-1089900372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:10 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0b9a6c9f-655f-4759-a129-d8af206fd881 tempest-SnapshotsActionsTest-1089900372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:17:10 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0b9a6c9f-655f-4759-a129-d8af206fd881 tempest-SnapshotsActionsTest-1089900372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:17:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0b9a6c9f-655f-4759-a129-d8af206fd881 tempest-SnapshotsActionsTest-1089900372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0b9a6c9f-655f-4759-a129-d8af206fd881 tempest-SnapshotsActionsTest-1089900372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:10 devstack sudo[95023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:17:10 devstack sudo[95023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0b9a6c9f-655f-4759-a129-d8af206fd881 tempest-SnapshotsActionsTest-1089900372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.540s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:11 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-0b9a6c9f-655f-4759-a129-d8af206fd881 tempest-SnapshotsActionsTest-1089900372 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:17:11 devstack sudo[95023]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:11 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-0b9a6c9f-655f-4759-a129-d8af206fd881 tempest-SnapshotsActionsTest-1089900372 None] Deleted volume successfully. Sep 23 00:17:11 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0b9a6c9f-655f-4759-a129-d8af206fd881 tempest-SnapshotsActionsTest-1089900372 None] Lock "cinder-ff12e24b-1371-4c6d-80ae-f7902f3c6373-delete_volume" released by "delete_volume" :: held 2.113s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:13 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:UPDATE=112,cinder:INSERT=43,cinder:SELECT=116,cinder:DELETE=11 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:17:13 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=119,cinder:UPDATE=120,cinder:INSERT=30,cinder:DELETE=7 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:17:13 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-2c51497f-886c-4fc1-b3f9-cb39d1b6014b req-684fdd0c-9311-46ab-bcad-e42b176681f1 tempest-ServerActionsTestOtherA-1121932693 None] Terminate volume connection completed successfully. Sep 23 00:17:13 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-2c51497f-886c-4fc1-b3f9-cb39d1b6014b req-684fdd0c-9311-46ab-bcad-e42b176681f1 tempest-ServerActionsTestOtherA-1121932693 None] Deleting attachment 9bcbacaf-5545-4553-a038-8e003fe360b6. {{(pid=86591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:17:16 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:17:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:17:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:17:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:16 devstack sudo[95313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:17:16 devstack sudo[95313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:17 devstack sudo[95313]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.506s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:17 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:17:17 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running periodic task VolumeManager._thread_info {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:17:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] thread count: 29 {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:17:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] thread info: [<_MainThread(MainThread, started 135440660459648)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:17:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [req-f2b291c3-4bc0-478f-9833-bc8400bd8b88 req-602007a7-3718-4c65-9267-dc242b019689 tempest-ServerActionsTestOtherA-1121932693 None] Acquiring lock "cinder-1e654e26-6fcb-46ac-8430-e20b758981e8-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [req-f2b291c3-4bc0-478f-9833-bc8400bd8b88 req-602007a7-3718-4c65-9267-dc242b019689 tempest-ServerActionsTestOtherA-1121932693 None] Lock "cinder-1e654e26-6fcb-46ac-8430-e20b758981e8-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [req-f2b291c3-4bc0-478f-9833-bc8400bd8b88 req-602007a7-3718-4c65-9267-dc242b019689 tempest-ServerActionsTestOtherA-1121932693 None] Acquiring lock "cinder-quobyte-1e654e26-6fcb-46ac-8430-e20b758981e8" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [req-f2b291c3-4bc0-478f-9833-bc8400bd8b88 req-602007a7-3718-4c65-9267-dc242b019689 tempest-ServerActionsTestOtherA-1121932693 None] Lock "cinder-quobyte-1e654e26-6fcb-46ac-8430-e20b758981e8" acquired by "delete_volume" :: waited 0.044s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:18 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74a5d76-2e77-4700-91ff-92224266bc1b]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-f2b291c3-4bc0-478f-9833-bc8400bd8b88 req-602007a7-3718-4c65-9267-dc242b019689 tempest-ServerActionsTestOtherA-1121932693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1e654e26-6fcb-46ac-8430-e20b758981e8 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:18 devstack sudo[95319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1e654e26-6fcb-46ac-8430-e20b758981e8 Sep 23 00:17:18 devstack sudo[95319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:18 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8d5cf3c-55ae-4da8-af82-1d39758dc6c5 tempest-VolumesSnapshotListTestJSON-1222760958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:17:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c8d5cf3c-55ae-4da8-af82-1d39758dc6c5 tempest-VolumesSnapshotListTestJSON-1222760958 None] Flow 'volume_create_manager' (b11fbacf-8d0a-4c60-b341-29a851a1301f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:17:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c8d5cf3c-55ae-4da8-af82-1d39758dc6c5 tempest-VolumesSnapshotListTestJSON-1222760958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcd8ef56-2dae-4ea6-bfa7-b7133dda8c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c8d5cf3c-55ae-4da8-af82-1d39758dc6c5 tempest-VolumesSnapshotListTestJSON-1222760958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcd8ef56-2dae-4ea6-bfa7-b7133dda8c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:17:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-73514136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6d726d4-5292-4c6f-b2da-2a62545df107,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e3437c89f9c459ea9b0de50ae6adb8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:19Z,use_quota=True,user_id='9aa4aff434cc4cb59d48ac93daa88f43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c8d5cf3c-55ae-4da8-af82-1d39758dc6c5 tempest-VolumesSnapshotListTestJSON-1222760958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a065bd83-1d81-4875-a22a-91da38164401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c8d5cf3c-55ae-4da8-af82-1d39758dc6c5 tempest-VolumesSnapshotListTestJSON-1222760958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a065bd83-1d81-4875-a22a-91da38164401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c8d5cf3c-55ae-4da8-af82-1d39758dc6c5 tempest-VolumesSnapshotListTestJSON-1222760958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51177353-f3a8-4025-a3d4-1b702821985f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c8d5cf3c-55ae-4da8-af82-1d39758dc6c5 tempest-VolumesSnapshotListTestJSON-1222760958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51177353-f3a8-4025-a3d4-1b702821985f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6d726d4-5292-4c6f-b2da-2a62545df107', 'volume_name': 'volume-e6d726d4-5292-4c6f-b2da-2a62545df107', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c8d5cf3c-55ae-4da8-af82-1d39758dc6c5 tempest-VolumesSnapshotListTestJSON-1222760958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9bb2d0f-fcb6-477e-b465-3e4473a24963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c8d5cf3c-55ae-4da8-af82-1d39758dc6c5 tempest-VolumesSnapshotListTestJSON-1222760958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9bb2d0f-fcb6-477e-b465-3e4473a24963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c8d5cf3c-55ae-4da8-af82-1d39758dc6c5 tempest-VolumesSnapshotListTestJSON-1222760958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbff4f4a-0107-4b9a-8ec9-aa3f15c7e376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:18 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-c8d5cf3c-55ae-4da8-af82-1d39758dc6c5 tempest-VolumesSnapshotListTestJSON-1222760958 None] Volume e6d726d4-5292-4c6f-b2da-2a62545df107: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6d726d4-5292-4c6f-b2da-2a62545df107', 'volume_size': 1} Sep 23 00:17:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c8d5cf3c-55ae-4da8-af82-1d39758dc6c5 tempest-VolumesSnapshotListTestJSON-1222760958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c8d5cf3c-55ae-4da8-af82-1d39758dc6c5 tempest-VolumesSnapshotListTestJSON-1222760958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:18 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c8d5cf3c-55ae-4da8-af82-1d39758dc6c5 tempest-VolumesSnapshotListTestJSON-1222760958 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:17:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-73514136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6d726d4-5292-4c6f-b2da-2a62545df107,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e3437c89f9c459ea9b0de50ae6adb8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:19Z,use_quota=True,user_id='9aa4aff434cc4cb59d48ac93daa88f43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:17:18 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-c8d5cf3c-55ae-4da8-af82-1d39758dc6c5 tempest-VolumesSnapshotListTestJSON-1222760958 None] Creating volume e6d726d4-5292-4c6f-b2da-2a62545df107 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:17:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c8d5cf3c-55ae-4da8-af82-1d39758dc6c5 tempest-VolumesSnapshotListTestJSON-1222760958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c8d5cf3c-55ae-4da8-af82-1d39758dc6c5 tempest-VolumesSnapshotListTestJSON-1222760958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:18 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c8d5cf3c-55ae-4da8-af82-1d39758dc6c5 tempest-VolumesSnapshotListTestJSON-1222760958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:17:18 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c8d5cf3c-55ae-4da8-af82-1d39758dc6c5 tempest-VolumesSnapshotListTestJSON-1222760958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:17:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c8d5cf3c-55ae-4da8-af82-1d39758dc6c5 tempest-VolumesSnapshotListTestJSON-1222760958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:18 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c8d5cf3c-55ae-4da8-af82-1d39758dc6c5 tempest-VolumesSnapshotListTestJSON-1222760958 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:17:18 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-c8d5cf3c-55ae-4da8-af82-1d39758dc6c5 tempest-VolumesSnapshotListTestJSON-1222760958 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:17:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c8d5cf3c-55ae-4da8-af82-1d39758dc6c5 tempest-VolumesSnapshotListTestJSON-1222760958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:18 devstack sudo[95321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107 1073741824 Sep 23 00:17:18 devstack sudo[95321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:19 devstack sudo[95319]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-f2b291c3-4bc0-478f-9833-bc8400bd8b88 req-602007a7-3718-4c65-9267-dc242b019689 tempest-ServerActionsTestOtherA-1121932693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1e654e26-6fcb-46ac-8430-e20b758981e8" returned: 0 in 0.677s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-f2b291c3-4bc0-478f-9833-bc8400bd8b88 req-602007a7-3718-4c65-9267-dc242b019689 tempest-ServerActionsTestOtherA-1121932693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1e654e26-6fcb-46ac-8430-e20b758981e8 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:19 devstack sudo[95327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1e654e26-6fcb-46ac-8430-e20b758981e8 Sep 23 00:17:19 devstack sudo[95327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:19 devstack sudo[95327]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-f2b291c3-4bc0-478f-9833-bc8400bd8b88 req-602007a7-3718-4c65-9267-dc242b019689 tempest-ServerActionsTestOtherA-1121932693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1e654e26-6fcb-46ac-8430-e20b758981e8" returned: 0 in 0.421s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [req-f2b291c3-4bc0-478f-9833-bc8400bd8b88 req-602007a7-3718-4c65-9267-dc242b019689 tempest-ServerActionsTestOtherA-1121932693 None] Lock "cinder-quobyte-1e654e26-6fcb-46ac-8430-e20b758981e8" released by "delete_volume" :: held 1.193s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:19 devstack cinder-volume[86591]: DEBUG cinder.quota [req-f2b291c3-4bc0-478f-9833-bc8400bd8b88 req-602007a7-3718-4c65-9267-dc242b019689 tempest-ServerActionsTestOtherA-1121932693 None] Created reservations ['24aaadbb-152c-48dc-8154-777ef733ecee', 'a8239d0c-5b75-4662-bea1-eaf2e2aa623f', 'c166cd3a-82e4-4bbd-a273-f43dcbc24935', 'c11a7fcd-6ec7-4498-b4d0-2f50b6b6f7b9'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:17:19 devstack sudo[95321]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c8d5cf3c-55ae-4da8-af82-1d39758dc6c5 tempest-VolumesSnapshotListTestJSON-1222760958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107 1073741824" returned: 0 in 0.857s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c8d5cf3c-55ae-4da8-af82-1d39758dc6c5 tempest-VolumesSnapshotListTestJSON-1222760958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-f2b291c3-4bc0-478f-9833-bc8400bd8b88 req-602007a7-3718-4c65-9267-dc242b019689 tempest-ServerActionsTestOtherA-1121932693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-f2b291c3-4bc0-478f-9833-bc8400bd8b88 req-602007a7-3718-4c65-9267-dc242b019689 tempest-ServerActionsTestOtherA-1121932693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:19 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [req-f2b291c3-4bc0-478f-9833-bc8400bd8b88 req-602007a7-3718-4c65-9267-dc242b019689 tempest-ServerActionsTestOtherA-1121932693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:17:19 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [req-f2b291c3-4bc0-478f-9833-bc8400bd8b88 req-602007a7-3718-4c65-9267-dc242b019689 tempest-ServerActionsTestOtherA-1121932693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:17:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-f2b291c3-4bc0-478f-9833-bc8400bd8b88 req-602007a7-3718-4c65-9267-dc242b019689 tempest-ServerActionsTestOtherA-1121932693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-f2b291c3-4bc0-478f-9833-bc8400bd8b88 req-602007a7-3718-4c65-9267-dc242b019689 tempest-ServerActionsTestOtherA-1121932693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:19 devstack sudo[95334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107 Sep 23 00:17:19 devstack sudo[95334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:19 devstack sudo[95336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:17:19 devstack sudo[95336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:20 devstack sudo[95334]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:20 devstack sudo[95336]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c8d5cf3c-55ae-4da8-af82-1d39758dc6c5 tempest-VolumesSnapshotListTestJSON-1222760958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107" returned: 0 in 0.509s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:20 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c8d5cf3c-55ae-4da8-af82-1d39758dc6c5 tempest-VolumesSnapshotListTestJSON-1222760958 None] <== create_volume: return (1452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:17:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c8d5cf3c-55ae-4da8-af82-1d39758dc6c5 tempest-VolumesSnapshotListTestJSON-1222760958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.456s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-f2b291c3-4bc0-478f-9833-bc8400bd8b88 req-602007a7-3718-4c65-9267-dc242b019689 tempest-ServerActionsTestOtherA-1121932693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.484s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:20 devstack cinder-volume[86591]: DEBUG cinder.manager [req-f2b291c3-4bc0-478f-9833-bc8400bd8b88 req-602007a7-3718-4c65-9267-dc242b019689 tempest-ServerActionsTestOtherA-1121932693 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:17:20 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-f2b291c3-4bc0-478f-9833-bc8400bd8b88 req-602007a7-3718-4c65-9267-dc242b019689 tempest-ServerActionsTestOtherA-1121932693 None] Deleted volume successfully. Sep 23 00:17:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c8d5cf3c-55ae-4da8-af82-1d39758dc6c5 tempest-VolumesSnapshotListTestJSON-1222760958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbff4f4a-0107-4b9a-8ec9-aa3f15c7e376) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6d726d4-5292-4c6f-b2da-2a62545df107', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c8d5cf3c-55ae-4da8-af82-1d39758dc6c5 tempest-VolumesSnapshotListTestJSON-1222760958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba4b3eda-1063-440e-a2d5-4122f402247f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:20 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-c8d5cf3c-55ae-4da8-af82-1d39758dc6c5 tempest-VolumesSnapshotListTestJSON-1222760958 None] Volume volume-e6d726d4-5292-4c6f-b2da-2a62545df107 (e6d726d4-5292-4c6f-b2da-2a62545df107): created successfully Sep 23 00:17:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c8d5cf3c-55ae-4da8-af82-1d39758dc6c5 tempest-VolumesSnapshotListTestJSON-1222760958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba4b3eda-1063-440e-a2d5-4122f402247f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c8d5cf3c-55ae-4da8-af82-1d39758dc6c5 tempest-VolumesSnapshotListTestJSON-1222760958 None] Flow 'volume_create_manager' (b11fbacf-8d0a-4c60-b341-29a851a1301f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:17:20 devstack cinder-volume[86591]: DEBUG cinder.coordination [req-f2b291c3-4bc0-478f-9833-bc8400bd8b88 req-602007a7-3718-4c65-9267-dc242b019689 tempest-ServerActionsTestOtherA-1121932693 None] Lock "cinder-1e654e26-6fcb-46ac-8430-e20b758981e8-delete_volume" released by "delete_volume" :: held 2.156s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:20 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-c8d5cf3c-55ae-4da8-af82-1d39758dc6c5 tempest-VolumesSnapshotListTestJSON-1222760958 None] Created volume successfully. Sep 23 00:17:20 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-7b1b424a-8843-4ae4-bf0a-7041aeab2f80 tempest-ServerActionsTestOtherA-1121932693 None] Acquiring lock "cinder-1815be18-5aab-4633-8ca2-69aaaa6fb514-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:20 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-7b1b424a-8843-4ae4-bf0a-7041aeab2f80 tempest-ServerActionsTestOtherA-1121932693 None] Lock "cinder-1815be18-5aab-4633-8ca2-69aaaa6fb514-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:20 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-7b1b424a-8843-4ae4-bf0a-7041aeab2f80 tempest-ServerActionsTestOtherA-1121932693 None] Acquiring lock "cinder-quobyte-1815be18-5aab-4633-8ca2-69aaaa6fb514" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:20 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-7b1b424a-8843-4ae4-bf0a-7041aeab2f80 tempest-ServerActionsTestOtherA-1121932693 None] Lock "cinder-quobyte-1815be18-5aab-4633-8ca2-69aaaa6fb514" acquired by "delete_volume" :: waited 0.018s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:20 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb634f9-6199-41af-8b5a-4a284e727a4a]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7b1b424a-8843-4ae4-bf0a-7041aeab2f80 tempest-ServerActionsTestOtherA-1121932693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1815be18-5aab-4633-8ca2-69aaaa6fb514 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:20 devstack sudo[95340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1815be18-5aab-4633-8ca2-69aaaa6fb514 Sep 23 00:17:20 devstack sudo[95340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b600f605-927f-4318-9653-14c4aef8739a tempest-VolumesSnapshotListTestJSON-1222760958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b600f605-927f-4318-9653-14c4aef8739a tempest-VolumesSnapshotListTestJSON-1222760958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:21 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-b600f605-927f-4318-9653-14c4aef8739a tempest-VolumesSnapshotListTestJSON-1222760958 None] Creating offline snapshot f03f9057-a527-4da0-b35a-556badf8fd32 of volume e6d726d4-5292-4c6f-b2da-2a62545df107 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:17:21 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[10007d13-00d6-4691-84b1-f9f0e131ab58]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b600f605-927f-4318-9653-14c4aef8739a tempest-VolumesSnapshotListTestJSON-1222760958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:21 devstack sudo[95340]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7b1b424a-8843-4ae4-bf0a-7041aeab2f80 tempest-ServerActionsTestOtherA-1121932693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1815be18-5aab-4633-8ca2-69aaaa6fb514" returned: 0 in 0.657s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7b1b424a-8843-4ae4-bf0a-7041aeab2f80 tempest-ServerActionsTestOtherA-1121932693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1815be18-5aab-4633-8ca2-69aaaa6fb514 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:21 devstack sudo[95342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107 Sep 23 00:17:21 devstack sudo[95342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:21 devstack sudo[95347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1815be18-5aab-4633-8ca2-69aaaa6fb514 Sep 23 00:17:21 devstack sudo[95347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:21 devstack sudo[95347]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7b1b424a-8843-4ae4-bf0a-7041aeab2f80 tempest-ServerActionsTestOtherA-1121932693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1815be18-5aab-4633-8ca2-69aaaa6fb514" returned: 0 in 0.362s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:21 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-7b1b424a-8843-4ae4-bf0a-7041aeab2f80 tempest-ServerActionsTestOtherA-1121932693 None] Lock "cinder-quobyte-1815be18-5aab-4633-8ca2-69aaaa6fb514" released by "delete_volume" :: held 1.088s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:21 devstack sudo[95342]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b600f605-927f-4318-9653-14c4aef8739a tempest-VolumesSnapshotListTestJSON-1222760958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107" returned: 0 in 0.562s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b600f605-927f-4318-9653-14c4aef8739a tempest-VolumesSnapshotListTestJSON-1222760958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.f03f9057-a527-4da0-b35a-556badf8fd32 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:21 devstack sudo[95353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.f03f9057-a527-4da0-b35a-556badf8fd32 1G Sep 23 00:17:21 devstack sudo[95353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:21 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-7b1b424a-8843-4ae4-bf0a-7041aeab2f80 tempest-ServerActionsTestOtherA-1121932693 None] Created reservations ['676441eb-fc73-4e4b-94a3-f32208781b3a', 'a9dba445-1479-4640-abac-ddb001ac84cb', '560398cf-77ba-4738-8011-61f9a9cab92d', '5b2cdb63-9cdd-4905-bd90-427edd35f139'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:17:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7b1b424a-8843-4ae4-bf0a-7041aeab2f80 tempest-ServerActionsTestOtherA-1121932693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7b1b424a-8843-4ae4-bf0a-7041aeab2f80 tempest-ServerActionsTestOtherA-1121932693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:21 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7b1b424a-8843-4ae4-bf0a-7041aeab2f80 tempest-ServerActionsTestOtherA-1121932693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:17:21 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7b1b424a-8843-4ae4-bf0a-7041aeab2f80 tempest-ServerActionsTestOtherA-1121932693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:17:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7b1b424a-8843-4ae4-bf0a-7041aeab2f80 tempest-ServerActionsTestOtherA-1121932693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7b1b424a-8843-4ae4-bf0a-7041aeab2f80 tempest-ServerActionsTestOtherA-1121932693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:21 devstack sudo[95355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:17:21 devstack sudo[95355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:22 devstack sudo[95355]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7b1b424a-8843-4ae4-bf0a-7041aeab2f80 tempest-ServerActionsTestOtherA-1121932693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.415s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:22 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-7b1b424a-8843-4ae4-bf0a-7041aeab2f80 tempest-ServerActionsTestOtherA-1121932693 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:17:22 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-7b1b424a-8843-4ae4-bf0a-7041aeab2f80 tempest-ServerActionsTestOtherA-1121932693 None] Deleted volume successfully. Sep 23 00:17:22 devstack sudo[95353]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b600f605-927f-4318-9653-14c4aef8739a tempest-VolumesSnapshotListTestJSON-1222760958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.f03f9057-a527-4da0-b35a-556badf8fd32 1G" returned: 0 in 0.649s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b600f605-927f-4318-9653-14c4aef8739a tempest-VolumesSnapshotListTestJSON-1222760958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6d726d4-5292-4c6f-b2da-2a62545df107 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.f03f9057-a527-4da0-b35a-556badf8fd32 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:22 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-7b1b424a-8843-4ae4-bf0a-7041aeab2f80 tempest-ServerActionsTestOtherA-1121932693 None] Lock "cinder-1815be18-5aab-4633-8ca2-69aaaa6fb514-delete_volume" released by "delete_volume" :: held 1.855s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:22 devstack sudo[95362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6d726d4-5292-4c6f-b2da-2a62545df107 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.f03f9057-a527-4da0-b35a-556badf8fd32 Sep 23 00:17:22 devstack sudo[95362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:22 devstack sudo[95362]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b600f605-927f-4318-9653-14c4aef8739a tempest-VolumesSnapshotListTestJSON-1222760958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6d726d4-5292-4c6f-b2da-2a62545df107 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.f03f9057-a527-4da0-b35a-556badf8fd32" returned: 0 in 0.402s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:22 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-b600f605-927f-4318-9653-14c4aef8739a tempest-VolumesSnapshotListTestJSON-1222760958 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.f03f9057-a527-4da0-b35a-556badf8fd32 is being set with open permissions: ugo+rw Sep 23 00:17:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b600f605-927f-4318-9653-14c4aef8739a tempest-VolumesSnapshotListTestJSON-1222760958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.f03f9057-a527-4da0-b35a-556badf8fd32 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:22 devstack sudo[95367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.f03f9057-a527-4da0-b35a-556badf8fd32 Sep 23 00:17:22 devstack sudo[95367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:23 devstack sudo[95367]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b600f605-927f-4318-9653-14c4aef8739a tempest-VolumesSnapshotListTestJSON-1222760958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.f03f9057-a527-4da0-b35a-556badf8fd32" returned: 0 in 0.513s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b600f605-927f-4318-9653-14c4aef8739a tempest-VolumesSnapshotListTestJSON-1222760958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:23 devstack sudo[95373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.info Sep 23 00:17:23 devstack sudo[95373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:23 devstack sudo[95373]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b600f605-927f-4318-9653-14c4aef8739a tempest-VolumesSnapshotListTestJSON-1222760958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.info" returned: 0 in 0.544s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:23 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-b600f605-927f-4318-9653-14c4aef8739a tempest-VolumesSnapshotListTestJSON-1222760958 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.info is being set with open permissions: ugo+rw Sep 23 00:17:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b600f605-927f-4318-9653-14c4aef8739a tempest-VolumesSnapshotListTestJSON-1222760958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:23 devstack sudo[95394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.info Sep 23 00:17:23 devstack sudo[95394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:24 devstack sudo[95394]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b600f605-927f-4318-9653-14c4aef8739a tempest-VolumesSnapshotListTestJSON-1222760958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.info" returned: 0 in 0.490s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b600f605-927f-4318-9653-14c4aef8739a tempest-VolumesSnapshotListTestJSON-1222760958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.313s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:24 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-b600f605-927f-4318-9653-14c4aef8739a tempest-VolumesSnapshotListTestJSON-1222760958 None] Create snapshot completed successfully Sep 23 00:17:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-bcf60893-5191-4e9a-a32b-1b558be24b16 tempest-VolumesSnapshotListTestJSON-1222760958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-bcf60893-5191-4e9a-a32b-1b558be24b16 tempest-VolumesSnapshotListTestJSON-1222760958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:25 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-bcf60893-5191-4e9a-a32b-1b558be24b16 tempest-VolumesSnapshotListTestJSON-1222760958 None] Creating offline snapshot e1f2f349-eae9-4b60-bc58-87f12461ad4e of volume e6d726d4-5292-4c6f-b2da-2a62545df107 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:17:25 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[7950edd5-52b2-47a7-9d86-12f606e19ae5]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bcf60893-5191-4e9a-a32b-1b558be24b16 tempest-VolumesSnapshotListTestJSON-1222760958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.f03f9057-a527-4da0-b35a-556badf8fd32 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:25 devstack sudo[95402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.f03f9057-a527-4da0-b35a-556badf8fd32 Sep 23 00:17:25 devstack sudo[95402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:26 devstack sudo[95402]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bcf60893-5191-4e9a-a32b-1b558be24b16 tempest-VolumesSnapshotListTestJSON-1222760958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.f03f9057-a527-4da0-b35a-556badf8fd32" returned: 0 in 0.528s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:26 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-bcf60893-5191-4e9a-a32b-1b558be24b16 tempest-VolumesSnapshotListTestJSON-1222760958 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6d726d4-5292-4c6f-b2da-2a62545df107(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:17:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bcf60893-5191-4e9a-a32b-1b558be24b16 tempest-VolumesSnapshotListTestJSON-1222760958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.f03f9057-a527-4da0-b35a-556badf8fd32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.e1f2f349-eae9-4b60-bc58-87f12461ad4e 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:26 devstack sudo[95408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.f03f9057-a527-4da0-b35a-556badf8fd32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.e1f2f349-eae9-4b60-bc58-87f12461ad4e 1G Sep 23 00:17:26 devstack sudo[95408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:26 devstack sudo[95408]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bcf60893-5191-4e9a-a32b-1b558be24b16 tempest-VolumesSnapshotListTestJSON-1222760958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.f03f9057-a527-4da0-b35a-556badf8fd32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.e1f2f349-eae9-4b60-bc58-87f12461ad4e 1G" returned: 0 in 0.665s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bcf60893-5191-4e9a-a32b-1b558be24b16 tempest-VolumesSnapshotListTestJSON-1222760958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6d726d4-5292-4c6f-b2da-2a62545df107.f03f9057-a527-4da0-b35a-556badf8fd32 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.e1f2f349-eae9-4b60-bc58-87f12461ad4e {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:26 devstack sudo[95415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6d726d4-5292-4c6f-b2da-2a62545df107.f03f9057-a527-4da0-b35a-556badf8fd32 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.e1f2f349-eae9-4b60-bc58-87f12461ad4e Sep 23 00:17:26 devstack sudo[95415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:27 devstack sudo[95415]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bcf60893-5191-4e9a-a32b-1b558be24b16 tempest-VolumesSnapshotListTestJSON-1222760958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6d726d4-5292-4c6f-b2da-2a62545df107.f03f9057-a527-4da0-b35a-556badf8fd32 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.e1f2f349-eae9-4b60-bc58-87f12461ad4e" returned: 0 in 0.401s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:27 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-bcf60893-5191-4e9a-a32b-1b558be24b16 tempest-VolumesSnapshotListTestJSON-1222760958 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.e1f2f349-eae9-4b60-bc58-87f12461ad4e is being set with open permissions: ugo+rw Sep 23 00:17:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bcf60893-5191-4e9a-a32b-1b558be24b16 tempest-VolumesSnapshotListTestJSON-1222760958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.e1f2f349-eae9-4b60-bc58-87f12461ad4e {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:27 devstack sudo[95421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.e1f2f349-eae9-4b60-bc58-87f12461ad4e Sep 23 00:17:27 devstack sudo[95421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:27 devstack sudo[95421]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bcf60893-5191-4e9a-a32b-1b558be24b16 tempest-VolumesSnapshotListTestJSON-1222760958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.e1f2f349-eae9-4b60-bc58-87f12461ad4e" returned: 0 in 0.363s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-bcf60893-5191-4e9a-a32b-1b558be24b16 tempest-VolumesSnapshotListTestJSON-1222760958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.129s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:27 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-bcf60893-5191-4e9a-a32b-1b558be24b16 tempest-VolumesSnapshotListTestJSON-1222760958 None] Create snapshot completed successfully Sep 23 00:17:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5ca4f16c-a671-454e-a0c1-fa0cfc6bbd73 tempest-VolumesSnapshotListTestJSON-1222760958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5ca4f16c-a671-454e-a0c1-fa0cfc6bbd73 tempest-VolumesSnapshotListTestJSON-1222760958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:29 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-5ca4f16c-a671-454e-a0c1-fa0cfc6bbd73 tempest-VolumesSnapshotListTestJSON-1222760958 None] Creating offline snapshot f28312d3-be6d-4945-b413-8f7523abafd8 of volume e6d726d4-5292-4c6f-b2da-2a62545df107 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:17:29 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[25fd8692-625d-476d-b22f-0190d66cbdd8]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5ca4f16c-a671-454e-a0c1-fa0cfc6bbd73 tempest-VolumesSnapshotListTestJSON-1222760958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.e1f2f349-eae9-4b60-bc58-87f12461ad4e {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:29 devstack sudo[95426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.e1f2f349-eae9-4b60-bc58-87f12461ad4e Sep 23 00:17:29 devstack sudo[95426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:29 devstack sudo[95426]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5ca4f16c-a671-454e-a0c1-fa0cfc6bbd73 tempest-VolumesSnapshotListTestJSON-1222760958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.e1f2f349-eae9-4b60-bc58-87f12461ad4e" returned: 0 in 0.536s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:29 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-5ca4f16c-a671-454e-a0c1-fa0cfc6bbd73 tempest-VolumesSnapshotListTestJSON-1222760958 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6d726d4-5292-4c6f-b2da-2a62545df107(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:17:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5ca4f16c-a671-454e-a0c1-fa0cfc6bbd73 tempest-VolumesSnapshotListTestJSON-1222760958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.e1f2f349-eae9-4b60-bc58-87f12461ad4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.f28312d3-be6d-4945-b413-8f7523abafd8 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:29 devstack sudo[95432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.e1f2f349-eae9-4b60-bc58-87f12461ad4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.f28312d3-be6d-4945-b413-8f7523abafd8 1G Sep 23 00:17:29 devstack sudo[95432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:30 devstack sudo[95432]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5ca4f16c-a671-454e-a0c1-fa0cfc6bbd73 tempest-VolumesSnapshotListTestJSON-1222760958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.e1f2f349-eae9-4b60-bc58-87f12461ad4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.f28312d3-be6d-4945-b413-8f7523abafd8 1G" returned: 0 in 0.738s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5ca4f16c-a671-454e-a0c1-fa0cfc6bbd73 tempest-VolumesSnapshotListTestJSON-1222760958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6d726d4-5292-4c6f-b2da-2a62545df107.e1f2f349-eae9-4b60-bc58-87f12461ad4e -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.f28312d3-be6d-4945-b413-8f7523abafd8 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:30 devstack sudo[95439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6d726d4-5292-4c6f-b2da-2a62545df107.e1f2f349-eae9-4b60-bc58-87f12461ad4e -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.f28312d3-be6d-4945-b413-8f7523abafd8 Sep 23 00:17:30 devstack sudo[95439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:30 devstack sudo[95439]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5ca4f16c-a671-454e-a0c1-fa0cfc6bbd73 tempest-VolumesSnapshotListTestJSON-1222760958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6d726d4-5292-4c6f-b2da-2a62545df107.e1f2f349-eae9-4b60-bc58-87f12461ad4e -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.f28312d3-be6d-4945-b413-8f7523abafd8" returned: 0 in 0.402s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:30 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-5ca4f16c-a671-454e-a0c1-fa0cfc6bbd73 tempest-VolumesSnapshotListTestJSON-1222760958 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.f28312d3-be6d-4945-b413-8f7523abafd8 is being set with open permissions: ugo+rw Sep 23 00:17:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5ca4f16c-a671-454e-a0c1-fa0cfc6bbd73 tempest-VolumesSnapshotListTestJSON-1222760958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.f28312d3-be6d-4945-b413-8f7523abafd8 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:30 devstack sudo[95444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.f28312d3-be6d-4945-b413-8f7523abafd8 Sep 23 00:17:30 devstack sudo[95444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:31 devstack sudo[95444]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5ca4f16c-a671-454e-a0c1-fa0cfc6bbd73 tempest-VolumesSnapshotListTestJSON-1222760958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.f28312d3-be6d-4945-b413-8f7523abafd8" returned: 0 in 0.307s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5ca4f16c-a671-454e-a0c1-fa0cfc6bbd73 tempest-VolumesSnapshotListTestJSON-1222760958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.164s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:31 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-5ca4f16c-a671-454e-a0c1-fa0cfc6bbd73 tempest-VolumesSnapshotListTestJSON-1222760958 None] Create snapshot completed successfully Sep 23 00:17:33 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c6564fad-683f-462f-b6c3-2d3d4c68d1d1 tempest-VolumesSnapshotListTestJSON-1222760958 None] Acquiring lock "cinder-f28312d3-be6d-4945-b413-8f7523abafd8-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:33 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c6564fad-683f-462f-b6c3-2d3d4c68d1d1 tempest-VolumesSnapshotListTestJSON-1222760958 None] Lock "cinder-f28312d3-be6d-4945-b413-8f7523abafd8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:33 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c6564fad-683f-462f-b6c3-2d3d4c68d1d1 tempest-VolumesSnapshotListTestJSON-1222760958 None] Acquiring lock "cinder-quobyte-e6d726d4-5292-4c6f-b2da-2a62545df107" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:33 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c6564fad-683f-462f-b6c3-2d3d4c68d1d1 tempest-VolumesSnapshotListTestJSON-1222760958 None] Lock "cinder-quobyte-e6d726d4-5292-4c6f-b2da-2a62545df107" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:33 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c6564fad-683f-462f-b6c3-2d3d4c68d1d1 tempest-VolumesSnapshotListTestJSON-1222760958 None] Acquiring lock "cinder-quobyte-f28312d3-be6d-4945-b413-8f7523abafd8" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:34 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c6564fad-683f-462f-b6c3-2d3d4c68d1d1 tempest-VolumesSnapshotListTestJSON-1222760958 None] Lock "cinder-quobyte-f28312d3-be6d-4945-b413-8f7523abafd8" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:34 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-c6564fad-683f-462f-b6c3-2d3d4c68d1d1 tempest-VolumesSnapshotListTestJSON-1222760958 None] Deleting offline snapshot f28312d3-be6d-4945-b413-8f7523abafd8 of volume e6d726d4-5292-4c6f-b2da-2a62545df107 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:17:34 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-c6564fad-683f-462f-b6c3-2d3d4c68d1d1 tempest-VolumesSnapshotListTestJSON-1222760958 None] snapshot_file for this snap is: volume-e6d726d4-5292-4c6f-b2da-2a62545df107.f28312d3-be6d-4945-b413-8f7523abafd8 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:17:34 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8d2557-8898-4ca6-84f7-a08fb43d992f]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c6564fad-683f-462f-b6c3-2d3d4c68d1d1 tempest-VolumesSnapshotListTestJSON-1222760958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.f28312d3-be6d-4945-b413-8f7523abafd8 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:34 devstack sudo[95447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.f28312d3-be6d-4945-b413-8f7523abafd8 Sep 23 00:17:34 devstack sudo[95447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:34 devstack sudo[95447]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c6564fad-683f-462f-b6c3-2d3d4c68d1d1 tempest-VolumesSnapshotListTestJSON-1222760958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.f28312d3-be6d-4945-b413-8f7523abafd8" returned: 0 in 0.543s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:34 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-c6564fad-683f-462f-b6c3-2d3d4c68d1d1 tempest-VolumesSnapshotListTestJSON-1222760958 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6d726d4-5292-4c6f-b2da-2a62545df107(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:17:34 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed52f69-3d5c-408c-a2b8-ebe3e942ab3e]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c6564fad-683f-462f-b6c3-2d3d4c68d1d1 tempest-VolumesSnapshotListTestJSON-1222760958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.e1f2f349-eae9-4b60-bc58-87f12461ad4e {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:34 devstack sudo[95454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.e1f2f349-eae9-4b60-bc58-87f12461ad4e Sep 23 00:17:34 devstack sudo[95454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:35 devstack sudo[95454]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c6564fad-683f-462f-b6c3-2d3d4c68d1d1 tempest-VolumesSnapshotListTestJSON-1222760958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.e1f2f349-eae9-4b60-bc58-87f12461ad4e" returned: 0 in 0.771s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:35 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-c6564fad-683f-462f-b6c3-2d3d4c68d1d1 tempest-VolumesSnapshotListTestJSON-1222760958 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6d726d4-5292-4c6f-b2da-2a62545df107(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:17:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c6564fad-683f-462f-b6c3-2d3d4c68d1d1 tempest-VolumesSnapshotListTestJSON-1222760958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.f28312d3-be6d-4945-b413-8f7523abafd8 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:35 devstack sudo[95461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.f28312d3-be6d-4945-b413-8f7523abafd8 Sep 23 00:17:35 devstack sudo[95461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:36 devstack sudo[95461]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c6564fad-683f-462f-b6c3-2d3d4c68d1d1 tempest-VolumesSnapshotListTestJSON-1222760958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.f28312d3-be6d-4945-b413-8f7523abafd8" returned: 0 in 0.650s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c6564fad-683f-462f-b6c3-2d3d4c68d1d1 tempest-VolumesSnapshotListTestJSON-1222760958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.f28312d3-be6d-4945-b413-8f7523abafd8 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:36 devstack sudo[95467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.f28312d3-be6d-4945-b413-8f7523abafd8 Sep 23 00:17:36 devstack sudo[95467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:36 devstack sudo[95467]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c6564fad-683f-462f-b6c3-2d3d4c68d1d1 tempest-VolumesSnapshotListTestJSON-1222760958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.f28312d3-be6d-4945-b413-8f7523abafd8" returned: 0 in 0.427s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:36 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c6564fad-683f-462f-b6c3-2d3d4c68d1d1 tempest-VolumesSnapshotListTestJSON-1222760958 None] Lock "cinder-quobyte-f28312d3-be6d-4945-b413-8f7523abafd8" released by "_delete_snapshot" :: held 2.610s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:36 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c6564fad-683f-462f-b6c3-2d3d4c68d1d1 tempest-VolumesSnapshotListTestJSON-1222760958 None] Lock "cinder-quobyte-e6d726d4-5292-4c6f-b2da-2a62545df107" released by "delete_snapshot" :: held 2.657s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:36 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-c6564fad-683f-462f-b6c3-2d3d4c68d1d1 tempest-VolumesSnapshotListTestJSON-1222760958 None] Created reservations ['e5bf04d0-d3ad-4a42-8cb5-0f42562d97c7', 'dde1ef62-9565-4162-bff1-dc3bc59d4319', 'af8b5216-4b34-4060-a671-dcd6cad7a7e5', '20de44b3-876b-47de-acc5-d905cdaa99d3'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:17:36 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-c6564fad-683f-462f-b6c3-2d3d4c68d1d1 tempest-VolumesSnapshotListTestJSON-1222760958 None] Delete snapshot completed successfully. Sep 23 00:17:36 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c6564fad-683f-462f-b6c3-2d3d4c68d1d1 tempest-VolumesSnapshotListTestJSON-1222760958 None] Lock "cinder-f28312d3-be6d-4945-b413-8f7523abafd8-delete_snapshot" released by "delete_snapshot" :: held 2.895s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:37 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-35e08a96-1c18-4d8c-a8f4-8ae4c92d61d1 tempest-VolumesSnapshotListTestJSON-1222760958 None] Acquiring lock "cinder-e1f2f349-eae9-4b60-bc58-87f12461ad4e-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:37 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-35e08a96-1c18-4d8c-a8f4-8ae4c92d61d1 tempest-VolumesSnapshotListTestJSON-1222760958 None] Lock "cinder-e1f2f349-eae9-4b60-bc58-87f12461ad4e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:37 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-35e08a96-1c18-4d8c-a8f4-8ae4c92d61d1 tempest-VolumesSnapshotListTestJSON-1222760958 None] Acquiring lock "cinder-quobyte-e6d726d4-5292-4c6f-b2da-2a62545df107" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:37 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-35e08a96-1c18-4d8c-a8f4-8ae4c92d61d1 tempest-VolumesSnapshotListTestJSON-1222760958 None] Lock "cinder-quobyte-e6d726d4-5292-4c6f-b2da-2a62545df107" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:37 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-35e08a96-1c18-4d8c-a8f4-8ae4c92d61d1 tempest-VolumesSnapshotListTestJSON-1222760958 None] Acquiring lock "cinder-quobyte-e1f2f349-eae9-4b60-bc58-87f12461ad4e" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:37 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-35e08a96-1c18-4d8c-a8f4-8ae4c92d61d1 tempest-VolumesSnapshotListTestJSON-1222760958 None] Lock "cinder-quobyte-e1f2f349-eae9-4b60-bc58-87f12461ad4e" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-35e08a96-1c18-4d8c-a8f4-8ae4c92d61d1 tempest-VolumesSnapshotListTestJSON-1222760958 None] Deleting offline snapshot e1f2f349-eae9-4b60-bc58-87f12461ad4e of volume e6d726d4-5292-4c6f-b2da-2a62545df107 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:17:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-35e08a96-1c18-4d8c-a8f4-8ae4c92d61d1 tempest-VolumesSnapshotListTestJSON-1222760958 None] snapshot_file for this snap is: volume-e6d726d4-5292-4c6f-b2da-2a62545df107.e1f2f349-eae9-4b60-bc58-87f12461ad4e {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:17:37 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e666ae85-b8a4-4f90-b820-db6c7a333d36]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-35e08a96-1c18-4d8c-a8f4-8ae4c92d61d1 tempest-VolumesSnapshotListTestJSON-1222760958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.e1f2f349-eae9-4b60-bc58-87f12461ad4e {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:37 devstack sudo[95471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.e1f2f349-eae9-4b60-bc58-87f12461ad4e Sep 23 00:17:37 devstack sudo[95471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:37 devstack sudo[95471]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-35e08a96-1c18-4d8c-a8f4-8ae4c92d61d1 tempest-VolumesSnapshotListTestJSON-1222760958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.e1f2f349-eae9-4b60-bc58-87f12461ad4e" returned: 0 in 0.553s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-35e08a96-1c18-4d8c-a8f4-8ae4c92d61d1 tempest-VolumesSnapshotListTestJSON-1222760958 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6d726d4-5292-4c6f-b2da-2a62545df107(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:17:38 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a29097-7157-4bbd-bd9c-228a187fab49]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-35e08a96-1c18-4d8c-a8f4-8ae4c92d61d1 tempest-VolumesSnapshotListTestJSON-1222760958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.f03f9057-a527-4da0-b35a-556badf8fd32 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:38 devstack sudo[95477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.f03f9057-a527-4da0-b35a-556badf8fd32 Sep 23 00:17:38 devstack sudo[95477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:38 devstack sudo[95477]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-35e08a96-1c18-4d8c-a8f4-8ae4c92d61d1 tempest-VolumesSnapshotListTestJSON-1222760958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.f03f9057-a527-4da0-b35a-556badf8fd32" returned: 0 in 0.696s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:38 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-35e08a96-1c18-4d8c-a8f4-8ae4c92d61d1 tempest-VolumesSnapshotListTestJSON-1222760958 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6d726d4-5292-4c6f-b2da-2a62545df107(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:17:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-35e08a96-1c18-4d8c-a8f4-8ae4c92d61d1 tempest-VolumesSnapshotListTestJSON-1222760958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.e1f2f349-eae9-4b60-bc58-87f12461ad4e {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:38 devstack sudo[95483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.e1f2f349-eae9-4b60-bc58-87f12461ad4e Sep 23 00:17:38 devstack sudo[95483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:38 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c714cf3-b476-4b97-9f33-e3eb17d27dc5 tempest-VolumesServicesTestJSON-1412681717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:17:38 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8c714cf3-b476-4b97-9f33-e3eb17d27dc5 tempest-VolumesServicesTestJSON-1412681717 None] Flow 'volume_create_manager' (4362eb63-0245-4620-9c59-5d4e26d91c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:17:38 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8c714cf3-b476-4b97-9f33-e3eb17d27dc5 tempest-VolumesServicesTestJSON-1412681717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (633a6c24-0bb8-45b6-b4d8-e654c7730b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:38 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8c714cf3-b476-4b97-9f33-e3eb17d27dc5 tempest-VolumesServicesTestJSON-1412681717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (633a6c24-0bb8-45b6-b4d8-e654c7730b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:17:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1977232036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c47b6477-c75f-4010-9bfb-3a3ee9f02c5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bea40e3cee1d4f2da62bcad8e2dc1973',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:39Z,use_quota=True,user_id='a7f886eae6804603ae8c768596bd8d23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:38 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8c714cf3-b476-4b97-9f33-e3eb17d27dc5 tempest-VolumesServicesTestJSON-1412681717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdba6449-05d0-4e26-a3fa-7e2d14f2f763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:38 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8c714cf3-b476-4b97-9f33-e3eb17d27dc5 tempest-VolumesServicesTestJSON-1412681717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdba6449-05d0-4e26-a3fa-7e2d14f2f763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:38 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8c714cf3-b476-4b97-9f33-e3eb17d27dc5 tempest-VolumesServicesTestJSON-1412681717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5540510-06f3-42d8-a2d6-aa946eda6849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:38 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8c714cf3-b476-4b97-9f33-e3eb17d27dc5 tempest-VolumesServicesTestJSON-1412681717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5540510-06f3-42d8-a2d6-aa946eda6849) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c47b6477-c75f-4010-9bfb-3a3ee9f02c5a', 'volume_name': 'volume-c47b6477-c75f-4010-9bfb-3a3ee9f02c5a', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:38 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8c714cf3-b476-4b97-9f33-e3eb17d27dc5 tempest-VolumesServicesTestJSON-1412681717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc23eaa6-b4ab-4428-ac7c-08f45d1da15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:38 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8c714cf3-b476-4b97-9f33-e3eb17d27dc5 tempest-VolumesServicesTestJSON-1412681717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc23eaa6-b4ab-4428-ac7c-08f45d1da15b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:38 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8c714cf3-b476-4b97-9f33-e3eb17d27dc5 tempest-VolumesServicesTestJSON-1412681717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e252b0a-4fa3-49fa-b244-70a078b16cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:38 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-8c714cf3-b476-4b97-9f33-e3eb17d27dc5 tempest-VolumesServicesTestJSON-1412681717 None] Volume c47b6477-c75f-4010-9bfb-3a3ee9f02c5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c47b6477-c75f-4010-9bfb-3a3ee9f02c5a', 'volume_size': 1} Sep 23 00:17:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8c714cf3-b476-4b97-9f33-e3eb17d27dc5 tempest-VolumesServicesTestJSON-1412681717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8c714cf3-b476-4b97-9f33-e3eb17d27dc5 tempest-VolumesServicesTestJSON-1412681717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:38 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-8c714cf3-b476-4b97-9f33-e3eb17d27dc5 tempest-VolumesServicesTestJSON-1412681717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:17:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1977232036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c47b6477-c75f-4010-9bfb-3a3ee9f02c5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bea40e3cee1d4f2da62bcad8e2dc1973',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:39Z,use_quota=True,user_id='a7f886eae6804603ae8c768596bd8d23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:17:38 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-8c714cf3-b476-4b97-9f33-e3eb17d27dc5 tempest-VolumesServicesTestJSON-1412681717 None] Creating volume c47b6477-c75f-4010-9bfb-3a3ee9f02c5a {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:17:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8c714cf3-b476-4b97-9f33-e3eb17d27dc5 tempest-VolumesServicesTestJSON-1412681717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8c714cf3-b476-4b97-9f33-e3eb17d27dc5 tempest-VolumesServicesTestJSON-1412681717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:38 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-8c714cf3-b476-4b97-9f33-e3eb17d27dc5 tempest-VolumesServicesTestJSON-1412681717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:17:39 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-8c714cf3-b476-4b97-9f33-e3eb17d27dc5 tempest-VolumesServicesTestJSON-1412681717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:17:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8c714cf3-b476-4b97-9f33-e3eb17d27dc5 tempest-VolumesServicesTestJSON-1412681717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:39 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-8c714cf3-b476-4b97-9f33-e3eb17d27dc5 tempest-VolumesServicesTestJSON-1412681717 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:17:39 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-8c714cf3-b476-4b97-9f33-e3eb17d27dc5 tempest-VolumesServicesTestJSON-1412681717 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:17:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8c714cf3-b476-4b97-9f33-e3eb17d27dc5 tempest-VolumesServicesTestJSON-1412681717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c47b6477-c75f-4010-9bfb-3a3ee9f02c5a 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:39 devstack sudo[95485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c47b6477-c75f-4010-9bfb-3a3ee9f02c5a 1073741824 Sep 23 00:17:39 devstack sudo[95485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:39 devstack sudo[95483]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-35e08a96-1c18-4d8c-a8f4-8ae4c92d61d1 tempest-VolumesSnapshotListTestJSON-1222760958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.e1f2f349-eae9-4b60-bc58-87f12461ad4e" returned: 0 in 0.655s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-35e08a96-1c18-4d8c-a8f4-8ae4c92d61d1 tempest-VolumesSnapshotListTestJSON-1222760958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.e1f2f349-eae9-4b60-bc58-87f12461ad4e {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:39 devstack sudo[95493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.e1f2f349-eae9-4b60-bc58-87f12461ad4e Sep 23 00:17:39 devstack sudo[95493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:39 devstack sudo[95485]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8c714cf3-b476-4b97-9f33-e3eb17d27dc5 tempest-VolumesServicesTestJSON-1412681717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c47b6477-c75f-4010-9bfb-3a3ee9f02c5a 1073741824" returned: 0 in 0.690s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8c714cf3-b476-4b97-9f33-e3eb17d27dc5 tempest-VolumesServicesTestJSON-1412681717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c47b6477-c75f-4010-9bfb-3a3ee9f02c5a {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:39 devstack sudo[95497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c47b6477-c75f-4010-9bfb-3a3ee9f02c5a Sep 23 00:17:39 devstack sudo[95497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:39 devstack sudo[95493]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-35e08a96-1c18-4d8c-a8f4-8ae4c92d61d1 tempest-VolumesSnapshotListTestJSON-1222760958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.e1f2f349-eae9-4b60-bc58-87f12461ad4e" returned: 0 in 0.449s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:39 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-35e08a96-1c18-4d8c-a8f4-8ae4c92d61d1 tempest-VolumesSnapshotListTestJSON-1222760958 None] Lock "cinder-quobyte-e1f2f349-eae9-4b60-bc58-87f12461ad4e" released by "_delete_snapshot" :: held 2.525s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:39 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-35e08a96-1c18-4d8c-a8f4-8ae4c92d61d1 tempest-VolumesSnapshotListTestJSON-1222760958 None] Lock "cinder-quobyte-e6d726d4-5292-4c6f-b2da-2a62545df107" released by "delete_snapshot" :: held 2.562s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:40 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-35e08a96-1c18-4d8c-a8f4-8ae4c92d61d1 tempest-VolumesSnapshotListTestJSON-1222760958 None] Created reservations ['4e250f66-e659-4c0d-9d92-5c2741a26348', 'f23685c2-6624-4f2f-b620-09cd16aa12bf', 'fd67ddb7-b27e-4aca-bd06-0283e375dd35', '3d13bb35-e2ee-41d4-83fe-e4c77bd4cda4'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:17:40 devstack sudo[95497]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8c714cf3-b476-4b97-9f33-e3eb17d27dc5 tempest-VolumesServicesTestJSON-1412681717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c47b6477-c75f-4010-9bfb-3a3ee9f02c5a" returned: 0 in 0.373s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:40 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-8c714cf3-b476-4b97-9f33-e3eb17d27dc5 tempest-VolumesServicesTestJSON-1412681717 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:17:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8c714cf3-b476-4b97-9f33-e3eb17d27dc5 tempest-VolumesServicesTestJSON-1412681717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:40 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-35e08a96-1c18-4d8c-a8f4-8ae4c92d61d1 tempest-VolumesSnapshotListTestJSON-1222760958 None] Delete snapshot completed successfully. Sep 23 00:17:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8c714cf3-b476-4b97-9f33-e3eb17d27dc5 tempest-VolumesServicesTestJSON-1412681717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e252b0a-4fa3-49fa-b244-70a078b16cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c47b6477-c75f-4010-9bfb-3a3ee9f02c5a', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8c714cf3-b476-4b97-9f33-e3eb17d27dc5 tempest-VolumesServicesTestJSON-1412681717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (002e5e9f-9dba-4d65-80ee-fec299b09919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:40 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-35e08a96-1c18-4d8c-a8f4-8ae4c92d61d1 tempest-VolumesSnapshotListTestJSON-1222760958 None] Lock "cinder-e1f2f349-eae9-4b60-bc58-87f12461ad4e-delete_snapshot" released by "delete_snapshot" :: held 2.856s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:40 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-8c714cf3-b476-4b97-9f33-e3eb17d27dc5 tempest-VolumesServicesTestJSON-1412681717 None] Volume volume-c47b6477-c75f-4010-9bfb-3a3ee9f02c5a (c47b6477-c75f-4010-9bfb-3a3ee9f02c5a): created successfully Sep 23 00:17:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8c714cf3-b476-4b97-9f33-e3eb17d27dc5 tempest-VolumesServicesTestJSON-1412681717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (002e5e9f-9dba-4d65-80ee-fec299b09919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8c714cf3-b476-4b97-9f33-e3eb17d27dc5 tempest-VolumesServicesTestJSON-1412681717 None] Flow 'volume_create_manager' (4362eb63-0245-4620-9c59-5d4e26d91c2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:17:40 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-8c714cf3-b476-4b97-9f33-e3eb17d27dc5 tempest-VolumesServicesTestJSON-1412681717 None] Created volume successfully. Sep 23 00:17:40 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b6f05ee8-e789-439f-a58c-587a7cb1601a tempest-VolumesSnapshotListTestJSON-1222760958 None] Acquiring lock "cinder-f03f9057-a527-4da0-b35a-556badf8fd32-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:40 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b6f05ee8-e789-439f-a58c-587a7cb1601a tempest-VolumesSnapshotListTestJSON-1222760958 None] Lock "cinder-f03f9057-a527-4da0-b35a-556badf8fd32-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:40 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b6f05ee8-e789-439f-a58c-587a7cb1601a tempest-VolumesSnapshotListTestJSON-1222760958 None] Acquiring lock "cinder-quobyte-e6d726d4-5292-4c6f-b2da-2a62545df107" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:40 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b6f05ee8-e789-439f-a58c-587a7cb1601a tempest-VolumesSnapshotListTestJSON-1222760958 None] Lock "cinder-quobyte-e6d726d4-5292-4c6f-b2da-2a62545df107" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:40 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b6f05ee8-e789-439f-a58c-587a7cb1601a tempest-VolumesSnapshotListTestJSON-1222760958 None] Acquiring lock "cinder-quobyte-f03f9057-a527-4da0-b35a-556badf8fd32" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:40 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b6f05ee8-e789-439f-a58c-587a7cb1601a tempest-VolumesSnapshotListTestJSON-1222760958 None] Lock "cinder-quobyte-f03f9057-a527-4da0-b35a-556badf8fd32" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:40 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-b6f05ee8-e789-439f-a58c-587a7cb1601a tempest-VolumesSnapshotListTestJSON-1222760958 None] Deleting offline snapshot f03f9057-a527-4da0-b35a-556badf8fd32 of volume e6d726d4-5292-4c6f-b2da-2a62545df107 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:17:40 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-b6f05ee8-e789-439f-a58c-587a7cb1601a tempest-VolumesSnapshotListTestJSON-1222760958 None] snapshot_file for this snap is: volume-e6d726d4-5292-4c6f-b2da-2a62545df107.f03f9057-a527-4da0-b35a-556badf8fd32 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:17:40 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[1614727d-0338-4b40-9677-330c1b29ebd5]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b6f05ee8-e789-439f-a58c-587a7cb1601a tempest-VolumesSnapshotListTestJSON-1222760958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.f03f9057-a527-4da0-b35a-556badf8fd32 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:40 devstack sudo[95500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.f03f9057-a527-4da0-b35a-556badf8fd32 Sep 23 00:17:40 devstack sudo[95500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:41 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8a289746-6937-4a19-9fdd-726064aa68c8 tempest-VolumesServicesTestJSON-1412681717 None] Acquiring lock "cinder-c47b6477-c75f-4010-9bfb-3a3ee9f02c5a-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:41 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8a289746-6937-4a19-9fdd-726064aa68c8 tempest-VolumesServicesTestJSON-1412681717 None] Lock "cinder-c47b6477-c75f-4010-9bfb-3a3ee9f02c5a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:41 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8a289746-6937-4a19-9fdd-726064aa68c8 tempest-VolumesServicesTestJSON-1412681717 None] Acquiring lock "cinder-quobyte-c47b6477-c75f-4010-9bfb-3a3ee9f02c5a" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:41 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8a289746-6937-4a19-9fdd-726064aa68c8 tempest-VolumesServicesTestJSON-1412681717 None] Lock "cinder-quobyte-c47b6477-c75f-4010-9bfb-3a3ee9f02c5a" acquired by "delete_volume" :: waited 0.018s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:41 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b327ac45-c026-402d-b5f8-df094aa895d7]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8a289746-6937-4a19-9fdd-726064aa68c8 tempest-VolumesServicesTestJSON-1412681717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c47b6477-c75f-4010-9bfb-3a3ee9f02c5a {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:41 devstack sudo[95500]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b6f05ee8-e789-439f-a58c-587a7cb1601a tempest-VolumesSnapshotListTestJSON-1222760958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.f03f9057-a527-4da0-b35a-556badf8fd32" returned: 0 in 0.667s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-b6f05ee8-e789-439f-a58c-587a7cb1601a tempest-VolumesSnapshotListTestJSON-1222760958 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6d726d4-5292-4c6f-b2da-2a62545df107(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:17:41 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af80ab2-b1fb-400a-b79a-cbaeffb98130]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b6f05ee8-e789-439f-a58c-587a7cb1601a tempest-VolumesSnapshotListTestJSON-1222760958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:41 devstack sudo[95505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c47b6477-c75f-4010-9bfb-3a3ee9f02c5a Sep 23 00:17:41 devstack sudo[95505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:41 devstack sudo[95506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107 Sep 23 00:17:41 devstack sudo[95506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:41 devstack sudo[95505]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8a289746-6937-4a19-9fdd-726064aa68c8 tempest-VolumesServicesTestJSON-1412681717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c47b6477-c75f-4010-9bfb-3a3ee9f02c5a" returned: 0 in 0.587s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8a289746-6937-4a19-9fdd-726064aa68c8 tempest-VolumesServicesTestJSON-1412681717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c47b6477-c75f-4010-9bfb-3a3ee9f02c5a {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:41 devstack sudo[95506]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b6f05ee8-e789-439f-a58c-587a7cb1601a tempest-VolumesSnapshotListTestJSON-1222760958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107" returned: 0 in 0.488s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b6f05ee8-e789-439f-a58c-587a7cb1601a tempest-VolumesSnapshotListTestJSON-1222760958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.f03f9057-a527-4da0-b35a-556badf8fd32 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:41 devstack sudo[95515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c47b6477-c75f-4010-9bfb-3a3ee9f02c5a Sep 23 00:17:41 devstack sudo[95515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:41 devstack sudo[95517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.f03f9057-a527-4da0-b35a-556badf8fd32 Sep 23 00:17:41 devstack sudo[95517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:42 devstack sudo[95515]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8a289746-6937-4a19-9fdd-726064aa68c8 tempest-VolumesServicesTestJSON-1412681717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c47b6477-c75f-4010-9bfb-3a3ee9f02c5a" returned: 0 in 0.403s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:42 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8a289746-6937-4a19-9fdd-726064aa68c8 tempest-VolumesServicesTestJSON-1412681717 None] Lock "cinder-quobyte-c47b6477-c75f-4010-9bfb-3a3ee9f02c5a" released by "delete_volume" :: held 1.044s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:42 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-8a289746-6937-4a19-9fdd-726064aa68c8 tempest-VolumesServicesTestJSON-1412681717 None] Created reservations ['f2d66ceb-e4c7-4f51-84bd-e6934dc8278f', 'dd221c20-80a4-4d58-bf29-cee21b9fa979', 'f441e430-928f-4192-aad5-a03975611514', '7aae9563-43c8-455a-a58a-7c58b68a9fc6'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:17:42 devstack sudo[95517]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b6f05ee8-e789-439f-a58c-587a7cb1601a tempest-VolumesSnapshotListTestJSON-1222760958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.f03f9057-a527-4da0-b35a-556badf8fd32" returned: 0 in 0.518s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b6f05ee8-e789-439f-a58c-587a7cb1601a tempest-VolumesSnapshotListTestJSON-1222760958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.f03f9057-a527-4da0-b35a-556badf8fd32 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:42 devstack sudo[95523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.f03f9057-a527-4da0-b35a-556badf8fd32 Sep 23 00:17:42 devstack sudo[95523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8a289746-6937-4a19-9fdd-726064aa68c8 tempest-VolumesServicesTestJSON-1412681717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8a289746-6937-4a19-9fdd-726064aa68c8 tempest-VolumesServicesTestJSON-1412681717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-8a289746-6937-4a19-9fdd-726064aa68c8 tempest-VolumesServicesTestJSON-1412681717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:17:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-8a289746-6937-4a19-9fdd-726064aa68c8 tempest-VolumesServicesTestJSON-1412681717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:17:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8a289746-6937-4a19-9fdd-726064aa68c8 tempest-VolumesServicesTestJSON-1412681717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8a289746-6937-4a19-9fdd-726064aa68c8 tempest-VolumesServicesTestJSON-1412681717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:42 devstack sudo[95525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:17:42 devstack sudo[95525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:42 devstack sudo[95523]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b6f05ee8-e789-439f-a58c-587a7cb1601a tempest-VolumesSnapshotListTestJSON-1222760958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107.f03f9057-a527-4da0-b35a-556badf8fd32" returned: 0 in 0.344s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:42 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b6f05ee8-e789-439f-a58c-587a7cb1601a tempest-VolumesSnapshotListTestJSON-1222760958 None] Lock "cinder-quobyte-f03f9057-a527-4da0-b35a-556badf8fd32" released by "_delete_snapshot" :: held 2.176s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:42 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b6f05ee8-e789-439f-a58c-587a7cb1601a tempest-VolumesSnapshotListTestJSON-1222760958 None] Lock "cinder-quobyte-e6d726d4-5292-4c6f-b2da-2a62545df107" released by "delete_snapshot" :: held 2.207s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:42 devstack sudo[95525]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8a289746-6937-4a19-9fdd-726064aa68c8 tempest-VolumesServicesTestJSON-1412681717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.393s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:42 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-8a289746-6937-4a19-9fdd-726064aa68c8 tempest-VolumesServicesTestJSON-1412681717 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:17:42 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-8a289746-6937-4a19-9fdd-726064aa68c8 tempest-VolumesServicesTestJSON-1412681717 None] Deleted volume successfully. Sep 23 00:17:42 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8a289746-6937-4a19-9fdd-726064aa68c8 tempest-VolumesServicesTestJSON-1412681717 None] Lock "cinder-c47b6477-c75f-4010-9bfb-3a3ee9f02c5a-delete_volume" released by "delete_volume" :: held 1.748s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:42 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-b6f05ee8-e789-439f-a58c-587a7cb1601a tempest-VolumesSnapshotListTestJSON-1222760958 None] Created reservations ['bc240417-bc94-4379-941f-bc3c4817f1b1', 'b9d411e6-75b8-4bbd-a499-04b1eb6ce71e', 'c2095d30-4164-4f21-b8ed-9b0a8bf928ae', 'f054aade-4380-4872-bfda-122cfc15784a'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:17:42 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-b6f05ee8-e789-439f-a58c-587a7cb1601a tempest-VolumesSnapshotListTestJSON-1222760958 None] Delete snapshot completed successfully. Sep 23 00:17:42 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b6f05ee8-e789-439f-a58c-587a7cb1601a tempest-VolumesSnapshotListTestJSON-1222760958 None] Lock "cinder-f03f9057-a527-4da0-b35a-556badf8fd32-delete_snapshot" released by "delete_snapshot" :: held 2.411s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:43 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c1df9ff0-f0c6-49cd-8a97-4de11f3b2d30 tempest-VolumesSnapshotListTestJSON-1222760958 None] Acquiring lock "cinder-e6d726d4-5292-4c6f-b2da-2a62545df107-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:43 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c1df9ff0-f0c6-49cd-8a97-4de11f3b2d30 tempest-VolumesSnapshotListTestJSON-1222760958 None] Lock "cinder-e6d726d4-5292-4c6f-b2da-2a62545df107-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:44 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c1df9ff0-f0c6-49cd-8a97-4de11f3b2d30 tempest-VolumesSnapshotListTestJSON-1222760958 None] Acquiring lock "cinder-quobyte-e6d726d4-5292-4c6f-b2da-2a62545df107" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:44 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c1df9ff0-f0c6-49cd-8a97-4de11f3b2d30 tempest-VolumesSnapshotListTestJSON-1222760958 None] Lock "cinder-quobyte-e6d726d4-5292-4c6f-b2da-2a62545df107" acquired by "delete_volume" :: waited 0.018s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:44 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8bf1dc-ff38-4632-a97d-9221b7fcce04]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1df9ff0-f0c6-49cd-8a97-4de11f3b2d30 tempest-VolumesSnapshotListTestJSON-1222760958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:44 devstack sudo[95529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107 Sep 23 00:17:44 devstack sudo[95529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:44 devstack sudo[95529]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1df9ff0-f0c6-49cd-8a97-4de11f3b2d30 tempest-VolumesSnapshotListTestJSON-1222760958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107" returned: 0 in 0.485s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1df9ff0-f0c6-49cd-8a97-4de11f3b2d30 tempest-VolumesSnapshotListTestJSON-1222760958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:44 devstack sudo[95534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107 Sep 23 00:17:44 devstack sudo[95534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:44 devstack sudo[95534]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1df9ff0-f0c6-49cd-8a97-4de11f3b2d30 tempest-VolumesSnapshotListTestJSON-1222760958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6d726d4-5292-4c6f-b2da-2a62545df107" returned: 0 in 0.319s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:44 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c1df9ff0-f0c6-49cd-8a97-4de11f3b2d30 tempest-VolumesSnapshotListTestJSON-1222760958 None] Lock "cinder-quobyte-e6d726d4-5292-4c6f-b2da-2a62545df107" released by "delete_volume" :: held 0.956s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:45 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-c1df9ff0-f0c6-49cd-8a97-4de11f3b2d30 tempest-VolumesSnapshotListTestJSON-1222760958 None] Created reservations ['f5ad6f04-3434-4bd0-a30b-9274ec4f7758', '12a0c522-fed6-43e6-9f71-c25be85c50fd', '00b82be8-f738-46ec-890a-9ebb55f4e42a', 'bbae2f38-c123-4330-8df6-7e4855b8bab4'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:17:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c1df9ff0-f0c6-49cd-8a97-4de11f3b2d30 tempest-VolumesSnapshotListTestJSON-1222760958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c1df9ff0-f0c6-49cd-8a97-4de11f3b2d30 tempest-VolumesSnapshotListTestJSON-1222760958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:45 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c1df9ff0-f0c6-49cd-8a97-4de11f3b2d30 tempest-VolumesSnapshotListTestJSON-1222760958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:17:45 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c1df9ff0-f0c6-49cd-8a97-4de11f3b2d30 tempest-VolumesSnapshotListTestJSON-1222760958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:17:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c1df9ff0-f0c6-49cd-8a97-4de11f3b2d30 tempest-VolumesSnapshotListTestJSON-1222760958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1df9ff0-f0c6-49cd-8a97-4de11f3b2d30 tempest-VolumesSnapshotListTestJSON-1222760958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:45 devstack sudo[95537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:17:45 devstack sudo[95537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:45 devstack sudo[95537]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1df9ff0-f0c6-49cd-8a97-4de11f3b2d30 tempest-VolumesSnapshotListTestJSON-1222760958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.363s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:45 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-c1df9ff0-f0c6-49cd-8a97-4de11f3b2d30 tempest-VolumesSnapshotListTestJSON-1222760958 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:17:45 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-c1df9ff0-f0c6-49cd-8a97-4de11f3b2d30 tempest-VolumesSnapshotListTestJSON-1222760958 None] Deleted volume successfully. Sep 23 00:17:45 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c1df9ff0-f0c6-49cd-8a97-4de11f3b2d30 tempest-VolumesSnapshotListTestJSON-1222760958 None] Lock "cinder-e6d726d4-5292-4c6f-b2da-2a62545df107-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:55 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:UPDATE=59,cinder:SELECT=50,cinder:INSERT=16,cinder:DELETE=1 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:17:55 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=44,cinder:INSERT=15,cinder:UPDATE=57,cinder:DELETE=8 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:18:16 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:18:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:16 devstack sudo[95700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:18:16 devstack sudo[95700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:17 devstack sudo[95700]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.506s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:17 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:18:17 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running periodic task VolumeManager._thread_info {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:18:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] thread count: 29 {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:18:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] thread info: [<_MainThread(MainThread, started 135440660459648)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:18:23 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-4581b621-eaaa-4c8b-9b4b-e0d3fbac2c66 tempest-VolumesImageMetadata-309946200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:18:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4581b621-eaaa-4c8b-9b4b-e0d3fbac2c66 tempest-VolumesImageMetadata-309946200 None] Flow 'volume_create_manager' (17e699b3-7763-4a84-81c3-bf09be500190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:18:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4581b621-eaaa-4c8b-9b4b-e0d3fbac2c66 tempest-VolumesImageMetadata-309946200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f39b728b-a9cb-4664-b68a-2604f33a100c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4581b621-eaaa-4c8b-9b4b-e0d3fbac2c66 tempest-VolumesImageMetadata-309946200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f39b728b-a9cb-4664-b68a-2604f33a100c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:18:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1360943357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d0d4b5f-0a9b-4ff3-8831-dfc59e01aa9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='518a87ea8c974266bc0094ed92528bd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:24Z,use_quota=True,user_id='8dfd0649ffad49908f1df5b8f44d68f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4581b621-eaaa-4c8b-9b4b-e0d3fbac2c66 tempest-VolumesImageMetadata-309946200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13053a18-2fe4-475d-b21e-1f1bec785cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4581b621-eaaa-4c8b-9b4b-e0d3fbac2c66 tempest-VolumesImageMetadata-309946200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13053a18-2fe4-475d-b21e-1f1bec785cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4581b621-eaaa-4c8b-9b4b-e0d3fbac2c66 tempest-VolumesImageMetadata-309946200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4a00d7b-d0d6-460f-8d38-d0185421c5b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:23 devstack cinder-volume[86591]: DEBUG cinder.image.glance [None req-4581b621-eaaa-4c8b-9b4b-e0d3fbac2c66 tempest-VolumesImageMetadata-309946200 None] Creating Keystone auth plugin from conf {{(pid=86591) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 00:18:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4581b621-eaaa-4c8b-9b4b-e0d3fbac2c66 tempest-VolumesImageMetadata-309946200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4a00d7b-d0d6-460f-8d38-d0185421c5b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3d0d4b5f-0a9b-4ff3-8831-dfc59e01aa9e', 'volume_name': 'volume-3d0d4b5f-0a9b-4ff3-8831-dfc59e01aa9e', 'volume_size': 1, 'image_id': 'acf635b7-10f9-4fce-8332-3b60fddafd4d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/acf635b7-10f9-4fce-8332-3b60fddafd4d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '91fff89797994a81952b7814d0d951c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'acf635b7-10f9-4fce-8332-3b60fddafd4d', 'created_at': datetime.datetime(2026, 9, 22, 22, 4, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 4, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/acf635b7-10f9-4fce-8332-3b60fddafd4d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4581b621-eaaa-4c8b-9b4b-e0d3fbac2c66 tempest-VolumesImageMetadata-309946200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e28b7860-d7e7-4b25-8b5e-b0e5d658a316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4581b621-eaaa-4c8b-9b4b-e0d3fbac2c66 tempest-VolumesImageMetadata-309946200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e28b7860-d7e7-4b25-8b5e-b0e5d658a316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4581b621-eaaa-4c8b-9b4b-e0d3fbac2c66 tempest-VolumesImageMetadata-309946200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2671ebbe-08d3-4d65-8c56-0b9e0d929965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:24 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-4581b621-eaaa-4c8b-9b4b-e0d3fbac2c66 tempest-VolumesImageMetadata-309946200 None] Volume 3d0d4b5f-0a9b-4ff3-8831-dfc59e01aa9e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3d0d4b5f-0a9b-4ff3-8831-dfc59e01aa9e', 'volume_size': 1, 'image_id': 'acf635b7-10f9-4fce-8332-3b60fddafd4d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/acf635b7-10f9-4fce-8332-3b60fddafd4d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '91fff89797994a81952b7814d0d951c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'acf635b7-10f9-4fce-8332-3b60fddafd4d', 'created_at': datetime.datetime(2026, 9, 22, 22, 4, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 4, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/acf635b7-10f9-4fce-8332-3b60fddafd4d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 23 00:18:24 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-4581b621-eaaa-4c8b-9b4b-e0d3fbac2c66 tempest-VolumesImageMetadata-309946200 None] Trying to clone 3d0d4b5f-0a9b-4ff3-8831-dfc59e01aa9e from image acf635b7-10f9-4fce-8332-3b60fddafd4d at location (None, [{'url': 'file:///opt/stack/data/glance/images/acf635b7-10f9-4fce-8332-3b60fddafd4d', 'metadata': {}}]). {{(pid=86591) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 00:18:25 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-4581b621-eaaa-4c8b-9b4b-e0d3fbac2c66 tempest-VolumesImageMetadata-309946200 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_icj8811_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86591) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 00:18:25 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-4581b621-eaaa-4c8b-9b4b-e0d3fbac2c66 tempest-VolumesImageMetadata-309946200 None] Image download 20.69 MB at 20.69 MB/s Sep 23 00:18:25 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7b245f-6fd1-4af9-bb6a-2573ce9b49d5]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:18:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4581b621-eaaa-4c8b-9b4b-e0d3fbac2c66 tempest-VolumesImageMetadata-309946200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_icj8811_devstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:25 devstack sudo[95794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_icj8811_devstack@QuobyteHD Sep 23 00:18:25 devstack sudo[95794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:25 devstack sudo[95794]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4581b621-eaaa-4c8b-9b4b-e0d3fbac2c66 tempest-VolumesImageMetadata-309946200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_icj8811_devstack@QuobyteHD" returned: 0 in 0.410s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:25 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-4581b621-eaaa-4c8b-9b4b-e0d3fbac2c66 tempest-VolumesImageMetadata-309946200 None] Temporary image acf635b7-10f9-4fce-8332-3b60fddafd4d is fetched for user 8dfd0649ffad49908f1df5b8f44d68f1. {{(pid=86591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 00:18:25 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec1ae03-d871-4a36-9176-29fbbda0f309]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:18:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4581b621-eaaa-4c8b-9b4b-e0d3fbac2c66 tempest-VolumesImageMetadata-309946200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_icj8811_devstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:25 devstack sudo[95800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_icj8811_devstack@QuobyteHD Sep 23 00:18:25 devstack sudo[95800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:26 devstack sudo[95800]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4581b621-eaaa-4c8b-9b4b-e0d3fbac2c66 tempest-VolumesImageMetadata-309946200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_icj8811_devstack@QuobyteHD" returned: 0 in 0.472s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4581b621-eaaa-4c8b-9b4b-e0d3fbac2c66 tempest-VolumesImageMetadata-309946200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4581b621-eaaa-4c8b-9b4b-e0d3fbac2c66 tempest-VolumesImageMetadata-309946200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:26 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4581b621-eaaa-4c8b-9b4b-e0d3fbac2c66 tempest-VolumesImageMetadata-309946200 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:18:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1360943357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d0d4b5f-0a9b-4ff3-8831-dfc59e01aa9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='518a87ea8c974266bc0094ed92528bd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:24Z,use_quota=True,user_id='8dfd0649ffad49908f1df5b8f44d68f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:18:26 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-4581b621-eaaa-4c8b-9b4b-e0d3fbac2c66 tempest-VolumesImageMetadata-309946200 None] Creating volume 3d0d4b5f-0a9b-4ff3-8831-dfc59e01aa9e {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:18:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4581b621-eaaa-4c8b-9b4b-e0d3fbac2c66 tempest-VolumesImageMetadata-309946200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4581b621-eaaa-4c8b-9b4b-e0d3fbac2c66 tempest-VolumesImageMetadata-309946200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:26 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4581b621-eaaa-4c8b-9b4b-e0d3fbac2c66 tempest-VolumesImageMetadata-309946200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:26 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4581b621-eaaa-4c8b-9b4b-e0d3fbac2c66 tempest-VolumesImageMetadata-309946200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4581b621-eaaa-4c8b-9b4b-e0d3fbac2c66 tempest-VolumesImageMetadata-309946200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:26 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4581b621-eaaa-4c8b-9b4b-e0d3fbac2c66 tempest-VolumesImageMetadata-309946200 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:18:26 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-4581b621-eaaa-4c8b-9b4b-e0d3fbac2c66 tempest-VolumesImageMetadata-309946200 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:18:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4581b621-eaaa-4c8b-9b4b-e0d3fbac2c66 tempest-VolumesImageMetadata-309946200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3d0d4b5f-0a9b-4ff3-8831-dfc59e01aa9e 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:26 devstack sudo[95806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3d0d4b5f-0a9b-4ff3-8831-dfc59e01aa9e 1073741824 Sep 23 00:18:26 devstack sudo[95806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:27 devstack sudo[95806]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4581b621-eaaa-4c8b-9b4b-e0d3fbac2c66 tempest-VolumesImageMetadata-309946200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3d0d4b5f-0a9b-4ff3-8831-dfc59e01aa9e 1073741824" returned: 0 in 0.702s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4581b621-eaaa-4c8b-9b4b-e0d3fbac2c66 tempest-VolumesImageMetadata-309946200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3d0d4b5f-0a9b-4ff3-8831-dfc59e01aa9e {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:27 devstack sudo[95813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3d0d4b5f-0a9b-4ff3-8831-dfc59e01aa9e Sep 23 00:18:27 devstack sudo[95813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:27 devstack sudo[95813]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4581b621-eaaa-4c8b-9b4b-e0d3fbac2c66 tempest-VolumesImageMetadata-309946200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3d0d4b5f-0a9b-4ff3-8831-dfc59e01aa9e" returned: 0 in 0.417s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:27 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4581b621-eaaa-4c8b-9b4b-e0d3fbac2c66 tempest-VolumesImageMetadata-309946200 None] <== create_volume: return (1226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:18:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4581b621-eaaa-4c8b-9b4b-e0d3fbac2c66 tempest-VolumesImageMetadata-309946200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.231s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:27 devstack cinder-volume[86591]: DEBUG cinder.volume.volume_utils [None req-4581b621-eaaa-4c8b-9b4b-e0d3fbac2c66 tempest-VolumesImageMetadata-309946200 None] Attempting download of acf635b7-10f9-4fce-8332-3b60fddafd4d ((None, [{'url': 'file:///opt/stack/data/glance/images/acf635b7-10f9-4fce-8332-3b60fddafd4d', 'metadata': {}}])) to volume 3d0d4b5f-0a9b-4ff3-8831-dfc59e01aa9e. {{(pid=86591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 00:18:27 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b2f82c-7c6a-4229-8097-0284f1219dbd]: (4, 'raw') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:18:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4581b621-eaaa-4c8b-9b4b-e0d3fbac2c66 tempest-VolumesImageMetadata-309946200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_acf635b7-10f9-4fce-8332-3b60fddafd4d_71_2gj6d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:27 devstack sudo[95816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_acf635b7-10f9-4fce-8332-3b60fddafd4d_71_2gj6d Sep 23 00:18:27 devstack sudo[95816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:28 devstack sudo[95816]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4581b621-eaaa-4c8b-9b4b-e0d3fbac2c66 tempest-VolumesImageMetadata-309946200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_acf635b7-10f9-4fce-8332-3b60fddafd4d_71_2gj6d" returned: 0 in 0.543s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4581b621-eaaa-4c8b-9b4b-e0d3fbac2c66 tempest-VolumesImageMetadata-309946200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_acf635b7-10f9-4fce-8332-3b60fddafd4d_71_2gj6d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:28 devstack sudo[95823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_acf635b7-10f9-4fce-8332-3b60fddafd4d_71_2gj6d Sep 23 00:18:28 devstack sudo[95823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:28 devstack sudo[95823]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4581b621-eaaa-4c8b-9b4b-e0d3fbac2c66 tempest-VolumesImageMetadata-309946200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_acf635b7-10f9-4fce-8332-3b60fddafd4d_71_2gj6d" returned: 1 in 0.596s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4581b621-eaaa-4c8b-9b4b-e0d3fbac2c66 tempest-VolumesImageMetadata-309946200 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_acf635b7-10f9-4fce-8332-3b60fddafd4d_71_2gj6d' failed. Not Retrying. {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:18:28 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6192406-d4a1-4083-b7ea-edd0436c5d03]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:18:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4581b621-eaaa-4c8b-9b4b-e0d3fbac2c66 tempest-VolumesImageMetadata-309946200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_icj8811_devstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:29 devstack sudo[95827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_icj8811_devstack@QuobyteHD Sep 23 00:18:29 devstack sudo[95827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:29 devstack sudo[95827]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4581b621-eaaa-4c8b-9b4b-e0d3fbac2c66 tempest-VolumesImageMetadata-309946200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_icj8811_devstack@QuobyteHD" returned: 0 in 0.792s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:29 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-4581b621-eaaa-4c8b-9b4b-e0d3fbac2c66 tempest-VolumesImageMetadata-309946200 None] acf635b7-10f9-4fce-8332-3b60fddafd4d was qcow2, converting to qcow2 {{(pid=86591) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 00:18:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4581b621-eaaa-4c8b-9b4b-e0d3fbac2c66 tempest-VolumesImageMetadata-309946200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_icj8811_devstack@QuobyteHD /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3d0d4b5f-0a9b-4ff3-8831-dfc59e01aa9e {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:29 devstack sudo[95834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_icj8811_devstack@QuobyteHD /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3d0d4b5f-0a9b-4ff3-8831-dfc59e01aa9e Sep 23 00:18:29 devstack sudo[95834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:32 devstack sudo[95834]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4581b621-eaaa-4c8b-9b4b-e0d3fbac2c66 tempest-VolumesImageMetadata-309946200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_icj8811_devstack@QuobyteHD /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3d0d4b5f-0a9b-4ff3-8831-dfc59e01aa9e" returned: 0 in 2.894s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:32 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-4581b621-eaaa-4c8b-9b4b-e0d3fbac2c66 tempest-VolumesImageMetadata-309946200 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_icj8811_devstack@QuobyteHD, size 112.00 MB, duration 2.90 sec, destination /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3d0d4b5f-0a9b-4ff3-8831-dfc59e01aa9e {{(pid=86591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:18:32 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-4581b621-eaaa-4c8b-9b4b-e0d3fbac2c66 tempest-VolumesImageMetadata-309946200 None] Converted 112.00 MB image at 38.68 MB/s Sep 23 00:18:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4581b621-eaaa-4c8b-9b4b-e0d3fbac2c66 tempest-VolumesImageMetadata-309946200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3d0d4b5f-0a9b-4ff3-8831-dfc59e01aa9e 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:32 devstack sudo[95842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3d0d4b5f-0a9b-4ff3-8831-dfc59e01aa9e 1G Sep 23 00:18:32 devstack sudo[95842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:32 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2c696e8-8dc1-41a3-9fcc-acc9b67609e0 tempest-ServersNegativeTestJSON-877174322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:18:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f2c696e8-8dc1-41a3-9fcc-acc9b67609e0 tempest-ServersNegativeTestJSON-877174322 None] Flow 'volume_create_manager' (92c02b57-5858-45fa-ad6b-03dd989bcee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:18:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f2c696e8-8dc1-41a3-9fcc-acc9b67609e0 tempest-ServersNegativeTestJSON-877174322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0e96a3e-9cb6-41be-a39f-d3b0c2b999a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f2c696e8-8dc1-41a3-9fcc-acc9b67609e0 tempest-ServersNegativeTestJSON-877174322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0e96a3e-9cb6-41be-a39f-d3b0c2b999a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:18:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-258615676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbb9f997-cf1c-42d3-8fdb-16dd22329bbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a7edb8ec8ed4e86a9f821696672b238',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:33Z,use_quota=True,user_id='b11a2613879047fab666e1504c971b00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f2c696e8-8dc1-41a3-9fcc-acc9b67609e0 tempest-ServersNegativeTestJSON-877174322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0a7ce38-f628-4d19-bf25-a843146dad3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f2c696e8-8dc1-41a3-9fcc-acc9b67609e0 tempest-ServersNegativeTestJSON-877174322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0a7ce38-f628-4d19-bf25-a843146dad3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f2c696e8-8dc1-41a3-9fcc-acc9b67609e0 tempest-ServersNegativeTestJSON-877174322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e25d7f22-097a-4036-ad5b-c9d7e82707a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f2c696e8-8dc1-41a3-9fcc-acc9b67609e0 tempest-ServersNegativeTestJSON-877174322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e25d7f22-097a-4036-ad5b-c9d7e82707a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbb9f997-cf1c-42d3-8fdb-16dd22329bbc', 'volume_name': 'volume-bbb9f997-cf1c-42d3-8fdb-16dd22329bbc', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f2c696e8-8dc1-41a3-9fcc-acc9b67609e0 tempest-ServersNegativeTestJSON-877174322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2d5d4c2-985c-4989-97eb-5a3b9feef7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f2c696e8-8dc1-41a3-9fcc-acc9b67609e0 tempest-ServersNegativeTestJSON-877174322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2d5d4c2-985c-4989-97eb-5a3b9feef7ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f2c696e8-8dc1-41a3-9fcc-acc9b67609e0 tempest-ServersNegativeTestJSON-877174322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3ad5ca2-0234-4c47-8e33-2b59df1b5638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:32 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-f2c696e8-8dc1-41a3-9fcc-acc9b67609e0 tempest-ServersNegativeTestJSON-877174322 None] Volume bbb9f997-cf1c-42d3-8fdb-16dd22329bbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbb9f997-cf1c-42d3-8fdb-16dd22329bbc', 'volume_size': 1} Sep 23 00:18:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f2c696e8-8dc1-41a3-9fcc-acc9b67609e0 tempest-ServersNegativeTestJSON-877174322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f2c696e8-8dc1-41a3-9fcc-acc9b67609e0 tempest-ServersNegativeTestJSON-877174322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:32 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f2c696e8-8dc1-41a3-9fcc-acc9b67609e0 tempest-ServersNegativeTestJSON-877174322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:18:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-258615676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbb9f997-cf1c-42d3-8fdb-16dd22329bbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a7edb8ec8ed4e86a9f821696672b238',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:33Z,use_quota=True,user_id='b11a2613879047fab666e1504c971b00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:18:32 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-f2c696e8-8dc1-41a3-9fcc-acc9b67609e0 tempest-ServersNegativeTestJSON-877174322 None] Creating volume bbb9f997-cf1c-42d3-8fdb-16dd22329bbc {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:18:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f2c696e8-8dc1-41a3-9fcc-acc9b67609e0 tempest-ServersNegativeTestJSON-877174322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f2c696e8-8dc1-41a3-9fcc-acc9b67609e0 tempest-ServersNegativeTestJSON-877174322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:32 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f2c696e8-8dc1-41a3-9fcc-acc9b67609e0 tempest-ServersNegativeTestJSON-877174322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:32 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f2c696e8-8dc1-41a3-9fcc-acc9b67609e0 tempest-ServersNegativeTestJSON-877174322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f2c696e8-8dc1-41a3-9fcc-acc9b67609e0 tempest-ServersNegativeTestJSON-877174322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:32 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f2c696e8-8dc1-41a3-9fcc-acc9b67609e0 tempest-ServersNegativeTestJSON-877174322 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:18:32 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-f2c696e8-8dc1-41a3-9fcc-acc9b67609e0 tempest-ServersNegativeTestJSON-877174322 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:18:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f2c696e8-8dc1-41a3-9fcc-acc9b67609e0 tempest-ServersNegativeTestJSON-877174322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-bbb9f997-cf1c-42d3-8fdb-16dd22329bbc 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:32 devstack sudo[95847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-bbb9f997-cf1c-42d3-8fdb-16dd22329bbc 1073741824 Sep 23 00:18:32 devstack sudo[95847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:33 devstack sudo[95842]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4581b621-eaaa-4c8b-9b4b-e0d3fbac2c66 tempest-VolumesImageMetadata-309946200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3d0d4b5f-0a9b-4ff3-8831-dfc59e01aa9e 1G" returned: 0 in 0.491s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:33 devstack cinder-volume[86591]: DEBUG cinder.volume.volume_utils [None req-4581b621-eaaa-4c8b-9b4b-e0d3fbac2c66 tempest-VolumesImageMetadata-309946200 None] Downloaded image acf635b7-10f9-4fce-8332-3b60fddafd4d ((None, [{'url': 'file:///opt/stack/data/glance/images/acf635b7-10f9-4fce-8332-3b60fddafd4d', 'metadata': {}}])) to volume 3d0d4b5f-0a9b-4ff3-8831-dfc59e01aa9e successfully. {{(pid=86591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 00:18:33 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-4581b621-eaaa-4c8b-9b4b-e0d3fbac2c66 tempest-VolumesImageMetadata-309946200 None] Temporary image acf635b7-10f9-4fce-8332-3b60fddafd4d for user 8dfd0649ffad49908f1df5b8f44d68f1 is deleted. {{(pid=86591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 00:18:33 devstack cinder-volume[86591]: DEBUG cinder.volume.volume_utils [None req-4581b621-eaaa-4c8b-9b4b-e0d3fbac2c66 tempest-VolumesImageMetadata-309946200 None] Marking volume 3d0d4b5f-0a9b-4ff3-8831-dfc59e01aa9e as bootable. {{(pid=86591) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 00:18:33 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-4581b621-eaaa-4c8b-9b4b-e0d3fbac2c66 tempest-VolumesImageMetadata-309946200 None] Copying metadata from image acf635b7-10f9-4fce-8332-3b60fddafd4d to 3d0d4b5f-0a9b-4ff3-8831-dfc59e01aa9e. {{(pid=86591) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 00:18:33 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-4581b621-eaaa-4c8b-9b4b-e0d3fbac2c66 tempest-VolumesImageMetadata-309946200 None] Creating volume glance metadata for volume 3d0d4b5f-0a9b-4ff3-8831-dfc59e01aa9e backed by image acf635b7-10f9-4fce-8332-3b60fddafd4d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'acf635b7-10f9-4fce-8332-3b60fddafd4d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86591) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 00:18:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4581b621-eaaa-4c8b-9b4b-e0d3fbac2c66 tempest-VolumesImageMetadata-309946200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2671ebbe-08d3-4d65-8c56-0b9e0d929965) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d0d4b5f-0a9b-4ff3-8831-dfc59e01aa9e', 'volume_size': 1, 'image_id': 'acf635b7-10f9-4fce-8332-3b60fddafd4d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/acf635b7-10f9-4fce-8332-3b60fddafd4d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '91fff89797994a81952b7814d0d951c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'acf635b7-10f9-4fce-8332-3b60fddafd4d', 'created_at': datetime.datetime(2026, 9, 22, 22, 4, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 4, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/acf635b7-10f9-4fce-8332-3b60fddafd4d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4581b621-eaaa-4c8b-9b4b-e0d3fbac2c66 tempest-VolumesImageMetadata-309946200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (726a8f2f-7af2-4fe6-8f1c-5a8539902f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:33 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-4581b621-eaaa-4c8b-9b4b-e0d3fbac2c66 tempest-VolumesImageMetadata-309946200 None] Volume volume-3d0d4b5f-0a9b-4ff3-8831-dfc59e01aa9e (3d0d4b5f-0a9b-4ff3-8831-dfc59e01aa9e): created successfully Sep 23 00:18:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4581b621-eaaa-4c8b-9b4b-e0d3fbac2c66 tempest-VolumesImageMetadata-309946200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (726a8f2f-7af2-4fe6-8f1c-5a8539902f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4581b621-eaaa-4c8b-9b4b-e0d3fbac2c66 tempest-VolumesImageMetadata-309946200 None] Flow 'volume_create_manager' (17e699b3-7763-4a84-81c3-bf09be500190) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:18:33 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-4581b621-eaaa-4c8b-9b4b-e0d3fbac2c66 tempest-VolumesImageMetadata-309946200 None] Created volume successfully. Sep 23 00:18:33 devstack sudo[95847]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f2c696e8-8dc1-41a3-9fcc-acc9b67609e0 tempest-ServersNegativeTestJSON-877174322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-bbb9f997-cf1c-42d3-8fdb-16dd22329bbc 1073741824" returned: 0 in 0.548s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f2c696e8-8dc1-41a3-9fcc-acc9b67609e0 tempest-ServersNegativeTestJSON-877174322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-bbb9f997-cf1c-42d3-8fdb-16dd22329bbc {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:33 devstack sudo[95853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-bbb9f997-cf1c-42d3-8fdb-16dd22329bbc Sep 23 00:18:33 devstack sudo[95853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:33 devstack sudo[95853]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f2c696e8-8dc1-41a3-9fcc-acc9b67609e0 tempest-ServersNegativeTestJSON-877174322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-bbb9f997-cf1c-42d3-8fdb-16dd22329bbc" returned: 0 in 0.315s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:33 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f2c696e8-8dc1-41a3-9fcc-acc9b67609e0 tempest-ServersNegativeTestJSON-877174322 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:18:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f2c696e8-8dc1-41a3-9fcc-acc9b67609e0 tempest-ServersNegativeTestJSON-877174322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f2c696e8-8dc1-41a3-9fcc-acc9b67609e0 tempest-ServersNegativeTestJSON-877174322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3ad5ca2-0234-4c47-8e33-2b59df1b5638) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbb9f997-cf1c-42d3-8fdb-16dd22329bbc', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f2c696e8-8dc1-41a3-9fcc-acc9b67609e0 tempest-ServersNegativeTestJSON-877174322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27e562e6-5465-489e-86fc-d6fa044364a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:33 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-f2c696e8-8dc1-41a3-9fcc-acc9b67609e0 tempest-ServersNegativeTestJSON-877174322 None] Volume volume-bbb9f997-cf1c-42d3-8fdb-16dd22329bbc (bbb9f997-cf1c-42d3-8fdb-16dd22329bbc): created successfully Sep 23 00:18:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f2c696e8-8dc1-41a3-9fcc-acc9b67609e0 tempest-ServersNegativeTestJSON-877174322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27e562e6-5465-489e-86fc-d6fa044364a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f2c696e8-8dc1-41a3-9fcc-acc9b67609e0 tempest-ServersNegativeTestJSON-877174322 None] Flow 'volume_create_manager' (92c02b57-5858-45fa-ad6b-03dd989bcee8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:18:33 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-f2c696e8-8dc1-41a3-9fcc-acc9b67609e0 tempest-ServersNegativeTestJSON-877174322 None] Created volume successfully. Sep 23 00:18:34 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-952ed091-5fa2-431f-85f0-139708153049 tempest-VolumesImageMetadata-309946200 None] Acquiring lock "cinder-3d0d4b5f-0a9b-4ff3-8831-dfc59e01aa9e-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:34 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-952ed091-5fa2-431f-85f0-139708153049 tempest-VolumesImageMetadata-309946200 None] Lock "cinder-3d0d4b5f-0a9b-4ff3-8831-dfc59e01aa9e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:34 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-952ed091-5fa2-431f-85f0-139708153049 tempest-VolumesImageMetadata-309946200 None] Acquiring lock "cinder-quobyte-3d0d4b5f-0a9b-4ff3-8831-dfc59e01aa9e" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:34 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-952ed091-5fa2-431f-85f0-139708153049 tempest-VolumesImageMetadata-309946200 None] Lock "cinder-quobyte-3d0d4b5f-0a9b-4ff3-8831-dfc59e01aa9e" acquired by "delete_volume" :: waited 0.024s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:34 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43efa7b-ecb9-49bc-9e37-0a44c2b90cfa]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:18:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-952ed091-5fa2-431f-85f0-139708153049 tempest-VolumesImageMetadata-309946200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3d0d4b5f-0a9b-4ff3-8831-dfc59e01aa9e {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:34 devstack sudo[95856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3d0d4b5f-0a9b-4ff3-8831-dfc59e01aa9e Sep 23 00:18:34 devstack sudo[95856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:35 devstack sudo[95856]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-952ed091-5fa2-431f-85f0-139708153049 tempest-VolumesImageMetadata-309946200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3d0d4b5f-0a9b-4ff3-8831-dfc59e01aa9e" returned: 0 in 0.598s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-952ed091-5fa2-431f-85f0-139708153049 tempest-VolumesImageMetadata-309946200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3d0d4b5f-0a9b-4ff3-8831-dfc59e01aa9e {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:35 devstack sudo[95864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3d0d4b5f-0a9b-4ff3-8831-dfc59e01aa9e Sep 23 00:18:35 devstack sudo[95864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:35 devstack sudo[95864]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-952ed091-5fa2-431f-85f0-139708153049 tempest-VolumesImageMetadata-309946200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3d0d4b5f-0a9b-4ff3-8831-dfc59e01aa9e" returned: 0 in 0.423s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:35 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-952ed091-5fa2-431f-85f0-139708153049 tempest-VolumesImageMetadata-309946200 None] Lock "cinder-quobyte-3d0d4b5f-0a9b-4ff3-8831-dfc59e01aa9e" released by "delete_volume" :: held 1.123s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:35 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-952ed091-5fa2-431f-85f0-139708153049 tempest-VolumesImageMetadata-309946200 None] Created reservations ['870ab30c-5aec-4981-9e21-0c8ebc92d153', 'b96bae38-318b-43c2-ae8f-2310fb239149', 'b7191dc6-e362-4f8a-97a6-09a605ed5aff', '3e20f08b-c5d5-4b86-80cb-e0a19996187e'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:18:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-952ed091-5fa2-431f-85f0-139708153049 tempest-VolumesImageMetadata-309946200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-952ed091-5fa2-431f-85f0-139708153049 tempest-VolumesImageMetadata-309946200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:35 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-952ed091-5fa2-431f-85f0-139708153049 tempest-VolumesImageMetadata-309946200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:35 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-952ed091-5fa2-431f-85f0-139708153049 tempest-VolumesImageMetadata-309946200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-952ed091-5fa2-431f-85f0-139708153049 tempest-VolumesImageMetadata-309946200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-952ed091-5fa2-431f-85f0-139708153049 tempest-VolumesImageMetadata-309946200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:35 devstack sudo[95868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:18:35 devstack sudo[95868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:36 devstack sudo[95868]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-952ed091-5fa2-431f-85f0-139708153049 tempest-VolumesImageMetadata-309946200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.361s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:36 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-952ed091-5fa2-431f-85f0-139708153049 tempest-VolumesImageMetadata-309946200 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:18:36 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-952ed091-5fa2-431f-85f0-139708153049 tempest-VolumesImageMetadata-309946200 None] Deleted volume successfully. Sep 23 00:18:36 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-952ed091-5fa2-431f-85f0-139708153049 tempest-VolumesImageMetadata-309946200 None] Lock "cinder-3d0d4b5f-0a9b-4ff3-8831-dfc59e01aa9e-delete_volume" released by "delete_volume" :: held 1.860s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:37 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-37af81e7-14ac-4bfe-a48b-e989fb3eb27f tempest-ServersNegativeTestJSON-877174322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:18:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-37af81e7-14ac-4bfe-a48b-e989fb3eb27f tempest-ServersNegativeTestJSON-877174322 None] Flow 'volume_create_manager' (9076064a-800c-4bfd-9ab2-2ec0188e2588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:18:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-37af81e7-14ac-4bfe-a48b-e989fb3eb27f tempest-ServersNegativeTestJSON-877174322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5c5e945-9c7a-4f7c-bf69-60ae088962cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-37af81e7-14ac-4bfe-a48b-e989fb3eb27f tempest-ServersNegativeTestJSON-877174322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5c5e945-9c7a-4f7c-bf69-60ae088962cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-383538602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c079cb0d-86b9-4d1f-b078-410ef247228b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a7edb8ec8ed4e86a9f821696672b238',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:37Z,use_quota=True,user_id='b11a2613879047fab666e1504c971b00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-37af81e7-14ac-4bfe-a48b-e989fb3eb27f tempest-ServersNegativeTestJSON-877174322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e8c801d-aea5-4231-8e36-4ac2cb0aa142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-37af81e7-14ac-4bfe-a48b-e989fb3eb27f tempest-ServersNegativeTestJSON-877174322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e8c801d-aea5-4231-8e36-4ac2cb0aa142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-37af81e7-14ac-4bfe-a48b-e989fb3eb27f tempest-ServersNegativeTestJSON-877174322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e22813c-a139-44eb-ba9c-4666748fed3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-37af81e7-14ac-4bfe-a48b-e989fb3eb27f tempest-ServersNegativeTestJSON-877174322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e22813c-a139-44eb-ba9c-4666748fed3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c079cb0d-86b9-4d1f-b078-410ef247228b', 'volume_name': 'volume-c079cb0d-86b9-4d1f-b078-410ef247228b', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-37af81e7-14ac-4bfe-a48b-e989fb3eb27f tempest-ServersNegativeTestJSON-877174322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83ce40ce-5462-47bd-9460-f2fd6064a5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-37af81e7-14ac-4bfe-a48b-e989fb3eb27f tempest-ServersNegativeTestJSON-877174322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83ce40ce-5462-47bd-9460-f2fd6064a5e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-37af81e7-14ac-4bfe-a48b-e989fb3eb27f tempest-ServersNegativeTestJSON-877174322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c62a92ec-7a0c-45c3-bb61-adfea801e61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:37 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-37af81e7-14ac-4bfe-a48b-e989fb3eb27f tempest-ServersNegativeTestJSON-877174322 None] Volume c079cb0d-86b9-4d1f-b078-410ef247228b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c079cb0d-86b9-4d1f-b078-410ef247228b', 'volume_size': 1} Sep 23 00:18:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-37af81e7-14ac-4bfe-a48b-e989fb3eb27f tempest-ServersNegativeTestJSON-877174322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-37af81e7-14ac-4bfe-a48b-e989fb3eb27f tempest-ServersNegativeTestJSON-877174322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-37af81e7-14ac-4bfe-a48b-e989fb3eb27f tempest-ServersNegativeTestJSON-877174322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-383538602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c079cb0d-86b9-4d1f-b078-410ef247228b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a7edb8ec8ed4e86a9f821696672b238',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:37Z,use_quota=True,user_id='b11a2613879047fab666e1504c971b00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:18:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-37af81e7-14ac-4bfe-a48b-e989fb3eb27f tempest-ServersNegativeTestJSON-877174322 None] Creating volume c079cb0d-86b9-4d1f-b078-410ef247228b {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:18:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-37af81e7-14ac-4bfe-a48b-e989fb3eb27f tempest-ServersNegativeTestJSON-877174322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-37af81e7-14ac-4bfe-a48b-e989fb3eb27f tempest-ServersNegativeTestJSON-877174322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-37af81e7-14ac-4bfe-a48b-e989fb3eb27f tempest-ServersNegativeTestJSON-877174322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-37af81e7-14ac-4bfe-a48b-e989fb3eb27f tempest-ServersNegativeTestJSON-877174322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-37af81e7-14ac-4bfe-a48b-e989fb3eb27f tempest-ServersNegativeTestJSON-877174322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-37af81e7-14ac-4bfe-a48b-e989fb3eb27f tempest-ServersNegativeTestJSON-877174322 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:18:37 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-37af81e7-14ac-4bfe-a48b-e989fb3eb27f tempest-ServersNegativeTestJSON-877174322 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:18:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-37af81e7-14ac-4bfe-a48b-e989fb3eb27f tempest-ServersNegativeTestJSON-877174322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c079cb0d-86b9-4d1f-b078-410ef247228b 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:37 devstack sudo[95872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c079cb0d-86b9-4d1f-b078-410ef247228b 1073741824 Sep 23 00:18:37 devstack sudo[95872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:38 devstack sudo[95872]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-37af81e7-14ac-4bfe-a48b-e989fb3eb27f tempest-ServersNegativeTestJSON-877174322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c079cb0d-86b9-4d1f-b078-410ef247228b 1073741824" returned: 0 in 0.815s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-37af81e7-14ac-4bfe-a48b-e989fb3eb27f tempest-ServersNegativeTestJSON-877174322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c079cb0d-86b9-4d1f-b078-410ef247228b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:38 devstack sudo[95888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c079cb0d-86b9-4d1f-b078-410ef247228b Sep 23 00:18:38 devstack sudo[95888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:38 devstack sudo[95888]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-37af81e7-14ac-4bfe-a48b-e989fb3eb27f tempest-ServersNegativeTestJSON-877174322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c079cb0d-86b9-4d1f-b078-410ef247228b" returned: 0 in 0.421s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:38 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-37af81e7-14ac-4bfe-a48b-e989fb3eb27f tempest-ServersNegativeTestJSON-877174322 None] <== create_volume: return (1326ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:18:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-37af81e7-14ac-4bfe-a48b-e989fb3eb27f tempest-ServersNegativeTestJSON-877174322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.329s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:38 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-37af81e7-14ac-4bfe-a48b-e989fb3eb27f tempest-ServersNegativeTestJSON-877174322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c62a92ec-7a0c-45c3-bb61-adfea801e61f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c079cb0d-86b9-4d1f-b078-410ef247228b', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:38 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-37af81e7-14ac-4bfe-a48b-e989fb3eb27f tempest-ServersNegativeTestJSON-877174322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aad9731-b410-4c2f-9087-7ba5ecc93589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:38 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-37af81e7-14ac-4bfe-a48b-e989fb3eb27f tempest-ServersNegativeTestJSON-877174322 None] Volume volume-c079cb0d-86b9-4d1f-b078-410ef247228b (c079cb0d-86b9-4d1f-b078-410ef247228b): created successfully Sep 23 00:18:38 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-37af81e7-14ac-4bfe-a48b-e989fb3eb27f tempest-ServersNegativeTestJSON-877174322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aad9731-b410-4c2f-9087-7ba5ecc93589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:38 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-37af81e7-14ac-4bfe-a48b-e989fb3eb27f tempest-ServersNegativeTestJSON-877174322 None] Flow 'volume_create_manager' (9076064a-800c-4bfd-9ab2-2ec0188e2588) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:18:38 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-37af81e7-14ac-4bfe-a48b-e989fb3eb27f tempest-ServersNegativeTestJSON-877174322 None] Created volume successfully. Sep 23 00:18:40 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9e152972-9608-4f28-9d72-99b6cc99ce30 tempest-ServersNegativeTestJSON-877174322 None] Acquiring lock "cinder-c079cb0d-86b9-4d1f-b078-410ef247228b-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:40 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9e152972-9608-4f28-9d72-99b6cc99ce30 tempest-ServersNegativeTestJSON-877174322 None] Lock "cinder-c079cb0d-86b9-4d1f-b078-410ef247228b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:40 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9e152972-9608-4f28-9d72-99b6cc99ce30 tempest-ServersNegativeTestJSON-877174322 None] Acquiring lock "cinder-quobyte-c079cb0d-86b9-4d1f-b078-410ef247228b" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:40 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9e152972-9608-4f28-9d72-99b6cc99ce30 tempest-ServersNegativeTestJSON-877174322 None] Lock "cinder-quobyte-c079cb0d-86b9-4d1f-b078-410ef247228b" acquired by "delete_volume" :: waited 0.018s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:40 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43f989c-b2ca-4b06-beea-481dfcbf1b7f]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:18:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9e152972-9608-4f28-9d72-99b6cc99ce30 tempest-ServersNegativeTestJSON-877174322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c079cb0d-86b9-4d1f-b078-410ef247228b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:40 devstack sudo[95911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c079cb0d-86b9-4d1f-b078-410ef247228b Sep 23 00:18:40 devstack sudo[95911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:41 devstack sudo[95911]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9e152972-9608-4f28-9d72-99b6cc99ce30 tempest-ServersNegativeTestJSON-877174322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c079cb0d-86b9-4d1f-b078-410ef247228b" returned: 0 in 0.919s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9e152972-9608-4f28-9d72-99b6cc99ce30 tempest-ServersNegativeTestJSON-877174322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c079cb0d-86b9-4d1f-b078-410ef247228b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:41 devstack sudo[95967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c079cb0d-86b9-4d1f-b078-410ef247228b Sep 23 00:18:41 devstack sudo[95967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:42 devstack sudo[95967]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9e152972-9608-4f28-9d72-99b6cc99ce30 tempest-ServersNegativeTestJSON-877174322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c079cb0d-86b9-4d1f-b078-410ef247228b" returned: 0 in 0.619s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:42 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9e152972-9608-4f28-9d72-99b6cc99ce30 tempest-ServersNegativeTestJSON-877174322 None] Lock "cinder-quobyte-c079cb0d-86b9-4d1f-b078-410ef247228b" released by "delete_volume" :: held 1.617s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:42 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-9e152972-9608-4f28-9d72-99b6cc99ce30 tempest-ServersNegativeTestJSON-877174322 None] Created reservations ['cb5be9fc-b7fa-4bbd-a874-7d86779b4a30', '5bbc0fb2-85ff-42d7-9174-bcad5077abb9', '80876d7c-cade-454c-ab3f-0e51cdfd242d', '967b9533-6e97-43d4-93c6-5168efac06e4'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:18:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9e152972-9608-4f28-9d72-99b6cc99ce30 tempest-ServersNegativeTestJSON-877174322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9e152972-9608-4f28-9d72-99b6cc99ce30 tempest-ServersNegativeTestJSON-877174322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9e152972-9608-4f28-9d72-99b6cc99ce30 tempest-ServersNegativeTestJSON-877174322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9e152972-9608-4f28-9d72-99b6cc99ce30 tempest-ServersNegativeTestJSON-877174322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9e152972-9608-4f28-9d72-99b6cc99ce30 tempest-ServersNegativeTestJSON-877174322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9e152972-9608-4f28-9d72-99b6cc99ce30 tempest-ServersNegativeTestJSON-877174322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:42 devstack sudo[95985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:18:42 devstack sudo[95985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:42 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f5179ad6-085f-45b5-88c5-e23b655fdab4 tempest-ServersNegativeTestJSON-877174322 None] Acquiring lock "cinder-bbb9f997-cf1c-42d3-8fdb-16dd22329bbc-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:42 devstack sudo[95985]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9e152972-9608-4f28-9d72-99b6cc99ce30 tempest-ServersNegativeTestJSON-877174322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.505s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:42 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-9e152972-9608-4f28-9d72-99b6cc99ce30 tempest-ServersNegativeTestJSON-877174322 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:18:42 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-9e152972-9608-4f28-9d72-99b6cc99ce30 tempest-ServersNegativeTestJSON-877174322 None] Deleted volume successfully. Sep 23 00:18:42 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f5179ad6-085f-45b5-88c5-e23b655fdab4 tempest-ServersNegativeTestJSON-877174322 None] Lock "cinder-bbb9f997-cf1c-42d3-8fdb-16dd22329bbc-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:43 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9e152972-9608-4f28-9d72-99b6cc99ce30 tempest-ServersNegativeTestJSON-877174322 None] Lock "cinder-c079cb0d-86b9-4d1f-b078-410ef247228b-delete_volume" released by "delete_volume" :: held 2.648s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:43 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f5179ad6-085f-45b5-88c5-e23b655fdab4 tempest-ServersNegativeTestJSON-877174322 None] Acquiring lock "cinder-quobyte-bbb9f997-cf1c-42d3-8fdb-16dd22329bbc" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:43 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f5179ad6-085f-45b5-88c5-e23b655fdab4 tempest-ServersNegativeTestJSON-877174322 None] Lock "cinder-quobyte-bbb9f997-cf1c-42d3-8fdb-16dd22329bbc" acquired by "delete_volume" :: waited 0.036s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:43 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[8008ae16-0754-43b6-b021-5e87fc0899b9]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:18:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f5179ad6-085f-45b5-88c5-e23b655fdab4 tempest-ServersNegativeTestJSON-877174322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-bbb9f997-cf1c-42d3-8fdb-16dd22329bbc {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:43 devstack sudo[95991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-bbb9f997-cf1c-42d3-8fdb-16dd22329bbc Sep 23 00:18:43 devstack sudo[95991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:43 devstack sudo[95991]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f5179ad6-085f-45b5-88c5-e23b655fdab4 tempest-ServersNegativeTestJSON-877174322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-bbb9f997-cf1c-42d3-8fdb-16dd22329bbc" returned: 0 in 0.527s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f5179ad6-085f-45b5-88c5-e23b655fdab4 tempest-ServersNegativeTestJSON-877174322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-bbb9f997-cf1c-42d3-8fdb-16dd22329bbc {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:43 devstack sudo[95996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-bbb9f997-cf1c-42d3-8fdb-16dd22329bbc Sep 23 00:18:43 devstack sudo[95996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:44 devstack sudo[95996]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f5179ad6-085f-45b5-88c5-e23b655fdab4 tempest-ServersNegativeTestJSON-877174322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-bbb9f997-cf1c-42d3-8fdb-16dd22329bbc" returned: 0 in 0.305s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:44 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f5179ad6-085f-45b5-88c5-e23b655fdab4 tempest-ServersNegativeTestJSON-877174322 None] Lock "cinder-quobyte-bbb9f997-cf1c-42d3-8fdb-16dd22329bbc" released by "delete_volume" :: held 0.903s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:44 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-f5179ad6-085f-45b5-88c5-e23b655fdab4 tempest-ServersNegativeTestJSON-877174322 None] Created reservations ['c44f8289-1851-4f14-9807-1c0eea1fd35f', '9833c1c2-7f57-41e1-9ff1-ccd1c1946ce6', '91d2ec6c-2d2c-4e37-956e-f335c9e69942', 'd149ffaf-0b35-405f-9477-6ca802f90ccc'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:18:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5179ad6-085f-45b5-88c5-e23b655fdab4 tempest-ServersNegativeTestJSON-877174322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5179ad6-085f-45b5-88c5-e23b655fdab4 tempest-ServersNegativeTestJSON-877174322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:44 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f5179ad6-085f-45b5-88c5-e23b655fdab4 tempest-ServersNegativeTestJSON-877174322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:44 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f5179ad6-085f-45b5-88c5-e23b655fdab4 tempest-ServersNegativeTestJSON-877174322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5179ad6-085f-45b5-88c5-e23b655fdab4 tempest-ServersNegativeTestJSON-877174322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f5179ad6-085f-45b5-88c5-e23b655fdab4 tempest-ServersNegativeTestJSON-877174322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:44 devstack sudo[95999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:18:44 devstack sudo[95999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:44 devstack sudo[95999]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f5179ad6-085f-45b5-88c5-e23b655fdab4 tempest-ServersNegativeTestJSON-877174322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.473s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:44 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-f5179ad6-085f-45b5-88c5-e23b655fdab4 tempest-ServersNegativeTestJSON-877174322 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:18:44 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-f5179ad6-085f-45b5-88c5-e23b655fdab4 tempest-ServersNegativeTestJSON-877174322 None] Deleted volume successfully. Sep 23 00:18:44 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f5179ad6-085f-45b5-88c5-e23b655fdab4 tempest-ServersNegativeTestJSON-877174322 None] Lock "cinder-bbb9f997-cf1c-42d3-8fdb-16dd22329bbc-delete_volume" released by "delete_volume" :: held 1.902s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:46 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-a173011f-8962-4382-a79c-31d1e1cf7275 tempest-AbsoluteLimitsTests-1719024373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:18:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a173011f-8962-4382-a79c-31d1e1cf7275 tempest-AbsoluteLimitsTests-1719024373 None] Flow 'volume_create_manager' (b5b287c9-c4c1-4019-979e-92e028aa02dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:18:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a173011f-8962-4382-a79c-31d1e1cf7275 tempest-AbsoluteLimitsTests-1719024373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed596971-e883-447d-b42b-dbef47d9d3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a173011f-8962-4382-a79c-31d1e1cf7275 tempest-AbsoluteLimitsTests-1719024373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed596971-e883-447d-b42b-dbef47d9d3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:18:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1183301773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f494cf8f-fbd7-4f32-84e3-1342e5b3154c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='108a2094423b452c928a7a607283b96b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:46Z,use_quota=True,user_id='48ab7819d78544ad9925f5290f449cc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a173011f-8962-4382-a79c-31d1e1cf7275 tempest-AbsoluteLimitsTests-1719024373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbc11dce-2066-465e-890e-fc711ecd9172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a173011f-8962-4382-a79c-31d1e1cf7275 tempest-AbsoluteLimitsTests-1719024373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbc11dce-2066-465e-890e-fc711ecd9172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a173011f-8962-4382-a79c-31d1e1cf7275 tempest-AbsoluteLimitsTests-1719024373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a431e0d-7c61-439a-b2f3-8d8732dffcab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a173011f-8962-4382-a79c-31d1e1cf7275 tempest-AbsoluteLimitsTests-1719024373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a431e0d-7c61-439a-b2f3-8d8732dffcab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f494cf8f-fbd7-4f32-84e3-1342e5b3154c', 'volume_name': 'volume-f494cf8f-fbd7-4f32-84e3-1342e5b3154c', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a173011f-8962-4382-a79c-31d1e1cf7275 tempest-AbsoluteLimitsTests-1719024373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8b198f3-549f-428e-b252-de9bdfbf497c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a173011f-8962-4382-a79c-31d1e1cf7275 tempest-AbsoluteLimitsTests-1719024373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8b198f3-549f-428e-b252-de9bdfbf497c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a173011f-8962-4382-a79c-31d1e1cf7275 tempest-AbsoluteLimitsTests-1719024373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2673617-429a-4a8b-ae5b-424ebcd750f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:46 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-a173011f-8962-4382-a79c-31d1e1cf7275 tempest-AbsoluteLimitsTests-1719024373 None] Volume f494cf8f-fbd7-4f32-84e3-1342e5b3154c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f494cf8f-fbd7-4f32-84e3-1342e5b3154c', 'volume_size': 1} Sep 23 00:18:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a173011f-8962-4382-a79c-31d1e1cf7275 tempest-AbsoluteLimitsTests-1719024373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a173011f-8962-4382-a79c-31d1e1cf7275 tempest-AbsoluteLimitsTests-1719024373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a173011f-8962-4382-a79c-31d1e1cf7275 tempest-AbsoluteLimitsTests-1719024373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:18:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1183301773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f494cf8f-fbd7-4f32-84e3-1342e5b3154c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='108a2094423b452c928a7a607283b96b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:46Z,use_quota=True,user_id='48ab7819d78544ad9925f5290f449cc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:18:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-a173011f-8962-4382-a79c-31d1e1cf7275 tempest-AbsoluteLimitsTests-1719024373 None] Creating volume f494cf8f-fbd7-4f32-84e3-1342e5b3154c {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:18:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a173011f-8962-4382-a79c-31d1e1cf7275 tempest-AbsoluteLimitsTests-1719024373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a173011f-8962-4382-a79c-31d1e1cf7275 tempest-AbsoluteLimitsTests-1719024373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a173011f-8962-4382-a79c-31d1e1cf7275 tempest-AbsoluteLimitsTests-1719024373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a173011f-8962-4382-a79c-31d1e1cf7275 tempest-AbsoluteLimitsTests-1719024373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a173011f-8962-4382-a79c-31d1e1cf7275 tempest-AbsoluteLimitsTests-1719024373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a173011f-8962-4382-a79c-31d1e1cf7275 tempest-AbsoluteLimitsTests-1719024373 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:18:46 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-a173011f-8962-4382-a79c-31d1e1cf7275 tempest-AbsoluteLimitsTests-1719024373 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:18:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a173011f-8962-4382-a79c-31d1e1cf7275 tempest-AbsoluteLimitsTests-1719024373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f494cf8f-fbd7-4f32-84e3-1342e5b3154c 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:46 devstack sudo[96009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f494cf8f-fbd7-4f32-84e3-1342e5b3154c 1073741824 Sep 23 00:18:46 devstack sudo[96009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:47 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-449875a4-b3ba-40b8-ab91-a048a11b26c2 tempest-TestMinimumBasicScenario-1871786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:18:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-449875a4-b3ba-40b8-ab91-a048a11b26c2 tempest-TestMinimumBasicScenario-1871786 None] Flow 'volume_create_manager' (e1f97e1f-5039-47de-9e9b-961988aee573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:18:47 devstack sudo[96009]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-449875a4-b3ba-40b8-ab91-a048a11b26c2 tempest-TestMinimumBasicScenario-1871786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23a9e8ca-828d-4dc7-8804-530251fae09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a173011f-8962-4382-a79c-31d1e1cf7275 tempest-AbsoluteLimitsTests-1719024373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f494cf8f-fbd7-4f32-84e3-1342e5b3154c 1073741824" returned: 0 in 1.452s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-449875a4-b3ba-40b8-ab91-a048a11b26c2 tempest-TestMinimumBasicScenario-1871786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23a9e8ca-828d-4dc7-8804-530251fae09c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:18:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-518938669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5caa0a52-4ebf-4fd8-88d5-c49590e9ff3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='921b963ed6324207af6845c1961cc491',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:48Z,use_quota=True,user_id='dffbd4d0a66a4690a293a2e35e9fc332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-449875a4-b3ba-40b8-ab91-a048a11b26c2 tempest-TestMinimumBasicScenario-1871786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66dfc067-feeb-49e3-8fee-8cad8b3021ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-449875a4-b3ba-40b8-ab91-a048a11b26c2 tempest-TestMinimumBasicScenario-1871786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66dfc067-feeb-49e3-8fee-8cad8b3021ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-449875a4-b3ba-40b8-ab91-a048a11b26c2 tempest-TestMinimumBasicScenario-1871786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10b6827b-7701-44b8-814f-a0917131e47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-449875a4-b3ba-40b8-ab91-a048a11b26c2 tempest-TestMinimumBasicScenario-1871786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10b6827b-7701-44b8-814f-a0917131e47c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5caa0a52-4ebf-4fd8-88d5-c49590e9ff3a', 'volume_name': 'volume-5caa0a52-4ebf-4fd8-88d5-c49590e9ff3a', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-449875a4-b3ba-40b8-ab91-a048a11b26c2 tempest-TestMinimumBasicScenario-1871786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e071f4c4-084b-4c15-a594-556d1b7f370e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-449875a4-b3ba-40b8-ab91-a048a11b26c2 tempest-TestMinimumBasicScenario-1871786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e071f4c4-084b-4c15-a594-556d1b7f370e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-449875a4-b3ba-40b8-ab91-a048a11b26c2 tempest-TestMinimumBasicScenario-1871786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca74d05b-467b-490a-be03-e165fb107c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:47 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-449875a4-b3ba-40b8-ab91-a048a11b26c2 tempest-TestMinimumBasicScenario-1871786 None] Volume 5caa0a52-4ebf-4fd8-88d5-c49590e9ff3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5caa0a52-4ebf-4fd8-88d5-c49590e9ff3a', 'volume_size': 1} Sep 23 00:18:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-449875a4-b3ba-40b8-ab91-a048a11b26c2 tempest-TestMinimumBasicScenario-1871786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a173011f-8962-4382-a79c-31d1e1cf7275 tempest-AbsoluteLimitsTests-1719024373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f494cf8f-fbd7-4f32-84e3-1342e5b3154c {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:47 devstack sudo[96032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f494cf8f-fbd7-4f32-84e3-1342e5b3154c Sep 23 00:18:47 devstack sudo[96032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:48 devstack sudo[96032]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a173011f-8962-4382-a79c-31d1e1cf7275 tempest-AbsoluteLimitsTests-1719024373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f494cf8f-fbd7-4f32-84e3-1342e5b3154c" returned: 0 in 0.528s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:48 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a173011f-8962-4382-a79c-31d1e1cf7275 tempest-AbsoluteLimitsTests-1719024373 None] <== create_volume: return (2092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:18:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a173011f-8962-4382-a79c-31d1e1cf7275 tempest-AbsoluteLimitsTests-1719024373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.098s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-449875a4-b3ba-40b8-ab91-a048a11b26c2 tempest-TestMinimumBasicScenario-1871786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.594s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:48 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-449875a4-b3ba-40b8-ab91-a048a11b26c2 tempest-TestMinimumBasicScenario-1871786 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:18:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-518938669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5caa0a52-4ebf-4fd8-88d5-c49590e9ff3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='921b963ed6324207af6845c1961cc491',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:48Z,use_quota=True,user_id='dffbd4d0a66a4690a293a2e35e9fc332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:18:48 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-449875a4-b3ba-40b8-ab91-a048a11b26c2 tempest-TestMinimumBasicScenario-1871786 None] Creating volume 5caa0a52-4ebf-4fd8-88d5-c49590e9ff3a {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:18:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-449875a4-b3ba-40b8-ab91-a048a11b26c2 tempest-TestMinimumBasicScenario-1871786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-449875a4-b3ba-40b8-ab91-a048a11b26c2 tempest-TestMinimumBasicScenario-1871786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:48 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-449875a4-b3ba-40b8-ab91-a048a11b26c2 tempest-TestMinimumBasicScenario-1871786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:48 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-449875a4-b3ba-40b8-ab91-a048a11b26c2 tempest-TestMinimumBasicScenario-1871786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-449875a4-b3ba-40b8-ab91-a048a11b26c2 tempest-TestMinimumBasicScenario-1871786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:48 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-449875a4-b3ba-40b8-ab91-a048a11b26c2 tempest-TestMinimumBasicScenario-1871786 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:18:48 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-449875a4-b3ba-40b8-ab91-a048a11b26c2 tempest-TestMinimumBasicScenario-1871786 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:18:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-449875a4-b3ba-40b8-ab91-a048a11b26c2 tempest-TestMinimumBasicScenario-1871786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-5caa0a52-4ebf-4fd8-88d5-c49590e9ff3a 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:48 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a173011f-8962-4382-a79c-31d1e1cf7275 tempest-AbsoluteLimitsTests-1719024373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2673617-429a-4a8b-ae5b-424ebcd750f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f494cf8f-fbd7-4f32-84e3-1342e5b3154c', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:48 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a173011f-8962-4382-a79c-31d1e1cf7275 tempest-AbsoluteLimitsTests-1719024373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27a80b8d-8276-4536-b6d2-a0a57c340be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:48 devstack sudo[96037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-5caa0a52-4ebf-4fd8-88d5-c49590e9ff3a 1073741824 Sep 23 00:18:48 devstack sudo[96037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:48 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-a173011f-8962-4382-a79c-31d1e1cf7275 tempest-AbsoluteLimitsTests-1719024373 None] Volume volume-f494cf8f-fbd7-4f32-84e3-1342e5b3154c (f494cf8f-fbd7-4f32-84e3-1342e5b3154c): created successfully Sep 23 00:18:48 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a173011f-8962-4382-a79c-31d1e1cf7275 tempest-AbsoluteLimitsTests-1719024373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27a80b8d-8276-4536-b6d2-a0a57c340be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:48 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a173011f-8962-4382-a79c-31d1e1cf7275 tempest-AbsoluteLimitsTests-1719024373 None] Flow 'volume_create_manager' (b5b287c9-c4c1-4019-979e-92e028aa02dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:18:48 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-a173011f-8962-4382-a79c-31d1e1cf7275 tempest-AbsoluteLimitsTests-1719024373 None] Created volume successfully. Sep 23 00:18:49 devstack sudo[96037]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-449875a4-b3ba-40b8-ab91-a048a11b26c2 tempest-TestMinimumBasicScenario-1871786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-5caa0a52-4ebf-4fd8-88d5-c49590e9ff3a 1073741824" returned: 0 in 0.679s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-449875a4-b3ba-40b8-ab91-a048a11b26c2 tempest-TestMinimumBasicScenario-1871786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-5caa0a52-4ebf-4fd8-88d5-c49590e9ff3a {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:49 devstack sudo[96043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-5caa0a52-4ebf-4fd8-88d5-c49590e9ff3a Sep 23 00:18:49 devstack sudo[96043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:49 devstack sudo[96043]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-449875a4-b3ba-40b8-ab91-a048a11b26c2 tempest-TestMinimumBasicScenario-1871786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-5caa0a52-4ebf-4fd8-88d5-c49590e9ff3a" returned: 0 in 0.382s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:49 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-449875a4-b3ba-40b8-ab91-a048a11b26c2 tempest-TestMinimumBasicScenario-1871786 None] <== create_volume: return (1186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:18:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-449875a4-b3ba-40b8-ab91-a048a11b26c2 tempest-TestMinimumBasicScenario-1871786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.190s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-449875a4-b3ba-40b8-ab91-a048a11b26c2 tempest-TestMinimumBasicScenario-1871786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca74d05b-467b-490a-be03-e165fb107c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5caa0a52-4ebf-4fd8-88d5-c49590e9ff3a', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-449875a4-b3ba-40b8-ab91-a048a11b26c2 tempest-TestMinimumBasicScenario-1871786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2603299f-afac-42a7-8342-d9fa5b057ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:49 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-449875a4-b3ba-40b8-ab91-a048a11b26c2 tempest-TestMinimumBasicScenario-1871786 None] Volume volume-5caa0a52-4ebf-4fd8-88d5-c49590e9ff3a (5caa0a52-4ebf-4fd8-88d5-c49590e9ff3a): created successfully Sep 23 00:18:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-449875a4-b3ba-40b8-ab91-a048a11b26c2 tempest-TestMinimumBasicScenario-1871786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2603299f-afac-42a7-8342-d9fa5b057ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-449875a4-b3ba-40b8-ab91-a048a11b26c2 tempest-TestMinimumBasicScenario-1871786 None] Flow 'volume_create_manager' (e1f97e1f-5039-47de-9e9b-961988aee573) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:18:49 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-449875a4-b3ba-40b8-ab91-a048a11b26c2 tempest-TestMinimumBasicScenario-1871786 None] Created volume successfully. Sep 23 00:18:49 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b8b89c66-73e7-4f70-a8cf-e55136a4a90b tempest-AbsoluteLimitsTests-1719024373 None] Acquiring lock "cinder-f494cf8f-fbd7-4f32-84e3-1342e5b3154c-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:49 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b8b89c66-73e7-4f70-a8cf-e55136a4a90b tempest-AbsoluteLimitsTests-1719024373 None] Lock "cinder-f494cf8f-fbd7-4f32-84e3-1342e5b3154c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:49 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b8b89c66-73e7-4f70-a8cf-e55136a4a90b tempest-AbsoluteLimitsTests-1719024373 None] Acquiring lock "cinder-quobyte-f494cf8f-fbd7-4f32-84e3-1342e5b3154c" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:49 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b8b89c66-73e7-4f70-a8cf-e55136a4a90b tempest-AbsoluteLimitsTests-1719024373 None] Lock "cinder-quobyte-f494cf8f-fbd7-4f32-84e3-1342e5b3154c" acquired by "delete_volume" :: waited 0.022s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:49 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ea6a94-b463-4935-a3f9-4f5d1601522e]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:18:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b8b89c66-73e7-4f70-a8cf-e55136a4a90b tempest-AbsoluteLimitsTests-1719024373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f494cf8f-fbd7-4f32-84e3-1342e5b3154c {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:50 devstack sudo[96046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f494cf8f-fbd7-4f32-84e3-1342e5b3154c Sep 23 00:18:50 devstack sudo[96046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:50 devstack sudo[96046]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b8b89c66-73e7-4f70-a8cf-e55136a4a90b tempest-AbsoluteLimitsTests-1719024373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f494cf8f-fbd7-4f32-84e3-1342e5b3154c" returned: 0 in 0.638s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b8b89c66-73e7-4f70-a8cf-e55136a4a90b tempest-AbsoluteLimitsTests-1719024373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f494cf8f-fbd7-4f32-84e3-1342e5b3154c {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:50 devstack sudo[96051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f494cf8f-fbd7-4f32-84e3-1342e5b3154c Sep 23 00:18:50 devstack sudo[96051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:50 devstack sudo[96051]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b8b89c66-73e7-4f70-a8cf-e55136a4a90b tempest-AbsoluteLimitsTests-1719024373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f494cf8f-fbd7-4f32-84e3-1342e5b3154c" returned: 0 in 0.375s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:51 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b8b89c66-73e7-4f70-a8cf-e55136a4a90b tempest-AbsoluteLimitsTests-1719024373 None] Lock "cinder-quobyte-f494cf8f-fbd7-4f32-84e3-1342e5b3154c" released by "delete_volume" :: held 1.125s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:51 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-b8b89c66-73e7-4f70-a8cf-e55136a4a90b tempest-AbsoluteLimitsTests-1719024373 None] Created reservations ['8571448c-b485-44d0-8143-01c8724b0f40', 'a8094fb9-9901-4a31-a576-a7cde69aa38a', '867051f2-df3a-4f99-bedc-f29fba6460d4', '3dd706fb-50b7-4d92-8ef8-ceaaec2210c4'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:18:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b8b89c66-73e7-4f70-a8cf-e55136a4a90b tempest-AbsoluteLimitsTests-1719024373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b8b89c66-73e7-4f70-a8cf-e55136a4a90b tempest-AbsoluteLimitsTests-1719024373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:51 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b8b89c66-73e7-4f70-a8cf-e55136a4a90b tempest-AbsoluteLimitsTests-1719024373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:51 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b8b89c66-73e7-4f70-a8cf-e55136a4a90b tempest-AbsoluteLimitsTests-1719024373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b8b89c66-73e7-4f70-a8cf-e55136a4a90b tempest-AbsoluteLimitsTests-1719024373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b8b89c66-73e7-4f70-a8cf-e55136a4a90b tempest-AbsoluteLimitsTests-1719024373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:51 devstack sudo[96058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:18:51 devstack sudo[96058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:51 devstack sudo[96058]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b8b89c66-73e7-4f70-a8cf-e55136a4a90b tempest-AbsoluteLimitsTests-1719024373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.581s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:51 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-b8b89c66-73e7-4f70-a8cf-e55136a4a90b tempest-AbsoluteLimitsTests-1719024373 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:18:51 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-b8b89c66-73e7-4f70-a8cf-e55136a4a90b tempest-AbsoluteLimitsTests-1719024373 None] Deleted volume successfully. Sep 23 00:18:52 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b8b89c66-73e7-4f70-a8cf-e55136a4a90b tempest-AbsoluteLimitsTests-1719024373 None] Lock "cinder-f494cf8f-fbd7-4f32-84e3-1342e5b3154c-delete_volume" released by "delete_volume" :: held 2.222s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-269fd386-6095-4727-b288-ae84a0e60fad req-8e451144-19a8-4838-88f0-e5f6ed98c45b tempest-TestMinimumBasicScenario-1871786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-269fd386-6095-4727-b288-ae84a0e60fad req-8e451144-19a8-4838-88f0-e5f6ed98c45b tempest-TestMinimumBasicScenario-1871786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-269fd386-6095-4727-b288-ae84a0e60fad req-8e451144-19a8-4838-88f0-e5f6ed98c45b tempest-TestMinimumBasicScenario-1871786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-269fd386-6095-4727-b288-ae84a0e60fad req-8e451144-19a8-4838-88f0-e5f6ed98c45b tempest-TestMinimumBasicScenario-1871786 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974', 'name': 'volume-5caa0a52-4ebf-4fd8-88d5-c49590e9ff3a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a3ae2f83-91a5-44b2-bda5-7cc4209f01a2', 'enforce_multipath': True} {{(pid=86591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:18:52 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-269fd386-6095-4727-b288-ae84a0e60fad req-8e451144-19a8-4838-88f0-e5f6ed98c45b tempest-TestMinimumBasicScenario-1871786 None] attachment_update completed successfully. Sep 23 00:19:02 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1bb7944-be29-48ac-9bb5-6b496b260b6a tempest-VolumesDeleteCascade-1274973268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:19:02 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c1bb7944-be29-48ac-9bb5-6b496b260b6a tempest-VolumesDeleteCascade-1274973268 None] Flow 'volume_create_manager' (965841be-cd67-4736-acd3-6c73206db87b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:02 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c1bb7944-be29-48ac-9bb5-6b496b260b6a tempest-VolumesDeleteCascade-1274973268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cefe811-7601-4e7d-b356-5e84157b3073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:02 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c1bb7944-be29-48ac-9bb5-6b496b260b6a tempest-VolumesDeleteCascade-1274973268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cefe811-7601-4e7d-b356-5e84157b3073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1181831304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0ad1d74-7658-48bb-8358-8b136df72929,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa89d289058f4736b7ce60571bbda4c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:03Z,use_quota=True,user_id='e0ae37fadf4848eca0beb30703f98b83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:02 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c1bb7944-be29-48ac-9bb5-6b496b260b6a tempest-VolumesDeleteCascade-1274973268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65ad02f2-875f-46cb-afd1-eb7ecaafac8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:02 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c1bb7944-be29-48ac-9bb5-6b496b260b6a tempest-VolumesDeleteCascade-1274973268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65ad02f2-875f-46cb-afd1-eb7ecaafac8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:02 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c1bb7944-be29-48ac-9bb5-6b496b260b6a tempest-VolumesDeleteCascade-1274973268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fad03bb-8ba8-4a95-9aa7-ce44cb0ac52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:02 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c1bb7944-be29-48ac-9bb5-6b496b260b6a tempest-VolumesDeleteCascade-1274973268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fad03bb-8ba8-4a95-9aa7-ce44cb0ac52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0ad1d74-7658-48bb-8358-8b136df72929', 'volume_name': 'volume-f0ad1d74-7658-48bb-8358-8b136df72929', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:02 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c1bb7944-be29-48ac-9bb5-6b496b260b6a tempest-VolumesDeleteCascade-1274973268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6643909-4bb4-41c3-ba3e-546d504d94ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:02 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c1bb7944-be29-48ac-9bb5-6b496b260b6a tempest-VolumesDeleteCascade-1274973268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6643909-4bb4-41c3-ba3e-546d504d94ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:02 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c1bb7944-be29-48ac-9bb5-6b496b260b6a tempest-VolumesDeleteCascade-1274973268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (185ee513-887a-44ef-96b0-bad72a9597dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:02 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-c1bb7944-be29-48ac-9bb5-6b496b260b6a tempest-VolumesDeleteCascade-1274973268 None] Volume f0ad1d74-7658-48bb-8358-8b136df72929: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0ad1d74-7658-48bb-8358-8b136df72929', 'volume_size': 1} Sep 23 00:19:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c1bb7944-be29-48ac-9bb5-6b496b260b6a tempest-VolumesDeleteCascade-1274973268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c1bb7944-be29-48ac-9bb5-6b496b260b6a tempest-VolumesDeleteCascade-1274973268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:02 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c1bb7944-be29-48ac-9bb5-6b496b260b6a tempest-VolumesDeleteCascade-1274973268 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1181831304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0ad1d74-7658-48bb-8358-8b136df72929,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa89d289058f4736b7ce60571bbda4c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:03Z,use_quota=True,user_id='e0ae37fadf4848eca0beb30703f98b83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:19:02 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-c1bb7944-be29-48ac-9bb5-6b496b260b6a tempest-VolumesDeleteCascade-1274973268 None] Creating volume f0ad1d74-7658-48bb-8358-8b136df72929 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:19:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c1bb7944-be29-48ac-9bb5-6b496b260b6a tempest-VolumesDeleteCascade-1274973268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c1bb7944-be29-48ac-9bb5-6b496b260b6a tempest-VolumesDeleteCascade-1274973268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:02 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c1bb7944-be29-48ac-9bb5-6b496b260b6a tempest-VolumesDeleteCascade-1274973268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:02 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c1bb7944-be29-48ac-9bb5-6b496b260b6a tempest-VolumesDeleteCascade-1274973268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c1bb7944-be29-48ac-9bb5-6b496b260b6a tempest-VolumesDeleteCascade-1274973268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:02 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c1bb7944-be29-48ac-9bb5-6b496b260b6a tempest-VolumesDeleteCascade-1274973268 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:19:02 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-c1bb7944-be29-48ac-9bb5-6b496b260b6a tempest-VolumesDeleteCascade-1274973268 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:19:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1bb7944-be29-48ac-9bb5-6b496b260b6a tempest-VolumesDeleteCascade-1274973268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:02 devstack sudo[96530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929 1073741824 Sep 23 00:19:02 devstack sudo[96530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:03 devstack sudo[96530]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1bb7944-be29-48ac-9bb5-6b496b260b6a tempest-VolumesDeleteCascade-1274973268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929 1073741824" returned: 0 in 0.807s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1bb7944-be29-48ac-9bb5-6b496b260b6a tempest-VolumesDeleteCascade-1274973268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:03 devstack sudo[96536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929 Sep 23 00:19:03 devstack sudo[96536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:04 devstack sudo[96536]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1bb7944-be29-48ac-9bb5-6b496b260b6a tempest-VolumesDeleteCascade-1274973268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929" returned: 0 in 0.422s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:04 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c1bb7944-be29-48ac-9bb5-6b496b260b6a tempest-VolumesDeleteCascade-1274973268 None] <== create_volume: return (1303ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:19:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c1bb7944-be29-48ac-9bb5-6b496b260b6a tempest-VolumesDeleteCascade-1274973268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.307s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c1bb7944-be29-48ac-9bb5-6b496b260b6a tempest-VolumesDeleteCascade-1274973268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (185ee513-887a-44ef-96b0-bad72a9597dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0ad1d74-7658-48bb-8358-8b136df72929', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c1bb7944-be29-48ac-9bb5-6b496b260b6a tempest-VolumesDeleteCascade-1274973268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e16969cb-85ca-4c35-9c3f-31aa0bf5301f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:04 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7183798-c54f-451d-b09d-2b19d9d8ebc4 tempest-VolumesTestJSON-1613984727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:19:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c7183798-c54f-451d-b09d-2b19d9d8ebc4 tempest-VolumesTestJSON-1613984727 None] Flow 'volume_create_manager' (4153f368-4b0d-474e-92f9-5f31617c0337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c7183798-c54f-451d-b09d-2b19d9d8ebc4 tempest-VolumesTestJSON-1613984727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27ba0f0e-f931-43c3-943a-8e951d8fe521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:04 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-c1bb7944-be29-48ac-9bb5-6b496b260b6a tempest-VolumesDeleteCascade-1274973268 None] Volume volume-f0ad1d74-7658-48bb-8358-8b136df72929 (f0ad1d74-7658-48bb-8358-8b136df72929): created successfully Sep 23 00:19:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c1bb7944-be29-48ac-9bb5-6b496b260b6a tempest-VolumesDeleteCascade-1274973268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e16969cb-85ca-4c35-9c3f-31aa0bf5301f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c1bb7944-be29-48ac-9bb5-6b496b260b6a tempest-VolumesDeleteCascade-1274973268 None] Flow 'volume_create_manager' (965841be-cd67-4736-acd3-6c73206db87b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c7183798-c54f-451d-b09d-2b19d9d8ebc4 tempest-VolumesTestJSON-1613984727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27ba0f0e-f931-43c3-943a-8e951d8fe521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-828404011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec4dc235-3940-4660-a2a8-9dfbbffd638f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cbcbf92ac9d94c618c15cf55b2f8610b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:04Z,use_quota=True,user_id='da437aaac92f4241bcb07630bde0493b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c7183798-c54f-451d-b09d-2b19d9d8ebc4 tempest-VolumesTestJSON-1613984727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0e53354-72f0-4b52-9a53-94ce90f4af0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c7183798-c54f-451d-b09d-2b19d9d8ebc4 tempest-VolumesTestJSON-1613984727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0e53354-72f0-4b52-9a53-94ce90f4af0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c7183798-c54f-451d-b09d-2b19d9d8ebc4 tempest-VolumesTestJSON-1613984727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f492548-a016-4b1a-902f-9207594c9a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c7183798-c54f-451d-b09d-2b19d9d8ebc4 tempest-VolumesTestJSON-1613984727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f492548-a016-4b1a-902f-9207594c9a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec4dc235-3940-4660-a2a8-9dfbbffd638f', 'volume_name': 'volume-ec4dc235-3940-4660-a2a8-9dfbbffd638f', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c7183798-c54f-451d-b09d-2b19d9d8ebc4 tempest-VolumesTestJSON-1613984727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cc1c2f2-de8b-4053-92ac-154611ef61ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c7183798-c54f-451d-b09d-2b19d9d8ebc4 tempest-VolumesTestJSON-1613984727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cc1c2f2-de8b-4053-92ac-154611ef61ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c7183798-c54f-451d-b09d-2b19d9d8ebc4 tempest-VolumesTestJSON-1613984727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9269f546-faf6-40a9-a45a-d07e74a4026d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:04 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-c7183798-c54f-451d-b09d-2b19d9d8ebc4 tempest-VolumesTestJSON-1613984727 None] Volume ec4dc235-3940-4660-a2a8-9dfbbffd638f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec4dc235-3940-4660-a2a8-9dfbbffd638f', 'volume_size': 1} Sep 23 00:19:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c7183798-c54f-451d-b09d-2b19d9d8ebc4 tempest-VolumesTestJSON-1613984727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c7183798-c54f-451d-b09d-2b19d9d8ebc4 tempest-VolumesTestJSON-1613984727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:04 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c7183798-c54f-451d-b09d-2b19d9d8ebc4 tempest-VolumesTestJSON-1613984727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-828404011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec4dc235-3940-4660-a2a8-9dfbbffd638f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cbcbf92ac9d94c618c15cf55b2f8610b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:04Z,use_quota=True,user_id='da437aaac92f4241bcb07630bde0493b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:19:04 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-c7183798-c54f-451d-b09d-2b19d9d8ebc4 tempest-VolumesTestJSON-1613984727 None] Creating volume ec4dc235-3940-4660-a2a8-9dfbbffd638f {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:19:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c7183798-c54f-451d-b09d-2b19d9d8ebc4 tempest-VolumesTestJSON-1613984727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c7183798-c54f-451d-b09d-2b19d9d8ebc4 tempest-VolumesTestJSON-1613984727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:04 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c7183798-c54f-451d-b09d-2b19d9d8ebc4 tempest-VolumesTestJSON-1613984727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:04 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c7183798-c54f-451d-b09d-2b19d9d8ebc4 tempest-VolumesTestJSON-1613984727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c7183798-c54f-451d-b09d-2b19d9d8ebc4 tempest-VolumesTestJSON-1613984727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:04 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c7183798-c54f-451d-b09d-2b19d9d8ebc4 tempest-VolumesTestJSON-1613984727 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:19:04 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-c7183798-c54f-451d-b09d-2b19d9d8ebc4 tempest-VolumesTestJSON-1613984727 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:19:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c7183798-c54f-451d-b09d-2b19d9d8ebc4 tempest-VolumesTestJSON-1613984727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ec4dc235-3940-4660-a2a8-9dfbbffd638f 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:04 devstack sudo[96539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ec4dc235-3940-4660-a2a8-9dfbbffd638f 1073741824 Sep 23 00:19:04 devstack sudo[96539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:04 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-c1bb7944-be29-48ac-9bb5-6b496b260b6a tempest-VolumesDeleteCascade-1274973268 None] Created volume successfully. Sep 23 00:19:05 devstack sudo[96539]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c7183798-c54f-451d-b09d-2b19d9d8ebc4 tempest-VolumesTestJSON-1613984727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ec4dc235-3940-4660-a2a8-9dfbbffd638f 1073741824" returned: 0 in 0.790s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c1a6cd9d-a72b-4bab-a9ca-7822ea138677 tempest-VolumesDeleteCascade-1274973268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c7183798-c54f-451d-b09d-2b19d9d8ebc4 tempest-VolumesTestJSON-1613984727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ec4dc235-3940-4660-a2a8-9dfbbffd638f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:05 devstack sudo[96580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ec4dc235-3940-4660-a2a8-9dfbbffd638f Sep 23 00:19:05 devstack sudo[96580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:05 devstack sudo[96580]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c7183798-c54f-451d-b09d-2b19d9d8ebc4 tempest-VolumesTestJSON-1613984727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ec4dc235-3940-4660-a2a8-9dfbbffd638f" returned: 0 in 0.339s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:05 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c7183798-c54f-451d-b09d-2b19d9d8ebc4 tempest-VolumesTestJSON-1613984727 None] <== create_volume: return (1201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:19:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c7183798-c54f-451d-b09d-2b19d9d8ebc4 tempest-VolumesTestJSON-1613984727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.204s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c1a6cd9d-a72b-4bab-a9ca-7822ea138677 tempest-VolumesDeleteCascade-1274973268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.363s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:05 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-c1a6cd9d-a72b-4bab-a9ca-7822ea138677 tempest-VolumesDeleteCascade-1274973268 None] Creating offline snapshot 4c2e8ef6-a62e-47a3-b93f-6e2c17b7f19f of volume f0ad1d74-7658-48bb-8358-8b136df72929 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:19:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c7183798-c54f-451d-b09d-2b19d9d8ebc4 tempest-VolumesTestJSON-1613984727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9269f546-faf6-40a9-a45a-d07e74a4026d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec4dc235-3940-4660-a2a8-9dfbbffd638f', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c7183798-c54f-451d-b09d-2b19d9d8ebc4 tempest-VolumesTestJSON-1613984727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0925d86-fe2b-441c-b59a-5b70182cc625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:05 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc032305-26cf-442d-9445-6c2f95c978ac]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1a6cd9d-a72b-4bab-a9ca-7822ea138677 tempest-VolumesDeleteCascade-1274973268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:05 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-c7183798-c54f-451d-b09d-2b19d9d8ebc4 tempest-VolumesTestJSON-1613984727 None] Volume volume-ec4dc235-3940-4660-a2a8-9dfbbffd638f (ec4dc235-3940-4660-a2a8-9dfbbffd638f): created successfully Sep 23 00:19:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c7183798-c54f-451d-b09d-2b19d9d8ebc4 tempest-VolumesTestJSON-1613984727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0925d86-fe2b-441c-b59a-5b70182cc625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c7183798-c54f-451d-b09d-2b19d9d8ebc4 tempest-VolumesTestJSON-1613984727 None] Flow 'volume_create_manager' (4153f368-4b0d-474e-92f9-5f31617c0337) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:05 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-c7183798-c54f-451d-b09d-2b19d9d8ebc4 tempest-VolumesTestJSON-1613984727 None] Created volume successfully. Sep 23 00:19:05 devstack sudo[96584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929 Sep 23 00:19:05 devstack sudo[96584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:06 devstack sudo[96584]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1a6cd9d-a72b-4bab-a9ca-7822ea138677 tempest-VolumesDeleteCascade-1274973268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929" returned: 0 in 0.544s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1a6cd9d-a72b-4bab-a9ca-7822ea138677 tempest-VolumesDeleteCascade-1274973268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929.4c2e8ef6-a62e-47a3-b93f-6e2c17b7f19f 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:06 devstack sudo[96589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929.4c2e8ef6-a62e-47a3-b93f-6e2c17b7f19f 1G Sep 23 00:19:06 devstack sudo[96589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:06 devstack sudo[96589]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1a6cd9d-a72b-4bab-a9ca-7822ea138677 tempest-VolumesDeleteCascade-1274973268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929.4c2e8ef6-a62e-47a3-b93f-6e2c17b7f19f 1G" returned: 0 in 0.696s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1a6cd9d-a72b-4bab-a9ca-7822ea138677 tempest-VolumesDeleteCascade-1274973268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0ad1d74-7658-48bb-8358-8b136df72929 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929.4c2e8ef6-a62e-47a3-b93f-6e2c17b7f19f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:06 devstack sudo[96597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0ad1d74-7658-48bb-8358-8b136df72929 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929.4c2e8ef6-a62e-47a3-b93f-6e2c17b7f19f Sep 23 00:19:06 devstack sudo[96597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:07 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-28ecbadb-54ec-4c1a-b1d7-d6df35bbfa1b tempest-VolumesTestJSON-1613984727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:19:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-28ecbadb-54ec-4c1a-b1d7-d6df35bbfa1b tempest-VolumesTestJSON-1613984727 None] Flow 'volume_create_manager' (e3b8f5e8-7021-4781-9f29-a56758463176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-28ecbadb-54ec-4c1a-b1d7-d6df35bbfa1b tempest-VolumesTestJSON-1613984727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aceb28b8-4d4b-4df0-89cf-26cafbef8a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:07 devstack sudo[96597]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1a6cd9d-a72b-4bab-a9ca-7822ea138677 tempest-VolumesDeleteCascade-1274973268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0ad1d74-7658-48bb-8358-8b136df72929 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929.4c2e8ef6-a62e-47a3-b93f-6e2c17b7f19f" returned: 0 in 0.710s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:07 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-c1a6cd9d-a72b-4bab-a9ca-7822ea138677 tempest-VolumesDeleteCascade-1274973268 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929.4c2e8ef6-a62e-47a3-b93f-6e2c17b7f19f is being set with open permissions: ugo+rw Sep 23 00:19:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1a6cd9d-a72b-4bab-a9ca-7822ea138677 tempest-VolumesDeleteCascade-1274973268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929.4c2e8ef6-a62e-47a3-b93f-6e2c17b7f19f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-28ecbadb-54ec-4c1a-b1d7-d6df35bbfa1b tempest-VolumesTestJSON-1613984727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aceb28b8-4d4b-4df0-89cf-26cafbef8a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1979106351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6dc7550-84aa-425c-a6f6-53808850b330,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cbcbf92ac9d94c618c15cf55b2f8610b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:07Z,use_quota=True,user_id='da437aaac92f4241bcb07630bde0493b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:07 devstack sudo[96602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929.4c2e8ef6-a62e-47a3-b93f-6e2c17b7f19f Sep 23 00:19:07 devstack sudo[96602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-28ecbadb-54ec-4c1a-b1d7-d6df35bbfa1b tempest-VolumesTestJSON-1613984727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97a281ea-3e17-41e3-b74a-d3d01e951426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-28ecbadb-54ec-4c1a-b1d7-d6df35bbfa1b tempest-VolumesTestJSON-1613984727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97a281ea-3e17-41e3-b74a-d3d01e951426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-28ecbadb-54ec-4c1a-b1d7-d6df35bbfa1b tempest-VolumesTestJSON-1613984727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35316959-d9a4-4036-8285-3f0c5382c961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-28ecbadb-54ec-4c1a-b1d7-d6df35bbfa1b tempest-VolumesTestJSON-1613984727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35316959-d9a4-4036-8285-3f0c5382c961) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6dc7550-84aa-425c-a6f6-53808850b330', 'volume_name': 'volume-d6dc7550-84aa-425c-a6f6-53808850b330', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-28ecbadb-54ec-4c1a-b1d7-d6df35bbfa1b tempest-VolumesTestJSON-1613984727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef95e1cd-113a-48de-b71a-50458eb9c8d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-28ecbadb-54ec-4c1a-b1d7-d6df35bbfa1b tempest-VolumesTestJSON-1613984727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef95e1cd-113a-48de-b71a-50458eb9c8d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-28ecbadb-54ec-4c1a-b1d7-d6df35bbfa1b tempest-VolumesTestJSON-1613984727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80a471f2-2f06-4ac0-bc58-1b67b14a0298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:07 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-28ecbadb-54ec-4c1a-b1d7-d6df35bbfa1b tempest-VolumesTestJSON-1613984727 None] Volume d6dc7550-84aa-425c-a6f6-53808850b330: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6dc7550-84aa-425c-a6f6-53808850b330', 'volume_size': 1} Sep 23 00:19:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-28ecbadb-54ec-4c1a-b1d7-d6df35bbfa1b tempest-VolumesTestJSON-1613984727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:07 devstack sudo[96602]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1a6cd9d-a72b-4bab-a9ca-7822ea138677 tempest-VolumesDeleteCascade-1274973268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929.4c2e8ef6-a62e-47a3-b93f-6e2c17b7f19f" returned: 0 in 0.364s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1a6cd9d-a72b-4bab-a9ca-7822ea138677 tempest-VolumesDeleteCascade-1274973268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:07 devstack sudo[96605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929.info Sep 23 00:19:07 devstack sudo[96605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:08 devstack sudo[96605]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1a6cd9d-a72b-4bab-a9ca-7822ea138677 tempest-VolumesDeleteCascade-1274973268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929.info" returned: 0 in 0.323s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:08 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-c1a6cd9d-a72b-4bab-a9ca-7822ea138677 tempest-VolumesDeleteCascade-1274973268 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929.info is being set with open permissions: ugo+rw Sep 23 00:19:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1a6cd9d-a72b-4bab-a9ca-7822ea138677 tempest-VolumesDeleteCascade-1274973268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:08 devstack sudo[96608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929.info Sep 23 00:19:08 devstack sudo[96608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:08 devstack sudo[96608]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1a6cd9d-a72b-4bab-a9ca-7822ea138677 tempest-VolumesDeleteCascade-1274973268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929.info" returned: 0 in 0.285s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c1a6cd9d-a72b-4bab-a9ca-7822ea138677 tempest-VolumesDeleteCascade-1274973268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.072s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-28ecbadb-54ec-4c1a-b1d7-d6df35bbfa1b tempest-VolumesTestJSON-1613984727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.970s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:08 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-28ecbadb-54ec-4c1a-b1d7-d6df35bbfa1b tempest-VolumesTestJSON-1613984727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1979106351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6dc7550-84aa-425c-a6f6-53808850b330,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cbcbf92ac9d94c618c15cf55b2f8610b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:07Z,use_quota=True,user_id='da437aaac92f4241bcb07630bde0493b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:19:08 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-28ecbadb-54ec-4c1a-b1d7-d6df35bbfa1b tempest-VolumesTestJSON-1613984727 None] Creating volume d6dc7550-84aa-425c-a6f6-53808850b330 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:19:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-28ecbadb-54ec-4c1a-b1d7-d6df35bbfa1b tempest-VolumesTestJSON-1613984727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-28ecbadb-54ec-4c1a-b1d7-d6df35bbfa1b tempest-VolumesTestJSON-1613984727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:08 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-28ecbadb-54ec-4c1a-b1d7-d6df35bbfa1b tempest-VolumesTestJSON-1613984727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:08 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-28ecbadb-54ec-4c1a-b1d7-d6df35bbfa1b tempest-VolumesTestJSON-1613984727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-28ecbadb-54ec-4c1a-b1d7-d6df35bbfa1b tempest-VolumesTestJSON-1613984727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:08 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-28ecbadb-54ec-4c1a-b1d7-d6df35bbfa1b tempest-VolumesTestJSON-1613984727 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:19:08 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-28ecbadb-54ec-4c1a-b1d7-d6df35bbfa1b tempest-VolumesTestJSON-1613984727 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:19:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-28ecbadb-54ec-4c1a-b1d7-d6df35bbfa1b tempest-VolumesTestJSON-1613984727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d6dc7550-84aa-425c-a6f6-53808850b330 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:08 devstack sudo[96611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d6dc7550-84aa-425c-a6f6-53808850b330 1073741824 Sep 23 00:19:08 devstack sudo[96611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:08 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-c1a6cd9d-a72b-4bab-a9ca-7822ea138677 tempest-VolumesDeleteCascade-1274973268 None] Create snapshot completed successfully Sep 23 00:19:09 devstack sudo[96611]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-28ecbadb-54ec-4c1a-b1d7-d6df35bbfa1b tempest-VolumesTestJSON-1613984727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d6dc7550-84aa-425c-a6f6-53808850b330 1073741824" returned: 0 in 0.572s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-28ecbadb-54ec-4c1a-b1d7-d6df35bbfa1b tempest-VolumesTestJSON-1613984727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d6dc7550-84aa-425c-a6f6-53808850b330 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:09 devstack sudo[96616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d6dc7550-84aa-425c-a6f6-53808850b330 Sep 23 00:19:09 devstack sudo[96616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:09 devstack sudo[96616]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-28ecbadb-54ec-4c1a-b1d7-d6df35bbfa1b tempest-VolumesTestJSON-1613984727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d6dc7550-84aa-425c-a6f6-53808850b330" returned: 0 in 0.374s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:09 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-28ecbadb-54ec-4c1a-b1d7-d6df35bbfa1b tempest-VolumesTestJSON-1613984727 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:19:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-28ecbadb-54ec-4c1a-b1d7-d6df35bbfa1b tempest-VolumesTestJSON-1613984727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-28ecbadb-54ec-4c1a-b1d7-d6df35bbfa1b tempest-VolumesTestJSON-1613984727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80a471f2-2f06-4ac0-bc58-1b67b14a0298) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6dc7550-84aa-425c-a6f6-53808850b330', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-28ecbadb-54ec-4c1a-b1d7-d6df35bbfa1b tempest-VolumesTestJSON-1613984727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dd01d09-cd78-4cb9-b89b-cd449693c0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:09 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-28ecbadb-54ec-4c1a-b1d7-d6df35bbfa1b tempest-VolumesTestJSON-1613984727 None] Volume volume-d6dc7550-84aa-425c-a6f6-53808850b330 (d6dc7550-84aa-425c-a6f6-53808850b330): created successfully Sep 23 00:19:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-28ecbadb-54ec-4c1a-b1d7-d6df35bbfa1b tempest-VolumesTestJSON-1613984727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dd01d09-cd78-4cb9-b89b-cd449693c0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-28ecbadb-54ec-4c1a-b1d7-d6df35bbfa1b tempest-VolumesTestJSON-1613984727 None] Flow 'volume_create_manager' (e3b8f5e8-7021-4781-9f29-a56758463176) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-170a958e-76de-4e2b-964f-e56fe47809ce tempest-VolumesDeleteCascade-1274973268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-170a958e-76de-4e2b-964f-e56fe47809ce tempest-VolumesDeleteCascade-1274973268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:09 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-28ecbadb-54ec-4c1a-b1d7-d6df35bbfa1b tempest-VolumesTestJSON-1613984727 None] Created volume successfully. Sep 23 00:19:09 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-170a958e-76de-4e2b-964f-e56fe47809ce tempest-VolumesDeleteCascade-1274973268 None] Creating offline snapshot dbc57827-10ca-4776-846b-09c85d0bf809 of volume f0ad1d74-7658-48bb-8358-8b136df72929 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:19:09 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be03635-697b-495e-b783-145590ac16e9]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-170a958e-76de-4e2b-964f-e56fe47809ce tempest-VolumesDeleteCascade-1274973268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929.4c2e8ef6-a62e-47a3-b93f-6e2c17b7f19f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:09 devstack sudo[96625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929.4c2e8ef6-a62e-47a3-b93f-6e2c17b7f19f Sep 23 00:19:09 devstack sudo[96625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:10 devstack sudo[96625]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-170a958e-76de-4e2b-964f-e56fe47809ce tempest-VolumesDeleteCascade-1274973268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929.4c2e8ef6-a62e-47a3-b93f-6e2c17b7f19f" returned: 0 in 0.657s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:10 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-170a958e-76de-4e2b-964f-e56fe47809ce tempest-VolumesDeleteCascade-1274973268 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0ad1d74-7658-48bb-8358-8b136df72929(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:19:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-170a958e-76de-4e2b-964f-e56fe47809ce tempest-VolumesDeleteCascade-1274973268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929.4c2e8ef6-a62e-47a3-b93f-6e2c17b7f19f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929.dbc57827-10ca-4776-846b-09c85d0bf809 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:10 devstack sudo[96633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929.4c2e8ef6-a62e-47a3-b93f-6e2c17b7f19f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929.dbc57827-10ca-4776-846b-09c85d0bf809 1G Sep 23 00:19:10 devstack sudo[96633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:11 devstack sudo[96633]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-170a958e-76de-4e2b-964f-e56fe47809ce tempest-VolumesDeleteCascade-1274973268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929.4c2e8ef6-a62e-47a3-b93f-6e2c17b7f19f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929.dbc57827-10ca-4776-846b-09c85d0bf809 1G" returned: 0 in 0.857s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-170a958e-76de-4e2b-964f-e56fe47809ce tempest-VolumesDeleteCascade-1274973268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0ad1d74-7658-48bb-8358-8b136df72929.4c2e8ef6-a62e-47a3-b93f-6e2c17b7f19f -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929.dbc57827-10ca-4776-846b-09c85d0bf809 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:11 devstack sudo[96640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0ad1d74-7658-48bb-8358-8b136df72929.4c2e8ef6-a62e-47a3-b93f-6e2c17b7f19f -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929.dbc57827-10ca-4776-846b-09c85d0bf809 Sep 23 00:19:11 devstack sudo[96640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:11 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e897354-fd20-4edd-ad5d-d038458afb85 tempest-VolumesTestJSON-1613984727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:19:11 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6e897354-fd20-4edd-ad5d-d038458afb85 tempest-VolumesTestJSON-1613984727 None] Flow 'volume_create_manager' (4ace290a-67c0-49af-b5f5-7674fc03d384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:11 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6e897354-fd20-4edd-ad5d-d038458afb85 tempest-VolumesTestJSON-1613984727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9f10da2-2a7b-4476-84de-b3e08a690708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:11 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6e897354-fd20-4edd-ad5d-d038458afb85 tempest-VolumesTestJSON-1613984727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9f10da2-2a7b-4476-84de-b3e08a690708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-243452048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce715b66-b838-46cb-aae6-0ee4b7d0a6c1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cbcbf92ac9d94c618c15cf55b2f8610b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:11Z,use_quota=True,user_id='da437aaac92f4241bcb07630bde0493b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:11 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6e897354-fd20-4edd-ad5d-d038458afb85 tempest-VolumesTestJSON-1613984727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dad27464-6cda-44fa-8ece-727ff9744ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:11 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6e897354-fd20-4edd-ad5d-d038458afb85 tempest-VolumesTestJSON-1613984727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dad27464-6cda-44fa-8ece-727ff9744ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:11 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6e897354-fd20-4edd-ad5d-d038458afb85 tempest-VolumesTestJSON-1613984727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (effd3246-fe1e-460f-91ad-8ef601cb9d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:11 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6e897354-fd20-4edd-ad5d-d038458afb85 tempest-VolumesTestJSON-1613984727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (effd3246-fe1e-460f-91ad-8ef601cb9d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce715b66-b838-46cb-aae6-0ee4b7d0a6c1', 'volume_name': 'volume-ce715b66-b838-46cb-aae6-0ee4b7d0a6c1', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:11 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6e897354-fd20-4edd-ad5d-d038458afb85 tempest-VolumesTestJSON-1613984727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a682892b-976b-4358-bf9f-744d83b8a16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:11 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6e897354-fd20-4edd-ad5d-d038458afb85 tempest-VolumesTestJSON-1613984727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a682892b-976b-4358-bf9f-744d83b8a16b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:11 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6e897354-fd20-4edd-ad5d-d038458afb85 tempest-VolumesTestJSON-1613984727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (219219db-0b1f-4bf0-a827-dddf463dcc25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:11 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-6e897354-fd20-4edd-ad5d-d038458afb85 tempest-VolumesTestJSON-1613984727 None] Volume ce715b66-b838-46cb-aae6-0ee4b7d0a6c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce715b66-b838-46cb-aae6-0ee4b7d0a6c1', 'volume_size': 1} Sep 23 00:19:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6e897354-fd20-4edd-ad5d-d038458afb85 tempest-VolumesTestJSON-1613984727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:11 devstack sudo[96640]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-170a958e-76de-4e2b-964f-e56fe47809ce tempest-VolumesDeleteCascade-1274973268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0ad1d74-7658-48bb-8358-8b136df72929.4c2e8ef6-a62e-47a3-b93f-6e2c17b7f19f -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929.dbc57827-10ca-4776-846b-09c85d0bf809" returned: 0 in 0.495s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:11 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-170a958e-76de-4e2b-964f-e56fe47809ce tempest-VolumesDeleteCascade-1274973268 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929.dbc57827-10ca-4776-846b-09c85d0bf809 is being set with open permissions: ugo+rw Sep 23 00:19:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-170a958e-76de-4e2b-964f-e56fe47809ce tempest-VolumesDeleteCascade-1274973268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929.dbc57827-10ca-4776-846b-09c85d0bf809 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:11 devstack sudo[96646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929.dbc57827-10ca-4776-846b-09c85d0bf809 Sep 23 00:19:11 devstack sudo[96646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:12 devstack sudo[96646]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-170a958e-76de-4e2b-964f-e56fe47809ce tempest-VolumesDeleteCascade-1274973268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929.dbc57827-10ca-4776-846b-09c85d0bf809" returned: 0 in 0.322s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-170a958e-76de-4e2b-964f-e56fe47809ce tempest-VolumesDeleteCascade-1274973268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.470s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6e897354-fd20-4edd-ad5d-d038458afb85 tempest-VolumesTestJSON-1613984727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.651s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:12 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6e897354-fd20-4edd-ad5d-d038458afb85 tempest-VolumesTestJSON-1613984727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-243452048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce715b66-b838-46cb-aae6-0ee4b7d0a6c1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cbcbf92ac9d94c618c15cf55b2f8610b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:11Z,use_quota=True,user_id='da437aaac92f4241bcb07630bde0493b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:19:12 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-6e897354-fd20-4edd-ad5d-d038458afb85 tempest-VolumesTestJSON-1613984727 None] Creating volume ce715b66-b838-46cb-aae6-0ee4b7d0a6c1 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:19:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6e897354-fd20-4edd-ad5d-d038458afb85 tempest-VolumesTestJSON-1613984727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6e897354-fd20-4edd-ad5d-d038458afb85 tempest-VolumesTestJSON-1613984727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:12 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6e897354-fd20-4edd-ad5d-d038458afb85 tempest-VolumesTestJSON-1613984727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:12 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6e897354-fd20-4edd-ad5d-d038458afb85 tempest-VolumesTestJSON-1613984727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6e897354-fd20-4edd-ad5d-d038458afb85 tempest-VolumesTestJSON-1613984727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:12 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6e897354-fd20-4edd-ad5d-d038458afb85 tempest-VolumesTestJSON-1613984727 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:19:12 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-6e897354-fd20-4edd-ad5d-d038458afb85 tempest-VolumesTestJSON-1613984727 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:19:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6e897354-fd20-4edd-ad5d-d038458afb85 tempest-VolumesTestJSON-1613984727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ce715b66-b838-46cb-aae6-0ee4b7d0a6c1 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:12 devstack sudo[96649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ce715b66-b838-46cb-aae6-0ee4b7d0a6c1 1073741824 Sep 23 00:19:12 devstack sudo[96649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:12 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-170a958e-76de-4e2b-964f-e56fe47809ce tempest-VolumesDeleteCascade-1274973268 None] Create snapshot completed successfully Sep 23 00:19:12 devstack sudo[96649]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6e897354-fd20-4edd-ad5d-d038458afb85 tempest-VolumesTestJSON-1613984727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ce715b66-b838-46cb-aae6-0ee4b7d0a6c1 1073741824" returned: 0 in 0.607s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6e897354-fd20-4edd-ad5d-d038458afb85 tempest-VolumesTestJSON-1613984727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ce715b66-b838-46cb-aae6-0ee4b7d0a6c1 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:12 devstack sudo[96655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ce715b66-b838-46cb-aae6-0ee4b7d0a6c1 Sep 23 00:19:12 devstack sudo[96655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:12 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] Acquiring lock "cinder-f0ad1d74-7658-48bb-8358-8b136df72929-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:13 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] Lock "cinder-f0ad1d74-7658-48bb-8358-8b136df72929-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:13 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] Performing cascade delete. {{(pid=86591) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 23 00:19:13 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] Acquiring lock "cinder-4c2e8ef6-a62e-47a3-b93f-6e2c17b7f19f-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:13 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] Lock "cinder-4c2e8ef6-a62e-47a3-b93f-6e2c17b7f19f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:13 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] Acquiring lock "cinder-quobyte-f0ad1d74-7658-48bb-8358-8b136df72929" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:13 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] Lock "cinder-quobyte-f0ad1d74-7658-48bb-8358-8b136df72929" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:13 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] Acquiring lock "cinder-quobyte-4c2e8ef6-a62e-47a3-b93f-6e2c17b7f19f" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:13 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] Lock "cinder-quobyte-4c2e8ef6-a62e-47a3-b93f-6e2c17b7f19f" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:13 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] Deleting offline snapshot 4c2e8ef6-a62e-47a3-b93f-6e2c17b7f19f of volume f0ad1d74-7658-48bb-8358-8b136df72929 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:19:13 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] snapshot_file for this snap is: volume-f0ad1d74-7658-48bb-8358-8b136df72929.4c2e8ef6-a62e-47a3-b93f-6e2c17b7f19f {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:19:13 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c9a521-0e9d-46f0-b973-f6eee65931fd]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929.4c2e8ef6-a62e-47a3-b93f-6e2c17b7f19f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:13 devstack sudo[96655]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6e897354-fd20-4edd-ad5d-d038458afb85 tempest-VolumesTestJSON-1613984727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ce715b66-b838-46cb-aae6-0ee4b7d0a6c1" returned: 0 in 0.446s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:13 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6e897354-fd20-4edd-ad5d-d038458afb85 tempest-VolumesTestJSON-1613984727 None] <== create_volume: return (1199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:19:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6e897354-fd20-4edd-ad5d-d038458afb85 tempest-VolumesTestJSON-1613984727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.203s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:13 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6e897354-fd20-4edd-ad5d-d038458afb85 tempest-VolumesTestJSON-1613984727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (219219db-0b1f-4bf0-a827-dddf463dcc25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce715b66-b838-46cb-aae6-0ee4b7d0a6c1', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:13 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6e897354-fd20-4edd-ad5d-d038458afb85 tempest-VolumesTestJSON-1613984727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8022acb-60e7-40bd-838b-5d02c1e81fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:13 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-6e897354-fd20-4edd-ad5d-d038458afb85 tempest-VolumesTestJSON-1613984727 None] Volume volume-ce715b66-b838-46cb-aae6-0ee4b7d0a6c1 (ce715b66-b838-46cb-aae6-0ee4b7d0a6c1): created successfully Sep 23 00:19:13 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6e897354-fd20-4edd-ad5d-d038458afb85 tempest-VolumesTestJSON-1613984727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8022acb-60e7-40bd-838b-5d02c1e81fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:13 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6e897354-fd20-4edd-ad5d-d038458afb85 tempest-VolumesTestJSON-1613984727 None] Flow 'volume_create_manager' (4ace290a-67c0-49af-b5f5-7674fc03d384) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:13 devstack sudo[96682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929.4c2e8ef6-a62e-47a3-b93f-6e2c17b7f19f Sep 23 00:19:13 devstack sudo[96682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:13 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-6e897354-fd20-4edd-ad5d-d038458afb85 tempest-VolumesTestJSON-1613984727 None] Created volume successfully. Sep 23 00:19:13 devstack sudo[96682]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929.4c2e8ef6-a62e-47a3-b93f-6e2c17b7f19f" returned: 0 in 0.537s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:13 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0ad1d74-7658-48bb-8358-8b136df72929(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:19:13 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[305c6e03-e8c4-46f5-8a74-a031fa0de78a]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:13 devstack sudo[96688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929 Sep 23 00:19:13 devstack sudo[96688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:14 devstack sudo[96688]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929" returned: 0 in 0.466s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:14 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3616d12-1eff-483b-b141-f7c441508052]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929.dbc57827-10ca-4776-846b-09c85d0bf809 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:14 devstack sudo[96697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929.dbc57827-10ca-4776-846b-09c85d0bf809 Sep 23 00:19:14 devstack sudo[96697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:14 devstack sudo[96697]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929.dbc57827-10ca-4776-846b-09c85d0bf809" returned: 0 in 0.576s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:14 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0ad1d74-7658-48bb-8358-8b136df72929(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:19:14 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[910fab2e-4a9c-4310-8628-c26be47188de]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929.4c2e8ef6-a62e-47a3-b93f-6e2c17b7f19f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:15 devstack sudo[96718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929.4c2e8ef6-a62e-47a3-b93f-6e2c17b7f19f Sep 23 00:19:15 devstack sudo[96718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:15 devstack sudo[96718]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929.4c2e8ef6-a62e-47a3-b93f-6e2c17b7f19f" returned: 0 in 0.584s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:15 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0ad1d74-7658-48bb-8358-8b136df72929(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:19:15 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd07d4bd-e9a3-4375-9174-48b0568369c2]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-75e5747e-3754-4f5a-ad55-db9fab7e1cfc tempest-VolumesTestJSON-1613984727 None] Acquiring lock "cinder-ce715b66-b838-46cb-aae6-0ee4b7d0a6c1-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-75e5747e-3754-4f5a-ad55-db9fab7e1cfc tempest-VolumesTestJSON-1613984727 None] Lock "cinder-ce715b66-b838-46cb-aae6-0ee4b7d0a6c1-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:15 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=56,cinder:UPDATE=68,cinder:INSERT=20,cinder:DELETE=13 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:19:15 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=66,cinder:UPDATE=64,cinder:INSERT=19,cinder:DELETE=2 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:19:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-75e5747e-3754-4f5a-ad55-db9fab7e1cfc tempest-VolumesTestJSON-1613984727 None] Acquiring lock "cinder-quobyte-ce715b66-b838-46cb-aae6-0ee4b7d0a6c1" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-75e5747e-3754-4f5a-ad55-db9fab7e1cfc tempest-VolumesTestJSON-1613984727 None] Lock "cinder-quobyte-ce715b66-b838-46cb-aae6-0ee4b7d0a6c1" acquired by "delete_volume" :: waited 0.031s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:15 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27230f8-2312-4ff1-8a7a-78a0a5c30be4]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-75e5747e-3754-4f5a-ad55-db9fab7e1cfc tempest-VolumesTestJSON-1613984727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ce715b66-b838-46cb-aae6-0ee4b7d0a6c1 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:15 devstack sudo[96729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929 Sep 23 00:19:15 devstack sudo[96729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:15 devstack sudo[96730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ce715b66-b838-46cb-aae6-0ee4b7d0a6c1 Sep 23 00:19:15 devstack sudo[96730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:16 devstack sudo[96729]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929" returned: 0 in 0.670s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929.4c2e8ef6-a62e-47a3-b93f-6e2c17b7f19f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:16 devstack sudo[96739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929.4c2e8ef6-a62e-47a3-b93f-6e2c17b7f19f Sep 23 00:19:16 devstack sudo[96739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:16 devstack sudo[96730]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-75e5747e-3754-4f5a-ad55-db9fab7e1cfc tempest-VolumesTestJSON-1613984727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ce715b66-b838-46cb-aae6-0ee4b7d0a6c1" returned: 0 in 0.585s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-75e5747e-3754-4f5a-ad55-db9fab7e1cfc tempest-VolumesTestJSON-1613984727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ce715b66-b838-46cb-aae6-0ee4b7d0a6c1 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:16 devstack sudo[96746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ce715b66-b838-46cb-aae6-0ee4b7d0a6c1 Sep 23 00:19:16 devstack sudo[96746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:16 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:19:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:16 devstack sudo[96752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:19:16 devstack sudo[96752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:16 devstack sudo[96739]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929.4c2e8ef6-a62e-47a3-b93f-6e2c17b7f19f" returned: 0 in 0.571s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929.4c2e8ef6-a62e-47a3-b93f-6e2c17b7f19f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:16 devstack sudo[96746]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-75e5747e-3754-4f5a-ad55-db9fab7e1cfc tempest-VolumesTestJSON-1613984727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ce715b66-b838-46cb-aae6-0ee4b7d0a6c1" returned: 0 in 0.443s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:16 devstack sudo[96756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929.4c2e8ef6-a62e-47a3-b93f-6e2c17b7f19f Sep 23 00:19:16 devstack sudo[96756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:16 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-75e5747e-3754-4f5a-ad55-db9fab7e1cfc tempest-VolumesTestJSON-1613984727 None] Lock "cinder-quobyte-ce715b66-b838-46cb-aae6-0ee4b7d0a6c1" released by "delete_volume" :: held 1.107s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:16 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-75e5747e-3754-4f5a-ad55-db9fab7e1cfc tempest-VolumesTestJSON-1613984727 None] Created reservations ['9054164b-2a30-44ef-894c-d98ab6e32036', 'e9cf8d30-a5e1-4f9a-9de7-6c922bed8329', 'ec95db33-4f07-49e0-921b-cfe057734c7f', '5539ab76-27b9-4395-93ce-60d9aad8822c'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:19:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-75e5747e-3754-4f5a-ad55-db9fab7e1cfc tempest-VolumesTestJSON-1613984727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-75e5747e-3754-4f5a-ad55-db9fab7e1cfc tempest-VolumesTestJSON-1613984727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:17 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-75e5747e-3754-4f5a-ad55-db9fab7e1cfc tempest-VolumesTestJSON-1613984727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:17 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-75e5747e-3754-4f5a-ad55-db9fab7e1cfc tempest-VolumesTestJSON-1613984727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-75e5747e-3754-4f5a-ad55-db9fab7e1cfc tempest-VolumesTestJSON-1613984727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-75e5747e-3754-4f5a-ad55-db9fab7e1cfc tempest-VolumesTestJSON-1613984727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:17 devstack sudo[96758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:19:17 devstack sudo[96758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:17 devstack sudo[96752]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.596s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:17 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:19:17 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running periodic task VolumeManager._thread_info {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:19:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] thread count: 29 {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:19:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] thread info: [<_MainThread(MainThread, started 135440660459648)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:19:17 devstack sudo[96756]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929.4c2e8ef6-a62e-47a3-b93f-6e2c17b7f19f" returned: 0 in 0.592s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0ad1d74-7658-48bb-8358-8b136df72929 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929.dbc57827-10ca-4776-846b-09c85d0bf809 -F qcow2 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:17 devstack sudo[96763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0ad1d74-7658-48bb-8358-8b136df72929 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929.dbc57827-10ca-4776-846b-09c85d0bf809 -F qcow2 Sep 23 00:19:17 devstack sudo[96763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:17 devstack sudo[96758]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-75e5747e-3754-4f5a-ad55-db9fab7e1cfc tempest-VolumesTestJSON-1613984727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.581s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:17 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-75e5747e-3754-4f5a-ad55-db9fab7e1cfc tempest-VolumesTestJSON-1613984727 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:19:17 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-75e5747e-3754-4f5a-ad55-db9fab7e1cfc tempest-VolumesTestJSON-1613984727 None] Deleted volume successfully. Sep 23 00:19:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-75e5747e-3754-4f5a-ad55-db9fab7e1cfc tempest-VolumesTestJSON-1613984727 None] Lock "cinder-ce715b66-b838-46cb-aae6-0ee4b7d0a6c1-delete_volume" released by "delete_volume" :: held 2.067s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f28e0d81-9ddc-489c-8911-c2eccdce7f34 tempest-VolumesTestJSON-1613984727 None] Acquiring lock "cinder-d6dc7550-84aa-425c-a6f6-53808850b330-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f28e0d81-9ddc-489c-8911-c2eccdce7f34 tempest-VolumesTestJSON-1613984727 None] Lock "cinder-d6dc7550-84aa-425c-a6f6-53808850b330-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f28e0d81-9ddc-489c-8911-c2eccdce7f34 tempest-VolumesTestJSON-1613984727 None] Acquiring lock "cinder-quobyte-d6dc7550-84aa-425c-a6f6-53808850b330" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f28e0d81-9ddc-489c-8911-c2eccdce7f34 tempest-VolumesTestJSON-1613984727 None] Lock "cinder-quobyte-d6dc7550-84aa-425c-a6f6-53808850b330" acquired by "delete_volume" :: waited 0.021s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:18 devstack sudo[96763]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0ad1d74-7658-48bb-8358-8b136df72929 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929.dbc57827-10ca-4776-846b-09c85d0bf809 -F qcow2" returned: 0 in 0.686s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:18 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5718dc-92a6-449c-8dc7-774b025a8e7c]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f28e0d81-9ddc-489c-8911-c2eccdce7f34 tempest-VolumesTestJSON-1613984727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d6dc7550-84aa-425c-a6f6-53808850b330 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] Lock "cinder-quobyte-4c2e8ef6-a62e-47a3-b93f-6e2c17b7f19f" released by "_delete_snapshot" :: held 4.976s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] Lock "cinder-quobyte-f0ad1d74-7658-48bb-8358-8b136df72929" released by "delete_snapshot" :: held 5.011s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:18 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] Created reservations ['34c595ec-c0e7-4028-9bc1-8bdad3d104bd', '03c778b0-1d05-47b7-a29b-ac8bc68d7fe3', '2fd552ab-32c3-4399-81c3-8d3a5d8a3299', '9d82ce06-7173-435a-885c-c5f479c3930b'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:19:18 devstack sudo[96769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d6dc7550-84aa-425c-a6f6-53808850b330 Sep 23 00:19:18 devstack sudo[96769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:18 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] Delete snapshot completed successfully. Sep 23 00:19:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] Lock "cinder-4c2e8ef6-a62e-47a3-b93f-6e2c17b7f19f-delete_snapshot" released by "delete_snapshot" :: held 5.263s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] Acquiring lock "cinder-dbc57827-10ca-4776-846b-09c85d0bf809-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] Lock "cinder-dbc57827-10ca-4776-846b-09c85d0bf809-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] Acquiring lock "cinder-quobyte-f0ad1d74-7658-48bb-8358-8b136df72929" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] Lock "cinder-quobyte-f0ad1d74-7658-48bb-8358-8b136df72929" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] Acquiring lock "cinder-quobyte-dbc57827-10ca-4776-846b-09c85d0bf809" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] Lock "cinder-quobyte-dbc57827-10ca-4776-846b-09c85d0bf809" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:18 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] Deleting offline snapshot dbc57827-10ca-4776-846b-09c85d0bf809 of volume f0ad1d74-7658-48bb-8358-8b136df72929 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:19:18 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] snapshot_file for this snap is: volume-f0ad1d74-7658-48bb-8358-8b136df72929.dbc57827-10ca-4776-846b-09c85d0bf809 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:19:18 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9db98c8-6e3b-4829-a0ad-8946fb4e3460]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929.dbc57827-10ca-4776-846b-09c85d0bf809 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:18 devstack sudo[96771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929.dbc57827-10ca-4776-846b-09c85d0bf809 Sep 23 00:19:18 devstack sudo[96769]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:18 devstack sudo[96771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f28e0d81-9ddc-489c-8911-c2eccdce7f34 tempest-VolumesTestJSON-1613984727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d6dc7550-84aa-425c-a6f6-53808850b330" returned: 0 in 0.623s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f28e0d81-9ddc-489c-8911-c2eccdce7f34 tempest-VolumesTestJSON-1613984727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d6dc7550-84aa-425c-a6f6-53808850b330 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:18 devstack sudo[96776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d6dc7550-84aa-425c-a6f6-53808850b330 Sep 23 00:19:18 devstack sudo[96776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:19 devstack sudo[96771]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929.dbc57827-10ca-4776-846b-09c85d0bf809" returned: 0 in 0.655s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:19 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0ad1d74-7658-48bb-8358-8b136df72929(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:19:19 devstack sudo[96776]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f28e0d81-9ddc-489c-8911-c2eccdce7f34 tempest-VolumesTestJSON-1613984727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d6dc7550-84aa-425c-a6f6-53808850b330" returned: 0 in 0.481s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:19 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a098afec-e1fd-4c71-a09b-359d531df5aa]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f28e0d81-9ddc-489c-8911-c2eccdce7f34 tempest-VolumesTestJSON-1613984727 None] Lock "cinder-quobyte-d6dc7550-84aa-425c-a6f6-53808850b330" released by "delete_volume" :: held 1.208s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:19 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-f28e0d81-9ddc-489c-8911-c2eccdce7f34 tempest-VolumesTestJSON-1613984727 None] Created reservations ['b8f6d15b-b5ab-491b-9108-7b67a05f6778', '1452498f-1337-4f8c-a166-f4f4760e8420', '848cc061-7a5e-4a76-b065-13ec7e3cc91f', '8b40727d-5597-4754-b015-c24926821c81'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:19:19 devstack sudo[96783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929 Sep 23 00:19:19 devstack sudo[96783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f28e0d81-9ddc-489c-8911-c2eccdce7f34 tempest-VolumesTestJSON-1613984727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f28e0d81-9ddc-489c-8911-c2eccdce7f34 tempest-VolumesTestJSON-1613984727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:19 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f28e0d81-9ddc-489c-8911-c2eccdce7f34 tempest-VolumesTestJSON-1613984727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:19 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f28e0d81-9ddc-489c-8911-c2eccdce7f34 tempest-VolumesTestJSON-1613984727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f28e0d81-9ddc-489c-8911-c2eccdce7f34 tempest-VolumesTestJSON-1613984727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f28e0d81-9ddc-489c-8911-c2eccdce7f34 tempest-VolumesTestJSON-1613984727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:19 devstack sudo[96785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:19:19 devstack sudo[96785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:19 devstack sudo[96785]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f28e0d81-9ddc-489c-8911-c2eccdce7f34 tempest-VolumesTestJSON-1613984727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.352s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:19 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-f28e0d81-9ddc-489c-8911-c2eccdce7f34 tempest-VolumesTestJSON-1613984727 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:19:19 devstack sudo[96783]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929" returned: 0 in 0.576s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929.dbc57827-10ca-4776-846b-09c85d0bf809 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:19 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-f28e0d81-9ddc-489c-8911-c2eccdce7f34 tempest-VolumesTestJSON-1613984727 None] Deleted volume successfully. Sep 23 00:19:19 devstack sudo[96791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929.dbc57827-10ca-4776-846b-09c85d0bf809 Sep 23 00:19:19 devstack sudo[96791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f28e0d81-9ddc-489c-8911-c2eccdce7f34 tempest-VolumesTestJSON-1613984727 None] Lock "cinder-d6dc7550-84aa-425c-a6f6-53808850b330-delete_volume" released by "delete_volume" :: held 1.915s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:20 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-355a28c2-de71-4cde-91fc-17761cfac630 tempest-VolumesTestJSON-1613984727 None] Acquiring lock "cinder-ec4dc235-3940-4660-a2a8-9dfbbffd638f-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:20 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-355a28c2-de71-4cde-91fc-17761cfac630 tempest-VolumesTestJSON-1613984727 None] Lock "cinder-ec4dc235-3940-4660-a2a8-9dfbbffd638f-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:20 devstack sudo[96791]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929.dbc57827-10ca-4776-846b-09c85d0bf809" returned: 0 in 0.608s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929.dbc57827-10ca-4776-846b-09c85d0bf809 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:20 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-355a28c2-de71-4cde-91fc-17761cfac630 tempest-VolumesTestJSON-1613984727 None] Acquiring lock "cinder-quobyte-ec4dc235-3940-4660-a2a8-9dfbbffd638f" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:20 devstack sudo[96801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929.dbc57827-10ca-4776-846b-09c85d0bf809 Sep 23 00:19:20 devstack sudo[96801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:20 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-355a28c2-de71-4cde-91fc-17761cfac630 tempest-VolumesTestJSON-1613984727 None] Lock "cinder-quobyte-ec4dc235-3940-4660-a2a8-9dfbbffd638f" acquired by "delete_volume" :: waited 0.025s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:20 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ddf37c-a574-4922-8dc6-04c9e70330c1]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-355a28c2-de71-4cde-91fc-17761cfac630 tempest-VolumesTestJSON-1613984727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ec4dc235-3940-4660-a2a8-9dfbbffd638f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:20 devstack sudo[96803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ec4dc235-3940-4660-a2a8-9dfbbffd638f Sep 23 00:19:20 devstack sudo[96803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:20 devstack sudo[96801]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929.dbc57827-10ca-4776-846b-09c85d0bf809" returned: 0 in 0.335s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:20 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] Lock "cinder-quobyte-dbc57827-10ca-4776-846b-09c85d0bf809" released by "_delete_snapshot" :: held 2.372s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:20 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] Lock "cinder-quobyte-f0ad1d74-7658-48bb-8358-8b136df72929" released by "delete_snapshot" :: held 2.404s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:20 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] Created reservations ['d4817814-353a-4760-9bdb-5a131a6f1ca6', 'ac1c6e43-d9b2-4fea-b24f-61d52f267127', '0570b0de-a831-458f-a850-1ffd8f630ce3', '00118858-ce24-4d2c-bcea-662c24fc287d'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:19:21 devstack sudo[96803]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-355a28c2-de71-4cde-91fc-17761cfac630 tempest-VolumesTestJSON-1613984727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ec4dc235-3940-4660-a2a8-9dfbbffd638f" returned: 0 in 0.480s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-355a28c2-de71-4cde-91fc-17761cfac630 tempest-VolumesTestJSON-1613984727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ec4dc235-3940-4660-a2a8-9dfbbffd638f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:21 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] Delete snapshot completed successfully. Sep 23 00:19:21 devstack sudo[96809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ec4dc235-3940-4660-a2a8-9dfbbffd638f Sep 23 00:19:21 devstack sudo[96809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:21 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] Lock "cinder-dbc57827-10ca-4776-846b-09c85d0bf809-delete_snapshot" released by "delete_snapshot" :: held 2.700s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] Snapshots deleted, issuing volume delete {{(pid=86591) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 23 00:19:21 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] Acquiring lock "cinder-quobyte-f0ad1d74-7658-48bb-8358-8b136df72929" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:21 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] Lock "cinder-quobyte-f0ad1d74-7658-48bb-8358-8b136df72929" acquired by "delete_volume" :: waited 0.031s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:21 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc55cb3e-1e63-42fc-a7ce-57ece180dbcb]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:21 devstack sudo[96811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929 Sep 23 00:19:21 devstack sudo[96811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:21 devstack sudo[96809]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-355a28c2-de71-4cde-91fc-17761cfac630 tempest-VolumesTestJSON-1613984727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ec4dc235-3940-4660-a2a8-9dfbbffd638f" returned: 0 in 0.368s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:21 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-355a28c2-de71-4cde-91fc-17761cfac630 tempest-VolumesTestJSON-1613984727 None] Lock "cinder-quobyte-ec4dc235-3940-4660-a2a8-9dfbbffd638f" released by "delete_volume" :: held 0.909s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:21 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-355a28c2-de71-4cde-91fc-17761cfac630 tempest-VolumesTestJSON-1613984727 None] Created reservations ['9dcd046d-b207-44cd-8fa5-21345000ba73', '39b3eb7c-12ec-4ac3-8e1d-de80f01aefd6', 'b84ca869-6e8e-40da-98f9-0c2e6b578e5e', '11f0a116-a350-42bf-96b2-5a12dddbf541'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:19:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-355a28c2-de71-4cde-91fc-17761cfac630 tempest-VolumesTestJSON-1613984727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-355a28c2-de71-4cde-91fc-17761cfac630 tempest-VolumesTestJSON-1613984727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:21 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-355a28c2-de71-4cde-91fc-17761cfac630 tempest-VolumesTestJSON-1613984727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:21 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-355a28c2-de71-4cde-91fc-17761cfac630 tempest-VolumesTestJSON-1613984727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-355a28c2-de71-4cde-91fc-17761cfac630 tempest-VolumesTestJSON-1613984727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-355a28c2-de71-4cde-91fc-17761cfac630 tempest-VolumesTestJSON-1613984727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:21 devstack sudo[96815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:19:21 devstack sudo[96815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:21 devstack sudo[96811]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929" returned: 0 in 0.595s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:21 devstack sudo[96819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929 Sep 23 00:19:21 devstack sudo[96819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:22 devstack sudo[96815]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-355a28c2-de71-4cde-91fc-17761cfac630 tempest-VolumesTestJSON-1613984727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.367s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:22 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-355a28c2-de71-4cde-91fc-17761cfac630 tempest-VolumesTestJSON-1613984727 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:19:22 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-355a28c2-de71-4cde-91fc-17761cfac630 tempest-VolumesTestJSON-1613984727 None] Deleted volume successfully. Sep 23 00:19:22 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-355a28c2-de71-4cde-91fc-17761cfac630 tempest-VolumesTestJSON-1613984727 None] Lock "cinder-ec4dc235-3940-4660-a2a8-9dfbbffd638f-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:22 devstack sudo[96819]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0ad1d74-7658-48bb-8358-8b136df72929" returned: 0 in 0.350s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:22 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] Lock "cinder-quobyte-f0ad1d74-7658-48bb-8358-8b136df72929" released by "delete_volume" :: held 1.026s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:22 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] Created reservations ['7d373b29-1833-44ae-88c1-759c33419019', 'f4231007-cde6-4efc-981a-26837784f3c0', '1d7ab67e-25da-4b66-8762-2d688f6c8ce5', '0712590f-8293-4440-b927-f90f07d5c216'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:19:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:22 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:22 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:22 devstack sudo[96823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:19:22 devstack sudo[96823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:22 devstack sudo[96823]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.299s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:22 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:19:22 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] Deleted volume successfully. Sep 23 00:19:22 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a90a774c-b070-404c-b1c4-412e650cdc35 tempest-VolumesDeleteCascade-1274973268 None] Lock "cinder-f0ad1d74-7658-48bb-8358-8b136df72929-delete_volume" released by "delete_volume" :: held 9.664s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:24 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c6f9def-6c87-4439-b40b-3e910b4d4ae8 tempest-VolumesDeleteCascade-1274973268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:19:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1c6f9def-6c87-4439-b40b-3e910b4d4ae8 tempest-VolumesDeleteCascade-1274973268 None] Flow 'volume_create_manager' (482ebd8e-db49-435c-ad57-325d648738c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1c6f9def-6c87-4439-b40b-3e910b4d4ae8 tempest-VolumesDeleteCascade-1274973268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa07459f-ad52-400d-9c81-5450c8fd9694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1c6f9def-6c87-4439-b40b-3e910b4d4ae8 tempest-VolumesDeleteCascade-1274973268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa07459f-ad52-400d-9c81-5450c8fd9694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-530089743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d112d997-f602-4d6f-84c7-101276d4e971,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa89d289058f4736b7ce60571bbda4c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:24Z,use_quota=True,user_id='e0ae37fadf4848eca0beb30703f98b83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1c6f9def-6c87-4439-b40b-3e910b4d4ae8 tempest-VolumesDeleteCascade-1274973268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d7abd03-54ca-4884-a7c0-d8e5b74999ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1c6f9def-6c87-4439-b40b-3e910b4d4ae8 tempest-VolumesDeleteCascade-1274973268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d7abd03-54ca-4884-a7c0-d8e5b74999ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1c6f9def-6c87-4439-b40b-3e910b4d4ae8 tempest-VolumesDeleteCascade-1274973268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (624df3e0-18d9-4298-bbe7-a931e96dabd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1c6f9def-6c87-4439-b40b-3e910b4d4ae8 tempest-VolumesDeleteCascade-1274973268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (624df3e0-18d9-4298-bbe7-a931e96dabd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd112d997-f602-4d6f-84c7-101276d4e971', 'volume_name': 'volume-d112d997-f602-4d6f-84c7-101276d4e971', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1c6f9def-6c87-4439-b40b-3e910b4d4ae8 tempest-VolumesDeleteCascade-1274973268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80548ef3-24c1-4a61-9516-01964b8fbbe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1c6f9def-6c87-4439-b40b-3e910b4d4ae8 tempest-VolumesDeleteCascade-1274973268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80548ef3-24c1-4a61-9516-01964b8fbbe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1c6f9def-6c87-4439-b40b-3e910b4d4ae8 tempest-VolumesDeleteCascade-1274973268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ea2f704-ddec-4d73-b0bb-fbcce4b42e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:24 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-1c6f9def-6c87-4439-b40b-3e910b4d4ae8 tempest-VolumesDeleteCascade-1274973268 None] Volume d112d997-f602-4d6f-84c7-101276d4e971: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d112d997-f602-4d6f-84c7-101276d4e971', 'volume_size': 1} Sep 23 00:19:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1c6f9def-6c87-4439-b40b-3e910b4d4ae8 tempest-VolumesDeleteCascade-1274973268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1c6f9def-6c87-4439-b40b-3e910b4d4ae8 tempest-VolumesDeleteCascade-1274973268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:24 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1c6f9def-6c87-4439-b40b-3e910b4d4ae8 tempest-VolumesDeleteCascade-1274973268 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-530089743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d112d997-f602-4d6f-84c7-101276d4e971,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa89d289058f4736b7ce60571bbda4c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:24Z,use_quota=True,user_id='e0ae37fadf4848eca0beb30703f98b83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:19:24 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-1c6f9def-6c87-4439-b40b-3e910b4d4ae8 tempest-VolumesDeleteCascade-1274973268 None] Creating volume d112d997-f602-4d6f-84c7-101276d4e971 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:19:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1c6f9def-6c87-4439-b40b-3e910b4d4ae8 tempest-VolumesDeleteCascade-1274973268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1c6f9def-6c87-4439-b40b-3e910b4d4ae8 tempest-VolumesDeleteCascade-1274973268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:24 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1c6f9def-6c87-4439-b40b-3e910b4d4ae8 tempest-VolumesDeleteCascade-1274973268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:24 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1c6f9def-6c87-4439-b40b-3e910b4d4ae8 tempest-VolumesDeleteCascade-1274973268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1c6f9def-6c87-4439-b40b-3e910b4d4ae8 tempest-VolumesDeleteCascade-1274973268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:24 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1c6f9def-6c87-4439-b40b-3e910b4d4ae8 tempest-VolumesDeleteCascade-1274973268 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:19:24 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-1c6f9def-6c87-4439-b40b-3e910b4d4ae8 tempest-VolumesDeleteCascade-1274973268 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:19:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1c6f9def-6c87-4439-b40b-3e910b4d4ae8 tempest-VolumesDeleteCascade-1274973268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d112d997-f602-4d6f-84c7-101276d4e971 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:24 devstack sudo[96826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d112d997-f602-4d6f-84c7-101276d4e971 1073741824 Sep 23 00:19:24 devstack sudo[96826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:25 devstack sudo[96826]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1c6f9def-6c87-4439-b40b-3e910b4d4ae8 tempest-VolumesDeleteCascade-1274973268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d112d997-f602-4d6f-84c7-101276d4e971 1073741824" returned: 0 in 0.730s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1c6f9def-6c87-4439-b40b-3e910b4d4ae8 tempest-VolumesDeleteCascade-1274973268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d112d997-f602-4d6f-84c7-101276d4e971 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:25 devstack sudo[96833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d112d997-f602-4d6f-84c7-101276d4e971 Sep 23 00:19:25 devstack sudo[96833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:25 devstack sudo[96833]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1c6f9def-6c87-4439-b40b-3e910b4d4ae8 tempest-VolumesDeleteCascade-1274973268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d112d997-f602-4d6f-84c7-101276d4e971" returned: 0 in 0.317s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:25 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1c6f9def-6c87-4439-b40b-3e910b4d4ae8 tempest-VolumesDeleteCascade-1274973268 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:19:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1c6f9def-6c87-4439-b40b-3e910b4d4ae8 tempest-VolumesDeleteCascade-1274973268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1c6f9def-6c87-4439-b40b-3e910b4d4ae8 tempest-VolumesDeleteCascade-1274973268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ea2f704-ddec-4d73-b0bb-fbcce4b42e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d112d997-f602-4d6f-84c7-101276d4e971', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1c6f9def-6c87-4439-b40b-3e910b4d4ae8 tempest-VolumesDeleteCascade-1274973268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58972825-fbf8-440d-94bf-a55e22150500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:25 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-1c6f9def-6c87-4439-b40b-3e910b4d4ae8 tempest-VolumesDeleteCascade-1274973268 None] Volume volume-d112d997-f602-4d6f-84c7-101276d4e971 (d112d997-f602-4d6f-84c7-101276d4e971): created successfully Sep 23 00:19:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1c6f9def-6c87-4439-b40b-3e910b4d4ae8 tempest-VolumesDeleteCascade-1274973268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58972825-fbf8-440d-94bf-a55e22150500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1c6f9def-6c87-4439-b40b-3e910b4d4ae8 tempest-VolumesDeleteCascade-1274973268 None] Flow 'volume_create_manager' (482ebd8e-db49-435c-ad57-325d648738c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:25 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-1c6f9def-6c87-4439-b40b-3e910b4d4ae8 tempest-VolumesDeleteCascade-1274973268 None] Created volume successfully. Sep 23 00:19:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-10f17e82-363c-4450-98a3-85f127901629 tempest-VolumesDeleteCascade-1274973268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-10f17e82-363c-4450-98a3-85f127901629 tempest-VolumesDeleteCascade-1274973268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:26 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-10f17e82-363c-4450-98a3-85f127901629 tempest-VolumesDeleteCascade-1274973268 None] Creating offline snapshot a4c7492f-f5a5-4e3c-bc00-1f63afa473b9 of volume d112d997-f602-4d6f-84c7-101276d4e971 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:19:26 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9677ec3-1aa4-455f-a58a-5c45ff7763ec]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-10f17e82-363c-4450-98a3-85f127901629 tempest-VolumesDeleteCascade-1274973268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d112d997-f602-4d6f-84c7-101276d4e971 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:26 devstack sudo[96838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d112d997-f602-4d6f-84c7-101276d4e971 Sep 23 00:19:26 devstack sudo[96838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:27 devstack sudo[96838]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-10f17e82-363c-4450-98a3-85f127901629 tempest-VolumesDeleteCascade-1274973268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d112d997-f602-4d6f-84c7-101276d4e971" returned: 0 in 0.611s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-10f17e82-363c-4450-98a3-85f127901629 tempest-VolumesDeleteCascade-1274973268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d112d997-f602-4d6f-84c7-101276d4e971,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d112d997-f602-4d6f-84c7-101276d4e971.a4c7492f-f5a5-4e3c-bc00-1f63afa473b9 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:27 devstack sudo[96843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d112d997-f602-4d6f-84c7-101276d4e971,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d112d997-f602-4d6f-84c7-101276d4e971.a4c7492f-f5a5-4e3c-bc00-1f63afa473b9 1G Sep 23 00:19:27 devstack sudo[96843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:27 devstack sudo[96843]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-10f17e82-363c-4450-98a3-85f127901629 tempest-VolumesDeleteCascade-1274973268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d112d997-f602-4d6f-84c7-101276d4e971,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d112d997-f602-4d6f-84c7-101276d4e971.a4c7492f-f5a5-4e3c-bc00-1f63afa473b9 1G" returned: 0 in 0.672s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-10f17e82-363c-4450-98a3-85f127901629 tempest-VolumesDeleteCascade-1274973268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d112d997-f602-4d6f-84c7-101276d4e971 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d112d997-f602-4d6f-84c7-101276d4e971.a4c7492f-f5a5-4e3c-bc00-1f63afa473b9 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:28 devstack sudo[96849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d112d997-f602-4d6f-84c7-101276d4e971 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d112d997-f602-4d6f-84c7-101276d4e971.a4c7492f-f5a5-4e3c-bc00-1f63afa473b9 Sep 23 00:19:28 devstack sudo[96849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:28 devstack sudo[96849]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-10f17e82-363c-4450-98a3-85f127901629 tempest-VolumesDeleteCascade-1274973268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d112d997-f602-4d6f-84c7-101276d4e971 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d112d997-f602-4d6f-84c7-101276d4e971.a4c7492f-f5a5-4e3c-bc00-1f63afa473b9" returned: 0 in 0.429s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:28 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-10f17e82-363c-4450-98a3-85f127901629 tempest-VolumesDeleteCascade-1274973268 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d112d997-f602-4d6f-84c7-101276d4e971.a4c7492f-f5a5-4e3c-bc00-1f63afa473b9 is being set with open permissions: ugo+rw Sep 23 00:19:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-10f17e82-363c-4450-98a3-85f127901629 tempest-VolumesDeleteCascade-1274973268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d112d997-f602-4d6f-84c7-101276d4e971.a4c7492f-f5a5-4e3c-bc00-1f63afa473b9 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:28 devstack sudo[96856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d112d997-f602-4d6f-84c7-101276d4e971.a4c7492f-f5a5-4e3c-bc00-1f63afa473b9 Sep 23 00:19:28 devstack sudo[96856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:28 devstack sudo[96856]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-10f17e82-363c-4450-98a3-85f127901629 tempest-VolumesDeleteCascade-1274973268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d112d997-f602-4d6f-84c7-101276d4e971.a4c7492f-f5a5-4e3c-bc00-1f63afa473b9" returned: 0 in 0.423s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-10f17e82-363c-4450-98a3-85f127901629 tempest-VolumesDeleteCascade-1274973268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d112d997-f602-4d6f-84c7-101276d4e971.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:28 devstack sudo[96859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d112d997-f602-4d6f-84c7-101276d4e971.info Sep 23 00:19:28 devstack sudo[96859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:29 devstack sudo[96859]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-10f17e82-363c-4450-98a3-85f127901629 tempest-VolumesDeleteCascade-1274973268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d112d997-f602-4d6f-84c7-101276d4e971.info" returned: 0 in 0.357s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:29 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-10f17e82-363c-4450-98a3-85f127901629 tempest-VolumesDeleteCascade-1274973268 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d112d997-f602-4d6f-84c7-101276d4e971.info is being set with open permissions: ugo+rw Sep 23 00:19:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-10f17e82-363c-4450-98a3-85f127901629 tempest-VolumesDeleteCascade-1274973268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d112d997-f602-4d6f-84c7-101276d4e971.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:29 devstack sudo[96862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d112d997-f602-4d6f-84c7-101276d4e971.info Sep 23 00:19:29 devstack sudo[96862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:29 devstack sudo[96862]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-10f17e82-363c-4450-98a3-85f127901629 tempest-VolumesDeleteCascade-1274973268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d112d997-f602-4d6f-84c7-101276d4e971.info" returned: 0 in 0.336s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-10f17e82-363c-4450-98a3-85f127901629 tempest-VolumesDeleteCascade-1274973268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.962s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:29 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-10f17e82-363c-4450-98a3-85f127901629 tempest-VolumesDeleteCascade-1274973268 None] Create snapshot completed successfully Sep 23 00:19:29 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-54e141be-a1c6-49ae-b703-8fb6976e60ca tempest-GroupSnapshotsV319Test-923687306 None] Group tempest-GroupSnapshotsV319Test-Group-2057926169: creating Sep 23 00:19:29 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-54e141be-a1c6-49ae-b703-8fb6976e60ca tempest-GroupSnapshotsV319Test-923687306 None] Group tempest-GroupSnapshotsV319Test-Group-2057926169: created successfully Sep 23 00:19:29 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-54e141be-a1c6-49ae-b703-8fb6976e60ca tempest-GroupSnapshotsV319Test-923687306 None] Create group completed successfully. Sep 23 00:19:30 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ddb0f63-9485-4152-b909-1839421b3f0e tempest-VolumesDeleteCascade-1274973268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:19:30 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8ddb0f63-9485-4152-b909-1839421b3f0e tempest-VolumesDeleteCascade-1274973268 None] Flow 'volume_create_manager' (9a3156eb-918e-4360-bd26-a04357deb69b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:30 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8ddb0f63-9485-4152-b909-1839421b3f0e tempest-VolumesDeleteCascade-1274973268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdf128cb-b295-4902-8ad9-5115ec36fe12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:30 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8ddb0f63-9485-4152-b909-1839421b3f0e tempest-VolumesDeleteCascade-1274973268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdf128cb-b295-4902-8ad9-5115ec36fe12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1691108603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67a2aae9-83a4-4134-ba98-a8c9fa96cea3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa89d289058f4736b7ce60571bbda4c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a4c7492f-f5a5-4e3c-bc00-1f63afa473b9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:31Z,use_quota=True,user_id='e0ae37fadf4848eca0beb30703f98b83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:30 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8ddb0f63-9485-4152-b909-1839421b3f0e tempest-VolumesDeleteCascade-1274973268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3af63afc-873d-4900-91d0-201b872ccb25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:30 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8ddb0f63-9485-4152-b909-1839421b3f0e tempest-VolumesDeleteCascade-1274973268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3af63afc-873d-4900-91d0-201b872ccb25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:30 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8ddb0f63-9485-4152-b909-1839421b3f0e tempest-VolumesDeleteCascade-1274973268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f172266-8161-4e55-afa3-e6ede1b396fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:30 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8ddb0f63-9485-4152-b909-1839421b3f0e tempest-VolumesDeleteCascade-1274973268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f172266-8161-4e55-afa3-e6ede1b396fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '67a2aae9-83a4-4134-ba98-a8c9fa96cea3', 'volume_name': 'volume-67a2aae9-83a4-4134-ba98-a8c9fa96cea3', 'volume_size': 1, 'snapshot_id': 'a4c7492f-f5a5-4e3c-bc00-1f63afa473b9'}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:30 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8ddb0f63-9485-4152-b909-1839421b3f0e tempest-VolumesDeleteCascade-1274973268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6788775d-45b0-4c55-a4a4-8a2481791bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:30 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8ddb0f63-9485-4152-b909-1839421b3f0e tempest-VolumesDeleteCascade-1274973268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6788775d-45b0-4c55-a4a4-8a2481791bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:30 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8ddb0f63-9485-4152-b909-1839421b3f0e tempest-VolumesDeleteCascade-1274973268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8be39932-44c3-4748-ae9e-0d2968f7ef3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:30 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-8ddb0f63-9485-4152-b909-1839421b3f0e tempest-VolumesDeleteCascade-1274973268 None] Volume 67a2aae9-83a4-4134-ba98-a8c9fa96cea3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-67a2aae9-83a4-4134-ba98-a8c9fa96cea3', 'volume_size': 1, 'snapshot_id': 'a4c7492f-f5a5-4e3c-bc00-1f63afa473b9'} Sep 23 00:19:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8ddb0f63-9485-4152-b909-1839421b3f0e tempest-VolumesDeleteCascade-1274973268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8ddb0f63-9485-4152-b909-1839421b3f0e tempest-VolumesDeleteCascade-1274973268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:30 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8ddb0f63-9485-4152-b909-1839421b3f0e tempest-VolumesDeleteCascade-1274973268 None] Acquiring lock "cinder-quobyte-a4c7492f-f5a5-4e3c-bc00-1f63afa473b9-67a2aae9-83a4-4134-ba98-a8c9fa96cea3" by "_create_volume_from_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:30 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8ddb0f63-9485-4152-b909-1839421b3f0e tempest-VolumesDeleteCascade-1274973268 None] Lock "cinder-quobyte-a4c7492f-f5a5-4e3c-bc00-1f63afa473b9-67a2aae9-83a4-4134-ba98-a8c9fa96cea3" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:30 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-8ddb0f63-9485-4152-b909-1839421b3f0e tempest-VolumesDeleteCascade-1274973268 None] Creating volume 67a2aae9-83a4-4134-ba98-a8c9fa96cea3 from snapshot a4c7492f-f5a5-4e3c-bc00-1f63afa473b9 {{(pid=86591) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 00:19:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8ddb0f63-9485-4152-b909-1839421b3f0e tempest-VolumesDeleteCascade-1274973268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8ddb0f63-9485-4152-b909-1839421b3f0e tempest-VolumesDeleteCascade-1274973268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:30 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-8ddb0f63-9485-4152-b909-1839421b3f0e tempest-VolumesDeleteCascade-1274973268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:30 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-8ddb0f63-9485-4152-b909-1839421b3f0e tempest-VolumesDeleteCascade-1274973268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8ddb0f63-9485-4152-b909-1839421b3f0e tempest-VolumesDeleteCascade-1274973268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:30 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-8ddb0f63-9485-4152-b909-1839421b3f0e tempest-VolumesDeleteCascade-1274973268 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:19:30 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8ddb0f63-9485-4152-b909-1839421b3f0e tempest-VolumesDeleteCascade-1274973268 None] Acquiring lock "cinder-quobyte-67a2aae9-83a4-4134-ba98-a8c9fa96cea3" by "_copy_volume_from_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:30 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8ddb0f63-9485-4152-b909-1839421b3f0e tempest-VolumesDeleteCascade-1274973268 None] Lock "cinder-quobyte-67a2aae9-83a4-4134-ba98-a8c9fa96cea3" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:30 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-8ddb0f63-9485-4152-b909-1839421b3f0e tempest-VolumesDeleteCascade-1274973268 None] snapshot: a4c7492f-f5a5-4e3c-bc00-1f63afa473b9, volume: 67a2aae9-83a4-4134-ba98-a8c9fa96cea3, {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:19:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8ddb0f63-9485-4152-b909-1839421b3f0e tempest-VolumesDeleteCascade-1274973268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8ddb0f63-9485-4152-b909-1839421b3f0e tempest-VolumesDeleteCascade-1274973268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:30 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-8ddb0f63-9485-4152-b909-1839421b3f0e tempest-VolumesDeleteCascade-1274973268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:30 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-8ddb0f63-9485-4152-b909-1839421b3f0e tempest-VolumesDeleteCascade-1274973268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8ddb0f63-9485-4152-b909-1839421b3f0e tempest-VolumesDeleteCascade-1274973268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:30 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9778d8-960b-4f9f-b3c8-f9eb4d195b2d]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8ddb0f63-9485-4152-b909-1839421b3f0e tempest-VolumesDeleteCascade-1274973268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d112d997-f602-4d6f-84c7-101276d4e971.a4c7492f-f5a5-4e3c-bc00-1f63afa473b9 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:31 devstack sudo[96870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d112d997-f602-4d6f-84c7-101276d4e971.a4c7492f-f5a5-4e3c-bc00-1f63afa473b9 Sep 23 00:19:31 devstack sudo[96870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:31 devstack sudo[96870]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8ddb0f63-9485-4152-b909-1839421b3f0e tempest-VolumesDeleteCascade-1274973268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d112d997-f602-4d6f-84c7-101276d4e971.a4c7492f-f5a5-4e3c-bc00-1f63afa473b9" returned: 0 in 0.613s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:31 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-8ddb0f63-9485-4152-b909-1839421b3f0e tempest-VolumesDeleteCascade-1274973268 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d112d997-f602-4d6f-84c7-101276d4e971(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:19:31 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b40f12-0da0-4eb4-b53b-a24175587c49]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8ddb0f63-9485-4152-b909-1839421b3f0e tempest-VolumesDeleteCascade-1274973268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d112d997-f602-4d6f-84c7-101276d4e971 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:31 devstack sudo[96875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d112d997-f602-4d6f-84c7-101276d4e971 Sep 23 00:19:31 devstack sudo[96875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:31 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4638452-6091-461a-8722-ae7ff479a041 tempest-GroupSnapshotsV319Test-923687306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:19:31 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a4638452-6091-461a-8722-ae7ff479a041 tempest-GroupSnapshotsV319Test-923687306 None] Flow 'volume_create_manager' (c55c0167-8f27-4814-a185-ffb91bd88759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:31 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a4638452-6091-461a-8722-ae7ff479a041 tempest-GroupSnapshotsV319Test-923687306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b543613-b4de-4f3f-b007-a8d6db4e5e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:31 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a4638452-6091-461a-8722-ae7ff479a041 tempest-GroupSnapshotsV319Test-923687306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b543613-b4de-4f3f-b007-a8d6db4e5e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-826732258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8f9a0849-b70a-49e0-ae50-8444d7920e65,host='devstack@QuobyteHD#QuobyteHD',id=60e05b67-9429-4861-9f11-e91b3fbbaf55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2abef5ebe654f989d43f3b2172fc6f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:32Z,use_quota=True,user_id='d14a6539784b46ba9e500dd0ea610589',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(257d4643-10bd-4f9a-8db1-76904d73292d),volume_type_id=257d4643-10bd-4f9a-8db1-76904d73292d)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:31 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a4638452-6091-461a-8722-ae7ff479a041 tempest-GroupSnapshotsV319Test-923687306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99a39f58-d789-498b-9b23-09445ce1b893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:31 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a4638452-6091-461a-8722-ae7ff479a041 tempest-GroupSnapshotsV319Test-923687306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99a39f58-d789-498b-9b23-09445ce1b893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:31 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a4638452-6091-461a-8722-ae7ff479a041 tempest-GroupSnapshotsV319Test-923687306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03884e48-cbdd-4f0d-934a-831e3cb8bd52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:31 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a4638452-6091-461a-8722-ae7ff479a041 tempest-GroupSnapshotsV319Test-923687306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03884e48-cbdd-4f0d-934a-831e3cb8bd52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60e05b67-9429-4861-9f11-e91b3fbbaf55', 'volume_name': 'volume-60e05b67-9429-4861-9f11-e91b3fbbaf55', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:31 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a4638452-6091-461a-8722-ae7ff479a041 tempest-GroupSnapshotsV319Test-923687306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e69d46d-2dfc-4013-9e14-5064a8103713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:31 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a4638452-6091-461a-8722-ae7ff479a041 tempest-GroupSnapshotsV319Test-923687306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e69d46d-2dfc-4013-9e14-5064a8103713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:31 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a4638452-6091-461a-8722-ae7ff479a041 tempest-GroupSnapshotsV319Test-923687306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6d1f383-39b7-4df3-af7f-344154afc749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:31 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-a4638452-6091-461a-8722-ae7ff479a041 tempest-GroupSnapshotsV319Test-923687306 None] Volume 60e05b67-9429-4861-9f11-e91b3fbbaf55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60e05b67-9429-4861-9f11-e91b3fbbaf55', 'volume_size': 1} Sep 23 00:19:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a4638452-6091-461a-8722-ae7ff479a041 tempest-GroupSnapshotsV319Test-923687306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:32 devstack sudo[96875]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8ddb0f63-9485-4152-b909-1839421b3f0e tempest-VolumesDeleteCascade-1274973268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d112d997-f602-4d6f-84c7-101276d4e971" returned: 0 in 0.504s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:32 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-8ddb0f63-9485-4152-b909-1839421b3f0e tempest-VolumesDeleteCascade-1274973268 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d112d997-f602-4d6f-84c7-101276d4e971 {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:19:32 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-8ddb0f63-9485-4152-b909-1839421b3f0e tempest-VolumesDeleteCascade-1274973268 None] Creating direct copy from snapshot {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:19:32 devstack cinder-volume[86591]: DEBUG cinder.utils [None req-8ddb0f63-9485-4152-b909-1839421b3f0e tempest-VolumesDeleteCascade-1274973268 None] Path /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-67a2aae9-83a4-4134-ba98-a8c9fa96cea3 not found in is_blk_device check {{(pid=86591) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:19:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8ddb0f63-9485-4152-b909-1839421b3f0e tempest-VolumesDeleteCascade-1274973268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d112d997-f602-4d6f-84c7-101276d4e971 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-67a2aae9-83a4-4134-ba98-a8c9fa96cea3 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:32 devstack sudo[96880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d112d997-f602-4d6f-84c7-101276d4e971 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-67a2aae9-83a4-4134-ba98-a8c9fa96cea3 Sep 23 00:19:32 devstack sudo[96880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:40 devstack sudo[96880]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8ddb0f63-9485-4152-b909-1839421b3f0e tempest-VolumesDeleteCascade-1274973268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d112d997-f602-4d6f-84c7-101276d4e971 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-67a2aae9-83a4-4134-ba98-a8c9fa96cea3" returned: 0 in 7.943s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:40 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-8ddb0f63-9485-4152-b909-1839421b3f0e tempest-VolumesDeleteCascade-1274973268 None] Image conversion details: src /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d112d997-f602-4d6f-84c7-101276d4e971, size 1024.00 MB, duration 7.94 sec, destination /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-67a2aae9-83a4-4134-ba98-a8c9fa96cea3 {{(pid=86591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:19:40 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-8ddb0f63-9485-4152-b909-1839421b3f0e tempest-VolumesDeleteCascade-1274973268 None] Converted 1024.00 MB image at 128.90 MB/s Sep 23 00:19:40 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-8ddb0f63-9485-4152-b909-1839421b3f0e tempest-VolumesDeleteCascade-1274973268 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-67a2aae9-83a4-4134-ba98-a8c9fa96cea3 is being set with open permissions: ugo+rw Sep 23 00:19:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8ddb0f63-9485-4152-b909-1839421b3f0e tempest-VolumesDeleteCascade-1274973268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-67a2aae9-83a4-4134-ba98-a8c9fa96cea3 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:40 devstack sudo[96900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-67a2aae9-83a4-4134-ba98-a8c9fa96cea3 Sep 23 00:19:40 devstack sudo[96900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:40 devstack sudo[96900]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8ddb0f63-9485-4152-b909-1839421b3f0e tempest-VolumesDeleteCascade-1274973268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-67a2aae9-83a4-4134-ba98-a8c9fa96cea3" returned: 0 in 0.263s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:40 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8ddb0f63-9485-4152-b909-1839421b3f0e tempest-VolumesDeleteCascade-1274973268 None] Lock "cinder-quobyte-67a2aae9-83a4-4134-ba98-a8c9fa96cea3" released by "_copy_volume_from_snapshot" :: held 9.452s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:40 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8ddb0f63-9485-4152-b909-1839421b3f0e tempest-VolumesDeleteCascade-1274973268 None] Lock "cinder-quobyte-a4c7492f-f5a5-4e3c-bc00-1f63afa473b9-67a2aae9-83a4-4134-ba98-a8c9fa96cea3" released by "_create_volume_from_snapshot" :: held 9.542s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8ddb0f63-9485-4152-b909-1839421b3f0e tempest-VolumesDeleteCascade-1274973268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.567s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a4638452-6091-461a-8722-ae7ff479a041 tempest-GroupSnapshotsV319Test-923687306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.438s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:40 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a4638452-6091-461a-8722-ae7ff479a041 tempest-GroupSnapshotsV319Test-923687306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8f9a0849-b70a-49e0-ae50-8444d7920e65,created_at=2026-09-22T22:19:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-826732258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8f9a0849-b70a-49e0-ae50-8444d7920e65,host='devstack@QuobyteHD#QuobyteHD',id=60e05b67-9429-4861-9f11-e91b3fbbaf55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2abef5ebe654f989d43f3b2172fc6f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:32Z,use_quota=True,user_id='d14a6539784b46ba9e500dd0ea610589',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(257d4643-10bd-4f9a-8db1-76904d73292d),volume_type_id=257d4643-10bd-4f9a-8db1-76904d73292d)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:19:40 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-a4638452-6091-461a-8722-ae7ff479a041 tempest-GroupSnapshotsV319Test-923687306 None] Creating volume 60e05b67-9429-4861-9f11-e91b3fbbaf55 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:19:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a4638452-6091-461a-8722-ae7ff479a041 tempest-GroupSnapshotsV319Test-923687306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a4638452-6091-461a-8722-ae7ff479a041 tempest-GroupSnapshotsV319Test-923687306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:40 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a4638452-6091-461a-8722-ae7ff479a041 tempest-GroupSnapshotsV319Test-923687306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:40 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a4638452-6091-461a-8722-ae7ff479a041 tempest-GroupSnapshotsV319Test-923687306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a4638452-6091-461a-8722-ae7ff479a041 tempest-GroupSnapshotsV319Test-923687306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:40 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a4638452-6091-461a-8722-ae7ff479a041 tempest-GroupSnapshotsV319Test-923687306 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:19:40 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-a4638452-6091-461a-8722-ae7ff479a041 tempest-GroupSnapshotsV319Test-923687306 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:19:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a4638452-6091-461a-8722-ae7ff479a041 tempest-GroupSnapshotsV319Test-923687306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-60e05b67-9429-4861-9f11-e91b3fbbaf55 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:40 devstack sudo[96903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-60e05b67-9429-4861-9f11-e91b3fbbaf55 1073741824 Sep 23 00:19:40 devstack sudo[96903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8ddb0f63-9485-4152-b909-1839421b3f0e tempest-VolumesDeleteCascade-1274973268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8be39932-44c3-4748-ae9e-0d2968f7ef3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67a2aae9-83a4-4134-ba98-a8c9fa96cea3', 'volume_size': 1, 'snapshot_id': 'a4c7492f-f5a5-4e3c-bc00-1f63afa473b9'}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8ddb0f63-9485-4152-b909-1839421b3f0e tempest-VolumesDeleteCascade-1274973268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1c9ea45-5d91-46d2-816c-225450a1778d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:40 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-8ddb0f63-9485-4152-b909-1839421b3f0e tempest-VolumesDeleteCascade-1274973268 None] Volume volume-67a2aae9-83a4-4134-ba98-a8c9fa96cea3 (67a2aae9-83a4-4134-ba98-a8c9fa96cea3): created successfully Sep 23 00:19:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8ddb0f63-9485-4152-b909-1839421b3f0e tempest-VolumesDeleteCascade-1274973268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1c9ea45-5d91-46d2-816c-225450a1778d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8ddb0f63-9485-4152-b909-1839421b3f0e tempest-VolumesDeleteCascade-1274973268 None] Flow 'volume_create_manager' (9a3156eb-918e-4360-bd26-a04357deb69b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:40 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-8ddb0f63-9485-4152-b909-1839421b3f0e tempest-VolumesDeleteCascade-1274973268 None] Created volume successfully. Sep 23 00:19:40 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f224801b-2722-442d-8afc-4551b26e65e4 tempest-VolumesDeleteCascade-1274973268 None] Acquiring lock "cinder-d112d997-f602-4d6f-84c7-101276d4e971-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:40 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f224801b-2722-442d-8afc-4551b26e65e4 tempest-VolumesDeleteCascade-1274973268 None] Lock "cinder-d112d997-f602-4d6f-84c7-101276d4e971-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f224801b-2722-442d-8afc-4551b26e65e4 tempest-VolumesDeleteCascade-1274973268 None] Performing cascade delete. {{(pid=86591) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 23 00:19:40 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f224801b-2722-442d-8afc-4551b26e65e4 tempest-VolumesDeleteCascade-1274973268 None] Acquiring lock "cinder-a4c7492f-f5a5-4e3c-bc00-1f63afa473b9-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:41 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f224801b-2722-442d-8afc-4551b26e65e4 tempest-VolumesDeleteCascade-1274973268 None] Lock "cinder-a4c7492f-f5a5-4e3c-bc00-1f63afa473b9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:41 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f224801b-2722-442d-8afc-4551b26e65e4 tempest-VolumesDeleteCascade-1274973268 None] Acquiring lock "cinder-quobyte-d112d997-f602-4d6f-84c7-101276d4e971" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:41 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f224801b-2722-442d-8afc-4551b26e65e4 tempest-VolumesDeleteCascade-1274973268 None] Lock "cinder-quobyte-d112d997-f602-4d6f-84c7-101276d4e971" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:41 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f224801b-2722-442d-8afc-4551b26e65e4 tempest-VolumesDeleteCascade-1274973268 None] Acquiring lock "cinder-quobyte-a4c7492f-f5a5-4e3c-bc00-1f63afa473b9" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:41 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f224801b-2722-442d-8afc-4551b26e65e4 tempest-VolumesDeleteCascade-1274973268 None] Lock "cinder-quobyte-a4c7492f-f5a5-4e3c-bc00-1f63afa473b9" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-f224801b-2722-442d-8afc-4551b26e65e4 tempest-VolumesDeleteCascade-1274973268 None] Deleting offline snapshot a4c7492f-f5a5-4e3c-bc00-1f63afa473b9 of volume d112d997-f602-4d6f-84c7-101276d4e971 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:19:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-f224801b-2722-442d-8afc-4551b26e65e4 tempest-VolumesDeleteCascade-1274973268 None] snapshot_file for this snap is: volume-d112d997-f602-4d6f-84c7-101276d4e971.a4c7492f-f5a5-4e3c-bc00-1f63afa473b9 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:19:41 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf2d43a-cedd-4240-9a8e-1823c40d50c3]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f224801b-2722-442d-8afc-4551b26e65e4 tempest-VolumesDeleteCascade-1274973268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d112d997-f602-4d6f-84c7-101276d4e971.a4c7492f-f5a5-4e3c-bc00-1f63afa473b9 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:41 devstack sudo[96903]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a4638452-6091-461a-8722-ae7ff479a041 tempest-GroupSnapshotsV319Test-923687306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-60e05b67-9429-4861-9f11-e91b3fbbaf55 1073741824" returned: 0 in 0.788s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a4638452-6091-461a-8722-ae7ff479a041 tempest-GroupSnapshotsV319Test-923687306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-60e05b67-9429-4861-9f11-e91b3fbbaf55 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:41 devstack sudo[96909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-60e05b67-9429-4861-9f11-e91b3fbbaf55 Sep 23 00:19:41 devstack sudo[96909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:41 devstack sudo[96908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d112d997-f602-4d6f-84c7-101276d4e971.a4c7492f-f5a5-4e3c-bc00-1f63afa473b9 Sep 23 00:19:41 devstack sudo[96908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:41 devstack sudo[96909]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a4638452-6091-461a-8722-ae7ff479a041 tempest-GroupSnapshotsV319Test-923687306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-60e05b67-9429-4861-9f11-e91b3fbbaf55" returned: 0 in 0.304s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a4638452-6091-461a-8722-ae7ff479a041 tempest-GroupSnapshotsV319Test-923687306 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:19:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a4638452-6091-461a-8722-ae7ff479a041 tempest-GroupSnapshotsV319Test-923687306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.151s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a4638452-6091-461a-8722-ae7ff479a041 tempest-GroupSnapshotsV319Test-923687306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6d1f383-39b7-4df3-af7f-344154afc749) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60e05b67-9429-4861-9f11-e91b3fbbaf55', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a4638452-6091-461a-8722-ae7ff479a041 tempest-GroupSnapshotsV319Test-923687306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5983fbf6-dd3c-4d56-807a-0c1698692317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:41 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-a4638452-6091-461a-8722-ae7ff479a041 tempest-GroupSnapshotsV319Test-923687306 None] Volume volume-60e05b67-9429-4861-9f11-e91b3fbbaf55 (60e05b67-9429-4861-9f11-e91b3fbbaf55): created successfully Sep 23 00:19:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a4638452-6091-461a-8722-ae7ff479a041 tempest-GroupSnapshotsV319Test-923687306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5983fbf6-dd3c-4d56-807a-0c1698692317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a4638452-6091-461a-8722-ae7ff479a041 tempest-GroupSnapshotsV319Test-923687306 None] Flow 'volume_create_manager' (c55c0167-8f27-4814-a185-ffb91bd88759) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:41 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-a4638452-6091-461a-8722-ae7ff479a041 tempest-GroupSnapshotsV319Test-923687306 None] Created volume successfully. Sep 23 00:19:41 devstack sudo[96908]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f224801b-2722-442d-8afc-4551b26e65e4 tempest-VolumesDeleteCascade-1274973268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d112d997-f602-4d6f-84c7-101276d4e971.a4c7492f-f5a5-4e3c-bc00-1f63afa473b9" returned: 0 in 0.516s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-f224801b-2722-442d-8afc-4551b26e65e4 tempest-VolumesDeleteCascade-1274973268 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d112d997-f602-4d6f-84c7-101276d4e971(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:19:41 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e448522-110d-412b-9a33-47787e000af5]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f224801b-2722-442d-8afc-4551b26e65e4 tempest-VolumesDeleteCascade-1274973268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d112d997-f602-4d6f-84c7-101276d4e971 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:41 devstack sudo[96918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d112d997-f602-4d6f-84c7-101276d4e971 Sep 23 00:19:41 devstack sudo[96918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:42 devstack sudo[96918]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f224801b-2722-442d-8afc-4551b26e65e4 tempest-VolumesDeleteCascade-1274973268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d112d997-f602-4d6f-84c7-101276d4e971" returned: 0 in 0.906s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f224801b-2722-442d-8afc-4551b26e65e4 tempest-VolumesDeleteCascade-1274973268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d112d997-f602-4d6f-84c7-101276d4e971.a4c7492f-f5a5-4e3c-bc00-1f63afa473b9 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:42 devstack sudo[96923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d112d997-f602-4d6f-84c7-101276d4e971.a4c7492f-f5a5-4e3c-bc00-1f63afa473b9 Sep 23 00:19:42 devstack sudo[96923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:42 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-5997cd7b-da35-4cdc-821d-19586d023f72 tempest-GroupSnapshotsV319Test-923687306 None] GroupSnapshot adfc6747-774d-4b44-8106-c70658f0d88a: creating. Sep 23 00:19:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5997cd7b-da35-4cdc-821d-19586d023f72 tempest-GroupSnapshotsV319Test-923687306 None] Group snapshot adfc6747-774d-4b44-8106-c70658f0d88a: creating. {{(pid=86591) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 23 00:19:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5997cd7b-da35-4cdc-821d-19586d023f72 tempest-GroupSnapshotsV319Test-923687306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5997cd7b-da35-4cdc-821d-19586d023f72 tempest-GroupSnapshotsV319Test-923687306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-5997cd7b-da35-4cdc-821d-19586d023f72 tempest-GroupSnapshotsV319Test-923687306 None] Creating offline snapshot 89768fc5-24f1-428a-8f69-38d54cf12181 of volume 60e05b67-9429-4861-9f11-e91b3fbbaf55 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:19:42 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5cbca2-cd13-4a50-ab6e-cf6cb9ffece4]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5997cd7b-da35-4cdc-821d-19586d023f72 tempest-GroupSnapshotsV319Test-923687306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-60e05b67-9429-4861-9f11-e91b3fbbaf55 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:43 devstack sudo[96925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-60e05b67-9429-4861-9f11-e91b3fbbaf55 Sep 23 00:19:43 devstack sudo[96925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:43 devstack sudo[96923]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f224801b-2722-442d-8afc-4551b26e65e4 tempest-VolumesDeleteCascade-1274973268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d112d997-f602-4d6f-84c7-101276d4e971.a4c7492f-f5a5-4e3c-bc00-1f63afa473b9" returned: 0 in 0.632s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f224801b-2722-442d-8afc-4551b26e65e4 tempest-VolumesDeleteCascade-1274973268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d112d997-f602-4d6f-84c7-101276d4e971.a4c7492f-f5a5-4e3c-bc00-1f63afa473b9 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:43 devstack sudo[96932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d112d997-f602-4d6f-84c7-101276d4e971.a4c7492f-f5a5-4e3c-bc00-1f63afa473b9 Sep 23 00:19:43 devstack sudo[96932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:43 devstack sudo[96925]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5997cd7b-da35-4cdc-821d-19586d023f72 tempest-GroupSnapshotsV319Test-923687306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-60e05b67-9429-4861-9f11-e91b3fbbaf55" returned: 0 in 0.651s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5997cd7b-da35-4cdc-821d-19586d023f72 tempest-GroupSnapshotsV319Test-923687306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-60e05b67-9429-4861-9f11-e91b3fbbaf55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-60e05b67-9429-4861-9f11-e91b3fbbaf55.89768fc5-24f1-428a-8f69-38d54cf12181 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:43 devstack sudo[96937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-60e05b67-9429-4861-9f11-e91b3fbbaf55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-60e05b67-9429-4861-9f11-e91b3fbbaf55.89768fc5-24f1-428a-8f69-38d54cf12181 1G Sep 23 00:19:43 devstack sudo[96937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:43 devstack sudo[96932]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f224801b-2722-442d-8afc-4551b26e65e4 tempest-VolumesDeleteCascade-1274973268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d112d997-f602-4d6f-84c7-101276d4e971.a4c7492f-f5a5-4e3c-bc00-1f63afa473b9" returned: 0 in 0.517s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:43 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f224801b-2722-442d-8afc-4551b26e65e4 tempest-VolumesDeleteCascade-1274973268 None] Lock "cinder-quobyte-a4c7492f-f5a5-4e3c-bc00-1f63afa473b9" released by "_delete_snapshot" :: held 2.736s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:43 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f224801b-2722-442d-8afc-4551b26e65e4 tempest-VolumesDeleteCascade-1274973268 None] Lock "cinder-quobyte-d112d997-f602-4d6f-84c7-101276d4e971" released by "delete_snapshot" :: held 2.777s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:43 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-f224801b-2722-442d-8afc-4551b26e65e4 tempest-VolumesDeleteCascade-1274973268 None] Created reservations ['fde4d871-cfe1-486b-a71b-451a5790e366', '7bf0bc7e-0268-4735-a8cf-fd27db3dc951', '25ea3922-2281-46ac-a9a5-6e7bb524fc8f', 'b2216404-4d11-461d-83cd-9bb9a8bee63d'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:19:44 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-f224801b-2722-442d-8afc-4551b26e65e4 tempest-VolumesDeleteCascade-1274973268 None] Delete snapshot completed successfully. Sep 23 00:19:44 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f224801b-2722-442d-8afc-4551b26e65e4 tempest-VolumesDeleteCascade-1274973268 None] Lock "cinder-a4c7492f-f5a5-4e3c-bc00-1f63afa473b9-delete_snapshot" released by "delete_snapshot" :: held 3.133s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f224801b-2722-442d-8afc-4551b26e65e4 tempest-VolumesDeleteCascade-1274973268 None] Snapshots deleted, issuing volume delete {{(pid=86591) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 23 00:19:44 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f224801b-2722-442d-8afc-4551b26e65e4 tempest-VolumesDeleteCascade-1274973268 None] Acquiring lock "cinder-quobyte-d112d997-f602-4d6f-84c7-101276d4e971" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:44 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f224801b-2722-442d-8afc-4551b26e65e4 tempest-VolumesDeleteCascade-1274973268 None] Lock "cinder-quobyte-d112d997-f602-4d6f-84c7-101276d4e971" acquired by "delete_volume" :: waited 0.029s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:44 devstack sudo[96937]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:44 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e508ae59-f2a1-48f8-97de-56942ad9bc76]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f224801b-2722-442d-8afc-4551b26e65e4 tempest-VolumesDeleteCascade-1274973268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d112d997-f602-4d6f-84c7-101276d4e971 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5997cd7b-da35-4cdc-821d-19586d023f72 tempest-GroupSnapshotsV319Test-923687306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-60e05b67-9429-4861-9f11-e91b3fbbaf55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-60e05b67-9429-4861-9f11-e91b3fbbaf55.89768fc5-24f1-428a-8f69-38d54cf12181 1G" returned: 0 in 0.780s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5997cd7b-da35-4cdc-821d-19586d023f72 tempest-GroupSnapshotsV319Test-923687306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60e05b67-9429-4861-9f11-e91b3fbbaf55 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-60e05b67-9429-4861-9f11-e91b3fbbaf55.89768fc5-24f1-428a-8f69-38d54cf12181 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:44 devstack sudo[96949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60e05b67-9429-4861-9f11-e91b3fbbaf55 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-60e05b67-9429-4861-9f11-e91b3fbbaf55.89768fc5-24f1-428a-8f69-38d54cf12181 Sep 23 00:19:44 devstack sudo[96949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:44 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-5c279dff-80e8-4adb-a987-1f4fd176360b req-e2f0d602-cc42-4c87-9a9b-9d9d08b83f22 tempest-TestMinimumBasicScenario-1871786 None] Terminate volume connection completed successfully. Sep 23 00:19:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-5c279dff-80e8-4adb-a987-1f4fd176360b req-e2f0d602-cc42-4c87-9a9b-9d9d08b83f22 tempest-TestMinimumBasicScenario-1871786 None] Deleting attachment a3ae2f83-91a5-44b2-bda5-7cc4209f01a2. {{(pid=86591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:19:44 devstack sudo[96948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d112d997-f602-4d6f-84c7-101276d4e971 Sep 23 00:19:44 devstack sudo[96948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:44 devstack sudo[96949]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5997cd7b-da35-4cdc-821d-19586d023f72 tempest-GroupSnapshotsV319Test-923687306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60e05b67-9429-4861-9f11-e91b3fbbaf55 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-60e05b67-9429-4861-9f11-e91b3fbbaf55.89768fc5-24f1-428a-8f69-38d54cf12181" returned: 0 in 0.442s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:44 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-5997cd7b-da35-4cdc-821d-19586d023f72 tempest-GroupSnapshotsV319Test-923687306 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-60e05b67-9429-4861-9f11-e91b3fbbaf55.89768fc5-24f1-428a-8f69-38d54cf12181 is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:19:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5997cd7b-da35-4cdc-821d-19586d023f72 tempest-GroupSnapshotsV319Test-923687306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-60e05b67-9429-4861-9f11-e91b3fbbaf55.89768fc5-24f1-428a-8f69-38d54cf12181 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:44 devstack sudo[96955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-60e05b67-9429-4861-9f11-e91b3fbbaf55.89768fc5-24f1-428a-8f69-38d54cf12181 Sep 23 00:19:44 devstack sudo[96955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:44 devstack sudo[96948]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f224801b-2722-442d-8afc-4551b26e65e4 tempest-VolumesDeleteCascade-1274973268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d112d997-f602-4d6f-84c7-101276d4e971" returned: 0 in 0.634s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f224801b-2722-442d-8afc-4551b26e65e4 tempest-VolumesDeleteCascade-1274973268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d112d997-f602-4d6f-84c7-101276d4e971 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:44 devstack sudo[96960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d112d997-f602-4d6f-84c7-101276d4e971 Sep 23 00:19:44 devstack sudo[96960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:45 devstack sudo[96955]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5997cd7b-da35-4cdc-821d-19586d023f72 tempest-GroupSnapshotsV319Test-923687306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-60e05b67-9429-4861-9f11-e91b3fbbaf55.89768fc5-24f1-428a-8f69-38d54cf12181" returned: 0 in 0.391s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:45 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-16161651-999b-4d90-a1e7-81adcc37f0c4 tempest-TestMinimumBasicScenario-1871786 None] Acquiring lock "cinder-5caa0a52-4ebf-4fd8-88d5-c49590e9ff3a-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:45 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-16161651-999b-4d90-a1e7-81adcc37f0c4 tempest-TestMinimumBasicScenario-1871786 None] Lock "cinder-5caa0a52-4ebf-4fd8-88d5-c49590e9ff3a-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5997cd7b-da35-4cdc-821d-19586d023f72 tempest-GroupSnapshotsV319Test-923687306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-60e05b67-9429-4861-9f11-e91b3fbbaf55.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:45 devstack sudo[96963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-60e05b67-9429-4861-9f11-e91b3fbbaf55.info Sep 23 00:19:45 devstack sudo[96963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:45 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-16161651-999b-4d90-a1e7-81adcc37f0c4 tempest-TestMinimumBasicScenario-1871786 None] Acquiring lock "cinder-quobyte-5caa0a52-4ebf-4fd8-88d5-c49590e9ff3a" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:45 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-16161651-999b-4d90-a1e7-81adcc37f0c4 tempest-TestMinimumBasicScenario-1871786 None] Lock "cinder-quobyte-5caa0a52-4ebf-4fd8-88d5-c49590e9ff3a" acquired by "delete_volume" :: waited 0.020s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:45 devstack sudo[96960]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f224801b-2722-442d-8afc-4551b26e65e4 tempest-VolumesDeleteCascade-1274973268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d112d997-f602-4d6f-84c7-101276d4e971" returned: 0 in 0.420s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:45 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[6234eda0-dde0-4cb4-a7fa-3b4dc45a2c6c]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-16161651-999b-4d90-a1e7-81adcc37f0c4 tempest-TestMinimumBasicScenario-1871786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-5caa0a52-4ebf-4fd8-88d5-c49590e9ff3a {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:45 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f224801b-2722-442d-8afc-4551b26e65e4 tempest-VolumesDeleteCascade-1274973268 None] Lock "cinder-quobyte-d112d997-f602-4d6f-84c7-101276d4e971" released by "delete_volume" :: held 1.200s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:45 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-f224801b-2722-442d-8afc-4551b26e65e4 tempest-VolumesDeleteCascade-1274973268 None] Created reservations ['8d36723b-beaf-4544-af52-c6b78baab666', '665c0ba5-7cd2-44bb-89b5-03cc5c6246f7', 'a9d036d9-05b4-4b70-bfa8-768d710cd27c', '7e58dec9-a525-4fc8-90d3-21d75346f927'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:19:45 devstack sudo[96966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-5caa0a52-4ebf-4fd8-88d5-c49590e9ff3a Sep 23 00:19:45 devstack sudo[96966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f224801b-2722-442d-8afc-4551b26e65e4 tempest-VolumesDeleteCascade-1274973268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f224801b-2722-442d-8afc-4551b26e65e4 tempest-VolumesDeleteCascade-1274973268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:45 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f224801b-2722-442d-8afc-4551b26e65e4 tempest-VolumesDeleteCascade-1274973268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:45 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f224801b-2722-442d-8afc-4551b26e65e4 tempest-VolumesDeleteCascade-1274973268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f224801b-2722-442d-8afc-4551b26e65e4 tempest-VolumesDeleteCascade-1274973268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f224801b-2722-442d-8afc-4551b26e65e4 tempest-VolumesDeleteCascade-1274973268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:45 devstack sudo[96969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:19:45 devstack sudo[96969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:45 devstack sudo[96963]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5997cd7b-da35-4cdc-821d-19586d023f72 tempest-GroupSnapshotsV319Test-923687306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-60e05b67-9429-4861-9f11-e91b3fbbaf55.info" returned: 0 in 0.439s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:45 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-5997cd7b-da35-4cdc-821d-19586d023f72 tempest-GroupSnapshotsV319Test-923687306 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-60e05b67-9429-4861-9f11-e91b3fbbaf55.info is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:19:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5997cd7b-da35-4cdc-821d-19586d023f72 tempest-GroupSnapshotsV319Test-923687306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-60e05b67-9429-4861-9f11-e91b3fbbaf55.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:45 devstack sudo[96971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-60e05b67-9429-4861-9f11-e91b3fbbaf55.info Sep 23 00:19:45 devstack sudo[96971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:45 devstack sudo[96966]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-16161651-999b-4d90-a1e7-81adcc37f0c4 tempest-TestMinimumBasicScenario-1871786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-5caa0a52-4ebf-4fd8-88d5-c49590e9ff3a" returned: 0 in 0.525s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-16161651-999b-4d90-a1e7-81adcc37f0c4 tempest-TestMinimumBasicScenario-1871786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-5caa0a52-4ebf-4fd8-88d5-c49590e9ff3a {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:45 devstack sudo[96977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-5caa0a52-4ebf-4fd8-88d5-c49590e9ff3a Sep 23 00:19:45 devstack sudo[96977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:45 devstack sudo[96969]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f224801b-2722-442d-8afc-4551b26e65e4 tempest-VolumesDeleteCascade-1274973268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.330s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:45 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-f224801b-2722-442d-8afc-4551b26e65e4 tempest-VolumesDeleteCascade-1274973268 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:19:45 devstack sudo[96971]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5997cd7b-da35-4cdc-821d-19586d023f72 tempest-GroupSnapshotsV319Test-923687306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-60e05b67-9429-4861-9f11-e91b3fbbaf55.info" returned: 0 in 0.288s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5997cd7b-da35-4cdc-821d-19586d023f72 tempest-GroupSnapshotsV319Test-923687306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.154s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:45 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-f224801b-2722-442d-8afc-4551b26e65e4 tempest-VolumesDeleteCascade-1274973268 None] Deleted volume successfully. Sep 23 00:19:46 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f224801b-2722-442d-8afc-4551b26e65e4 tempest-VolumesDeleteCascade-1274973268 None] Lock "cinder-d112d997-f602-4d6f-84c7-101276d4e971-delete_volume" released by "delete_volume" :: held 5.128s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:46 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-5997cd7b-da35-4cdc-821d-19586d023f72 tempest-GroupSnapshotsV319Test-923687306 None] group_snapshot adfc6747-774d-4b44-8106-c70658f0d88a: created successfully Sep 23 00:19:46 devstack sudo[96977]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-16161651-999b-4d90-a1e7-81adcc37f0c4 tempest-TestMinimumBasicScenario-1871786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-5caa0a52-4ebf-4fd8-88d5-c49590e9ff3a" returned: 0 in 0.343s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:46 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-16161651-999b-4d90-a1e7-81adcc37f0c4 tempest-TestMinimumBasicScenario-1871786 None] Lock "cinder-quobyte-5caa0a52-4ebf-4fd8-88d5-c49590e9ff3a" released by "delete_volume" :: held 0.930s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:46 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-16161651-999b-4d90-a1e7-81adcc37f0c4 tempest-TestMinimumBasicScenario-1871786 None] Created reservations ['a3f97b74-72db-4744-9cc7-9b8bae2d4991', 'db161881-5f55-4eb0-8a74-59d7e85f0c5e', '94fd07c6-61b5-4ae1-946d-e94673981a7f', '3958ae8d-b1e5-4b00-adbe-eb405c6e3607'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:19:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-16161651-999b-4d90-a1e7-81adcc37f0c4 tempest-TestMinimumBasicScenario-1871786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-16161651-999b-4d90-a1e7-81adcc37f0c4 tempest-TestMinimumBasicScenario-1871786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-16161651-999b-4d90-a1e7-81adcc37f0c4 tempest-TestMinimumBasicScenario-1871786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-16161651-999b-4d90-a1e7-81adcc37f0c4 tempest-TestMinimumBasicScenario-1871786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-16161651-999b-4d90-a1e7-81adcc37f0c4 tempest-TestMinimumBasicScenario-1871786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-16161651-999b-4d90-a1e7-81adcc37f0c4 tempest-TestMinimumBasicScenario-1871786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:46 devstack sudo[96981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:19:46 devstack sudo[96981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:46 devstack sudo[96981]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-16161651-999b-4d90-a1e7-81adcc37f0c4 tempest-TestMinimumBasicScenario-1871786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.280s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:46 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-16161651-999b-4d90-a1e7-81adcc37f0c4 tempest-TestMinimumBasicScenario-1871786 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:19:46 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-16161651-999b-4d90-a1e7-81adcc37f0c4 tempest-TestMinimumBasicScenario-1871786 None] Deleted volume successfully. Sep 23 00:19:46 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-16161651-999b-4d90-a1e7-81adcc37f0c4 tempest-TestMinimumBasicScenario-1871786 None] Lock "cinder-5caa0a52-4ebf-4fd8-88d5-c49590e9ff3a-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:46 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8f63dab0-f005-432f-ba18-91656c65547c tempest-VolumesDeleteCascade-1274973268 None] Acquiring lock "cinder-67a2aae9-83a4-4134-ba98-a8c9fa96cea3-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:46 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8f63dab0-f005-432f-ba18-91656c65547c tempest-VolumesDeleteCascade-1274973268 None] Lock "cinder-67a2aae9-83a4-4134-ba98-a8c9fa96cea3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:46 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8f63dab0-f005-432f-ba18-91656c65547c tempest-VolumesDeleteCascade-1274973268 None] Acquiring lock "cinder-quobyte-67a2aae9-83a4-4134-ba98-a8c9fa96cea3" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:46 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8f63dab0-f005-432f-ba18-91656c65547c tempest-VolumesDeleteCascade-1274973268 None] Lock "cinder-quobyte-67a2aae9-83a4-4134-ba98-a8c9fa96cea3" acquired by "delete_volume" :: waited 0.018s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:46 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e28abad-bf7e-458e-ad38-85f209a5068a]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8f63dab0-f005-432f-ba18-91656c65547c tempest-VolumesDeleteCascade-1274973268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-67a2aae9-83a4-4134-ba98-a8c9fa96cea3 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:47 devstack sudo[96985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-67a2aae9-83a4-4134-ba98-a8c9fa96cea3 Sep 23 00:19:47 devstack sudo[96985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:47 devstack sudo[96985]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8f63dab0-f005-432f-ba18-91656c65547c tempest-VolumesDeleteCascade-1274973268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-67a2aae9-83a4-4134-ba98-a8c9fa96cea3" returned: 0 in 0.518s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8f63dab0-f005-432f-ba18-91656c65547c tempest-VolumesDeleteCascade-1274973268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-67a2aae9-83a4-4134-ba98-a8c9fa96cea3 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:47 devstack sudo[96991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-67a2aae9-83a4-4134-ba98-a8c9fa96cea3 Sep 23 00:19:47 devstack sudo[96991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:47 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-d05a8cfa-af2d-43c7-aa39-73d12a8f32db tempest-GroupSnapshotsV319Test-923687306 None] group_snapshot adfc6747-774d-4b44-8106-c70658f0d88a: deleting Sep 23 00:19:47 devstack sudo[96991]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8f63dab0-f005-432f-ba18-91656c65547c tempest-VolumesDeleteCascade-1274973268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-67a2aae9-83a4-4134-ba98-a8c9fa96cea3" returned: 0 in 0.398s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:47 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8f63dab0-f005-432f-ba18-91656c65547c tempest-VolumesDeleteCascade-1274973268 None] Lock "cinder-quobyte-67a2aae9-83a4-4134-ba98-a8c9fa96cea3" released by "delete_volume" :: held 0.987s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d05a8cfa-af2d-43c7-aa39-73d12a8f32db tempest-GroupSnapshotsV319Test-923687306 None] group_snapshot adfc6747-774d-4b44-8106-c70658f0d88a: deleting {{(pid=86591) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 23 00:19:47 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d05a8cfa-af2d-43c7-aa39-73d12a8f32db tempest-GroupSnapshotsV319Test-923687306 None] Acquiring lock "cinder-quobyte-60e05b67-9429-4861-9f11-e91b3fbbaf55" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:47 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d05a8cfa-af2d-43c7-aa39-73d12a8f32db tempest-GroupSnapshotsV319Test-923687306 None] Lock "cinder-quobyte-60e05b67-9429-4861-9f11-e91b3fbbaf55" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:47 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d05a8cfa-af2d-43c7-aa39-73d12a8f32db tempest-GroupSnapshotsV319Test-923687306 None] Acquiring lock "cinder-quobyte-89768fc5-24f1-428a-8f69-38d54cf12181" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:47 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d05a8cfa-af2d-43c7-aa39-73d12a8f32db tempest-GroupSnapshotsV319Test-923687306 None] Lock "cinder-quobyte-89768fc5-24f1-428a-8f69-38d54cf12181" acquired by "_delete_snapshot" :: waited 0.052s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:48 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-d05a8cfa-af2d-43c7-aa39-73d12a8f32db tempest-GroupSnapshotsV319Test-923687306 None] Deleting offline snapshot 89768fc5-24f1-428a-8f69-38d54cf12181 of volume 60e05b67-9429-4861-9f11-e91b3fbbaf55 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:19:48 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-d05a8cfa-af2d-43c7-aa39-73d12a8f32db tempest-GroupSnapshotsV319Test-923687306 None] snapshot_file for this snap is: volume-60e05b67-9429-4861-9f11-e91b3fbbaf55.89768fc5-24f1-428a-8f69-38d54cf12181 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:19:48 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-8f63dab0-f005-432f-ba18-91656c65547c tempest-VolumesDeleteCascade-1274973268 None] Created reservations ['77b1f246-25cd-4012-98ae-5eb51efc9696', 'df61af64-2eba-4ead-b8eb-133cc014e2c4', '2bdefb2c-04bb-4e94-860a-d0f3d0818b81', 'af03dc90-007e-4b18-8fe1-a8c1409ea524'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:19:48 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e39f812-7e96-4e04-bea5-dca8240877a2]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d05a8cfa-af2d-43c7-aa39-73d12a8f32db tempest-GroupSnapshotsV319Test-923687306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-60e05b67-9429-4861-9f11-e91b3fbbaf55.89768fc5-24f1-428a-8f69-38d54cf12181 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8f63dab0-f005-432f-ba18-91656c65547c tempest-VolumesDeleteCascade-1274973268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8f63dab0-f005-432f-ba18-91656c65547c tempest-VolumesDeleteCascade-1274973268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:48 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-8f63dab0-f005-432f-ba18-91656c65547c tempest-VolumesDeleteCascade-1274973268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:48 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-8f63dab0-f005-432f-ba18-91656c65547c tempest-VolumesDeleteCascade-1274973268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8f63dab0-f005-432f-ba18-91656c65547c tempest-VolumesDeleteCascade-1274973268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8f63dab0-f005-432f-ba18-91656c65547c tempest-VolumesDeleteCascade-1274973268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:48 devstack sudo[97009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-60e05b67-9429-4861-9f11-e91b3fbbaf55.89768fc5-24f1-428a-8f69-38d54cf12181 Sep 23 00:19:48 devstack sudo[97009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:48 devstack sudo[97016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:19:48 devstack sudo[97016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:48 devstack sudo[97016]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8f63dab0-f005-432f-ba18-91656c65547c tempest-VolumesDeleteCascade-1274973268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.374s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:48 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-8f63dab0-f005-432f-ba18-91656c65547c tempest-VolumesDeleteCascade-1274973268 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:19:48 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-8f63dab0-f005-432f-ba18-91656c65547c tempest-VolumesDeleteCascade-1274973268 None] Deleted volume successfully. Sep 23 00:19:48 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8f63dab0-f005-432f-ba18-91656c65547c tempest-VolumesDeleteCascade-1274973268 None] Lock "cinder-67a2aae9-83a4-4134-ba98-a8c9fa96cea3-delete_volume" released by "delete_volume" :: held 2.138s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:48 devstack sudo[97009]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d05a8cfa-af2d-43c7-aa39-73d12a8f32db tempest-GroupSnapshotsV319Test-923687306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-60e05b67-9429-4861-9f11-e91b3fbbaf55.89768fc5-24f1-428a-8f69-38d54cf12181" returned: 0 in 0.747s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:48 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-d05a8cfa-af2d-43c7-aa39-73d12a8f32db tempest-GroupSnapshotsV319Test-923687306 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60e05b67-9429-4861-9f11-e91b3fbbaf55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:19:48 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99f6040-4cae-4288-bdad-263de49ce114]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d05a8cfa-af2d-43c7-aa39-73d12a8f32db tempest-GroupSnapshotsV319Test-923687306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-60e05b67-9429-4861-9f11-e91b3fbbaf55 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:49 devstack sudo[97024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-60e05b67-9429-4861-9f11-e91b3fbbaf55 Sep 23 00:19:49 devstack sudo[97024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:49 devstack sudo[97024]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d05a8cfa-af2d-43c7-aa39-73d12a8f32db tempest-GroupSnapshotsV319Test-923687306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-60e05b67-9429-4861-9f11-e91b3fbbaf55" returned: 0 in 0.615s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d05a8cfa-af2d-43c7-aa39-73d12a8f32db tempest-GroupSnapshotsV319Test-923687306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-60e05b67-9429-4861-9f11-e91b3fbbaf55.89768fc5-24f1-428a-8f69-38d54cf12181 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:49 devstack sudo[97030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-60e05b67-9429-4861-9f11-e91b3fbbaf55.89768fc5-24f1-428a-8f69-38d54cf12181 Sep 23 00:19:49 devstack sudo[97030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:50 devstack sudo[97030]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d05a8cfa-af2d-43c7-aa39-73d12a8f32db tempest-GroupSnapshotsV319Test-923687306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-60e05b67-9429-4861-9f11-e91b3fbbaf55.89768fc5-24f1-428a-8f69-38d54cf12181" returned: 0 in 0.752s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d05a8cfa-af2d-43c7-aa39-73d12a8f32db tempest-GroupSnapshotsV319Test-923687306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-60e05b67-9429-4861-9f11-e91b3fbbaf55.89768fc5-24f1-428a-8f69-38d54cf12181 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:50 devstack sudo[97037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-60e05b67-9429-4861-9f11-e91b3fbbaf55.89768fc5-24f1-428a-8f69-38d54cf12181 Sep 23 00:19:50 devstack sudo[97037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:50 devstack sudo[97037]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d05a8cfa-af2d-43c7-aa39-73d12a8f32db tempest-GroupSnapshotsV319Test-923687306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-60e05b67-9429-4861-9f11-e91b3fbbaf55.89768fc5-24f1-428a-8f69-38d54cf12181" returned: 0 in 0.356s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:50 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d05a8cfa-af2d-43c7-aa39-73d12a8f32db tempest-GroupSnapshotsV319Test-923687306 None] Lock "cinder-quobyte-89768fc5-24f1-428a-8f69-38d54cf12181" released by "_delete_snapshot" :: held 2.788s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:50 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d05a8cfa-af2d-43c7-aa39-73d12a8f32db tempest-GroupSnapshotsV319Test-923687306 None] Lock "cinder-quobyte-60e05b67-9429-4861-9f11-e91b3fbbaf55" released by "delete_snapshot" :: held 2.854s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:50 devstack cinder-volume[86591]: WARNING cinder.quota [None req-d05a8cfa-af2d-43c7-aa39-73d12a8f32db tempest-GroupSnapshotsV319Test-923687306 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1487986220 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1487986220, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:19:50 devstack cinder-volume[86591]: WARNING cinder.quota [None req-d05a8cfa-af2d-43c7-aa39-73d12a8f32db tempest-GroupSnapshotsV319Test-923687306 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1487986220 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1487986220, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:19:50 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-d05a8cfa-af2d-43c7-aa39-73d12a8f32db tempest-GroupSnapshotsV319Test-923687306 None] Created reservations ['6d205a8a-6f96-4ac1-b1e3-4cc0a9e7d12c', 'f7141931-db97-4926-a56b-075122c1db86', '0840244b-3514-4d91-8116-93ca38d3f944', '3b12fc48-2f2f-4aab-bbfa-06aa256959a6'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:19:51 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-d05a8cfa-af2d-43c7-aa39-73d12a8f32db tempest-GroupSnapshotsV319Test-923687306 None] group_snapshot adfc6747-774d-4b44-8106-c70658f0d88a: deleted successfully Sep 23 00:19:51 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-7020cbd9-7136-4055-8937-cc0fb0987b3f tempest-GroupSnapshotsV319Test-923687306 None] Acquiring lock "cinder-quobyte-60e05b67-9429-4861-9f11-e91b3fbbaf55" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:51 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-7020cbd9-7136-4055-8937-cc0fb0987b3f tempest-GroupSnapshotsV319Test-923687306 None] Lock "cinder-quobyte-60e05b67-9429-4861-9f11-e91b3fbbaf55" acquired by "delete_volume" :: waited 0.026s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:52 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e8b793-3a86-4ade-b5a0-efebe831a515]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7020cbd9-7136-4055-8937-cc0fb0987b3f tempest-GroupSnapshotsV319Test-923687306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-60e05b67-9429-4861-9f11-e91b3fbbaf55 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:52 devstack sudo[97040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-60e05b67-9429-4861-9f11-e91b3fbbaf55 Sep 23 00:19:52 devstack sudo[97040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:52 devstack sudo[97040]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7020cbd9-7136-4055-8937-cc0fb0987b3f tempest-GroupSnapshotsV319Test-923687306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-60e05b67-9429-4861-9f11-e91b3fbbaf55" returned: 0 in 0.598s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7020cbd9-7136-4055-8937-cc0fb0987b3f tempest-GroupSnapshotsV319Test-923687306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-60e05b67-9429-4861-9f11-e91b3fbbaf55 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:52 devstack sudo[97045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-60e05b67-9429-4861-9f11-e91b3fbbaf55 Sep 23 00:19:52 devstack sudo[97045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:52 devstack sudo[97045]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7020cbd9-7136-4055-8937-cc0fb0987b3f tempest-GroupSnapshotsV319Test-923687306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-60e05b67-9429-4861-9f11-e91b3fbbaf55" returned: 0 in 0.296s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:53 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-7020cbd9-7136-4055-8937-cc0fb0987b3f tempest-GroupSnapshotsV319Test-923687306 None] Lock "cinder-quobyte-60e05b67-9429-4861-9f11-e91b3fbbaf55" released by "delete_volume" :: held 1.020s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:53 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-7020cbd9-7136-4055-8937-cc0fb0987b3f tempest-GroupSnapshotsV319Test-923687306 None] Created reservations ['53c300bf-b83d-4f69-9844-6d6433d87424'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:19:53 devstack cinder-volume[86591]: WARNING cinder.quota [None req-7020cbd9-7136-4055-8937-cc0fb0987b3f tempest-GroupSnapshotsV319Test-923687306 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1487986220 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1487986220, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:19:53 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-7020cbd9-7136-4055-8937-cc0fb0987b3f tempest-GroupSnapshotsV319Test-923687306 None] Created reservations ['f62ac99e-c285-4de7-a990-44036e55d237', 'b138d027-79ae-4be2-9478-00918ccbe5a5', '364b5f3f-7b20-4c49-9500-e758a6c1d986', '94b9470a-45bd-41e7-b0a9-d8055f719336'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:19:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7020cbd9-7136-4055-8937-cc0fb0987b3f tempest-GroupSnapshotsV319Test-923687306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7020cbd9-7136-4055-8937-cc0fb0987b3f tempest-GroupSnapshotsV319Test-923687306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:53 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7020cbd9-7136-4055-8937-cc0fb0987b3f tempest-GroupSnapshotsV319Test-923687306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:53 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7020cbd9-7136-4055-8937-cc0fb0987b3f tempest-GroupSnapshotsV319Test-923687306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7020cbd9-7136-4055-8937-cc0fb0987b3f tempest-GroupSnapshotsV319Test-923687306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7020cbd9-7136-4055-8937-cc0fb0987b3f tempest-GroupSnapshotsV319Test-923687306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:53 devstack sudo[97048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:19:53 devstack sudo[97048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:53 devstack sudo[97048]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7020cbd9-7136-4055-8937-cc0fb0987b3f tempest-GroupSnapshotsV319Test-923687306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.332s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:53 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-7020cbd9-7136-4055-8937-cc0fb0987b3f tempest-GroupSnapshotsV319Test-923687306 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:19:53 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-7020cbd9-7136-4055-8937-cc0fb0987b3f tempest-GroupSnapshotsV319Test-923687306 None] Delete group completed successfully. Sep 23 00:19:58 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6b43a92-0cf2-4e7b-9e87-b72479b72c6e tempest-VolumesTransfersV357Test-301923303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:19:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e6b43a92-0cf2-4e7b-9e87-b72479b72c6e tempest-VolumesTransfersV357Test-301923303 None] Flow 'volume_create_manager' (c43094f9-1e9b-4414-ab85-d50b6fe0a942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e6b43a92-0cf2-4e7b-9e87-b72479b72c6e tempest-VolumesTransfersV357Test-301923303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7af66d0-1f43-4ea4-8641-ea99968e3101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e6b43a92-0cf2-4e7b-9e87-b72479b72c6e tempest-VolumesTransfersV357Test-301923303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7af66d0-1f43-4ea4-8641-ea99968e3101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1175078664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b11386b-6c71-4d6d-bdea-dc7ecbd2a8a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='771d5ca296934223bf015f9f07e21559',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:59Z,use_quota=True,user_id='b4c14145920d433cb19c0099ddf115a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e6b43a92-0cf2-4e7b-9e87-b72479b72c6e tempest-VolumesTransfersV357Test-301923303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2db4b83d-df4b-4b1d-a2b1-a16d443eb7da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e6b43a92-0cf2-4e7b-9e87-b72479b72c6e tempest-VolumesTransfersV357Test-301923303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2db4b83d-df4b-4b1d-a2b1-a16d443eb7da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e6b43a92-0cf2-4e7b-9e87-b72479b72c6e tempest-VolumesTransfersV357Test-301923303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36585a93-6338-44d5-a6e9-507573f5631d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e6b43a92-0cf2-4e7b-9e87-b72479b72c6e tempest-VolumesTransfersV357Test-301923303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36585a93-6338-44d5-a6e9-507573f5631d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b11386b-6c71-4d6d-bdea-dc7ecbd2a8a1', 'volume_name': 'volume-4b11386b-6c71-4d6d-bdea-dc7ecbd2a8a1', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e6b43a92-0cf2-4e7b-9e87-b72479b72c6e tempest-VolumesTransfersV357Test-301923303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3055e62-dd97-4387-9c44-21c9ba42821c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e6b43a92-0cf2-4e7b-9e87-b72479b72c6e tempest-VolumesTransfersV357Test-301923303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3055e62-dd97-4387-9c44-21c9ba42821c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e6b43a92-0cf2-4e7b-9e87-b72479b72c6e tempest-VolumesTransfersV357Test-301923303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15487beb-3d64-4172-8bac-9e6b4438a8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:58 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-e6b43a92-0cf2-4e7b-9e87-b72479b72c6e tempest-VolumesTransfersV357Test-301923303 None] Volume 4b11386b-6c71-4d6d-bdea-dc7ecbd2a8a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b11386b-6c71-4d6d-bdea-dc7ecbd2a8a1', 'volume_size': 1} Sep 23 00:19:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e6b43a92-0cf2-4e7b-9e87-b72479b72c6e tempest-VolumesTransfersV357Test-301923303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e6b43a92-0cf2-4e7b-9e87-b72479b72c6e tempest-VolumesTransfersV357Test-301923303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:58 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e6b43a92-0cf2-4e7b-9e87-b72479b72c6e tempest-VolumesTransfersV357Test-301923303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1175078664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b11386b-6c71-4d6d-bdea-dc7ecbd2a8a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='771d5ca296934223bf015f9f07e21559',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:59Z,use_quota=True,user_id='b4c14145920d433cb19c0099ddf115a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:19:58 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-e6b43a92-0cf2-4e7b-9e87-b72479b72c6e tempest-VolumesTransfersV357Test-301923303 None] Creating volume 4b11386b-6c71-4d6d-bdea-dc7ecbd2a8a1 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:19:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e6b43a92-0cf2-4e7b-9e87-b72479b72c6e tempest-VolumesTransfersV357Test-301923303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e6b43a92-0cf2-4e7b-9e87-b72479b72c6e tempest-VolumesTransfersV357Test-301923303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:58 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e6b43a92-0cf2-4e7b-9e87-b72479b72c6e tempest-VolumesTransfersV357Test-301923303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:58 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e6b43a92-0cf2-4e7b-9e87-b72479b72c6e tempest-VolumesTransfersV357Test-301923303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e6b43a92-0cf2-4e7b-9e87-b72479b72c6e tempest-VolumesTransfersV357Test-301923303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:58 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e6b43a92-0cf2-4e7b-9e87-b72479b72c6e tempest-VolumesTransfersV357Test-301923303 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:19:58 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-e6b43a92-0cf2-4e7b-9e87-b72479b72c6e tempest-VolumesTransfersV357Test-301923303 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:19:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e6b43a92-0cf2-4e7b-9e87-b72479b72c6e tempest-VolumesTransfersV357Test-301923303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-4b11386b-6c71-4d6d-bdea-dc7ecbd2a8a1 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:59 devstack sudo[97054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-4b11386b-6c71-4d6d-bdea-dc7ecbd2a8a1 1073741824 Sep 23 00:19:59 devstack sudo[97054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:59 devstack sudo[97054]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e6b43a92-0cf2-4e7b-9e87-b72479b72c6e tempest-VolumesTransfersV357Test-301923303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-4b11386b-6c71-4d6d-bdea-dc7ecbd2a8a1 1073741824" returned: 0 in 0.733s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e6b43a92-0cf2-4e7b-9e87-b72479b72c6e tempest-VolumesTransfersV357Test-301923303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-4b11386b-6c71-4d6d-bdea-dc7ecbd2a8a1 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:59 devstack sudo[97060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-4b11386b-6c71-4d6d-bdea-dc7ecbd2a8a1 Sep 23 00:19:59 devstack sudo[97060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:00 devstack sudo[97060]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e6b43a92-0cf2-4e7b-9e87-b72479b72c6e tempest-VolumesTransfersV357Test-301923303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-4b11386b-6c71-4d6d-bdea-dc7ecbd2a8a1" returned: 0 in 0.332s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:00 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e6b43a92-0cf2-4e7b-9e87-b72479b72c6e tempest-VolumesTransfersV357Test-301923303 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:20:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e6b43a92-0cf2-4e7b-9e87-b72479b72c6e tempest-VolumesTransfersV357Test-301923303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e6b43a92-0cf2-4e7b-9e87-b72479b72c6e tempest-VolumesTransfersV357Test-301923303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15487beb-3d64-4172-8bac-9e6b4438a8c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b11386b-6c71-4d6d-bdea-dc7ecbd2a8a1', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e6b43a92-0cf2-4e7b-9e87-b72479b72c6e tempest-VolumesTransfersV357Test-301923303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56df7722-9253-43c0-a5eb-5a86f9986c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:00 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-e6b43a92-0cf2-4e7b-9e87-b72479b72c6e tempest-VolumesTransfersV357Test-301923303 None] Volume volume-4b11386b-6c71-4d6d-bdea-dc7ecbd2a8a1 (4b11386b-6c71-4d6d-bdea-dc7ecbd2a8a1): created successfully Sep 23 00:20:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e6b43a92-0cf2-4e7b-9e87-b72479b72c6e tempest-VolumesTransfersV357Test-301923303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56df7722-9253-43c0-a5eb-5a86f9986c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e6b43a92-0cf2-4e7b-9e87-b72479b72c6e tempest-VolumesTransfersV357Test-301923303 None] Flow 'volume_create_manager' (c43094f9-1e9b-4414-ab85-d50b6fe0a942) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:20:00 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-e6b43a92-0cf2-4e7b-9e87-b72479b72c6e tempest-VolumesTransfersV357Test-301923303 None] Created volume successfully. Sep 23 00:20:02 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-17ec39db-167d-44fb-a380-38d357fba65d tempest-VolumesTransfersV357Test-185543252 None] Transfer volume completed successfully. Sep 23 00:20:03 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4e9a8dc0-3e9a-4de5-93ec-758efd2185dc tempest-VolumesTransfersV357Test-1658309370 None] Acquiring lock "cinder-4b11386b-6c71-4d6d-bdea-dc7ecbd2a8a1-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:03 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4e9a8dc0-3e9a-4de5-93ec-758efd2185dc tempest-VolumesTransfersV357Test-1658309370 None] Lock "cinder-4b11386b-6c71-4d6d-bdea-dc7ecbd2a8a1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:03 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4e9a8dc0-3e9a-4de5-93ec-758efd2185dc tempest-VolumesTransfersV357Test-1658309370 None] Acquiring lock "cinder-quobyte-4b11386b-6c71-4d6d-bdea-dc7ecbd2a8a1" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:03 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4e9a8dc0-3e9a-4de5-93ec-758efd2185dc tempest-VolumesTransfersV357Test-1658309370 None] Lock "cinder-quobyte-4b11386b-6c71-4d6d-bdea-dc7ecbd2a8a1" acquired by "delete_volume" :: waited 0.017s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:03 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[047811a7-8e34-4fb6-8b53-5f48e71e3cb1]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4e9a8dc0-3e9a-4de5-93ec-758efd2185dc tempest-VolumesTransfersV357Test-1658309370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-4b11386b-6c71-4d6d-bdea-dc7ecbd2a8a1 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:03 devstack sudo[97068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-4b11386b-6c71-4d6d-bdea-dc7ecbd2a8a1 Sep 23 00:20:03 devstack sudo[97068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:04 devstack sudo[97068]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4e9a8dc0-3e9a-4de5-93ec-758efd2185dc tempest-VolumesTransfersV357Test-1658309370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-4b11386b-6c71-4d6d-bdea-dc7ecbd2a8a1" returned: 0 in 0.476s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4e9a8dc0-3e9a-4de5-93ec-758efd2185dc tempest-VolumesTransfersV357Test-1658309370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-4b11386b-6c71-4d6d-bdea-dc7ecbd2a8a1 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:04 devstack sudo[97073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-4b11386b-6c71-4d6d-bdea-dc7ecbd2a8a1 Sep 23 00:20:04 devstack sudo[97073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:04 devstack sudo[97073]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4e9a8dc0-3e9a-4de5-93ec-758efd2185dc tempest-VolumesTransfersV357Test-1658309370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-4b11386b-6c71-4d6d-bdea-dc7ecbd2a8a1" returned: 0 in 0.404s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:04 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4e9a8dc0-3e9a-4de5-93ec-758efd2185dc tempest-VolumesTransfersV357Test-1658309370 None] Lock "cinder-quobyte-4b11386b-6c71-4d6d-bdea-dc7ecbd2a8a1" released by "delete_volume" :: held 0.960s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:04 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-4e9a8dc0-3e9a-4de5-93ec-758efd2185dc tempest-VolumesTransfersV357Test-1658309370 None] Created reservations ['a36619d8-1334-4e9b-8a3a-884759959cdb', '716bcfae-6f78-4952-a925-6c764df2cfb2', 'e0db80fb-4a0d-404c-9a0c-5ff663f1e374', '6b869aa1-1610-4f1c-90c2-162006af77a6'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:20:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4e9a8dc0-3e9a-4de5-93ec-758efd2185dc tempest-VolumesTransfersV357Test-1658309370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4e9a8dc0-3e9a-4de5-93ec-758efd2185dc tempest-VolumesTransfersV357Test-1658309370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:04 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4e9a8dc0-3e9a-4de5-93ec-758efd2185dc tempest-VolumesTransfersV357Test-1658309370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:04 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4e9a8dc0-3e9a-4de5-93ec-758efd2185dc tempest-VolumesTransfersV357Test-1658309370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4e9a8dc0-3e9a-4de5-93ec-758efd2185dc tempest-VolumesTransfersV357Test-1658309370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4e9a8dc0-3e9a-4de5-93ec-758efd2185dc tempest-VolumesTransfersV357Test-1658309370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:04 devstack sudo[97076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:20:04 devstack sudo[97076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:05 devstack sudo[97076]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4e9a8dc0-3e9a-4de5-93ec-758efd2185dc tempest-VolumesTransfersV357Test-1658309370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.365s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:05 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-4e9a8dc0-3e9a-4de5-93ec-758efd2185dc tempest-VolumesTransfersV357Test-1658309370 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:20:05 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-4e9a8dc0-3e9a-4de5-93ec-758efd2185dc tempest-VolumesTransfersV357Test-1658309370 None] Deleted volume successfully. Sep 23 00:20:05 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4e9a8dc0-3e9a-4de5-93ec-758efd2185dc tempest-VolumesTransfersV357Test-1658309370 None] Lock "cinder-4b11386b-6c71-4d6d-bdea-dc7ecbd2a8a1-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:06 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a22bece-10d0-47f3-b278-b62c2be2e4a1 tempest-VolumesTransfersV357Test-301923303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:20:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0a22bece-10d0-47f3-b278-b62c2be2e4a1 tempest-VolumesTransfersV357Test-301923303 None] Flow 'volume_create_manager' (034c124a-f153-49d9-9d49-9a48ecb924f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:20:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0a22bece-10d0-47f3-b278-b62c2be2e4a1 tempest-VolumesTransfersV357Test-301923303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e64d4ac7-1864-4c2b-ac35-9fa7422d361d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0a22bece-10d0-47f3-b278-b62c2be2e4a1 tempest-VolumesTransfersV357Test-301923303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e64d4ac7-1864-4c2b-ac35-9fa7422d361d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:20:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-542594907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0ef2366-4455-4c96-a930-6d015cfc0dee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='771d5ca296934223bf015f9f07e21559',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:07Z,use_quota=True,user_id='b4c14145920d433cb19c0099ddf115a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0a22bece-10d0-47f3-b278-b62c2be2e4a1 tempest-VolumesTransfersV357Test-301923303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0c8409c-8775-4f35-8d37-17e1a3a16eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0a22bece-10d0-47f3-b278-b62c2be2e4a1 tempest-VolumesTransfersV357Test-301923303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0c8409c-8775-4f35-8d37-17e1a3a16eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0a22bece-10d0-47f3-b278-b62c2be2e4a1 tempest-VolumesTransfersV357Test-301923303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (403876d3-68c2-49c3-909f-efc17b7d7d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0a22bece-10d0-47f3-b278-b62c2be2e4a1 tempest-VolumesTransfersV357Test-301923303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (403876d3-68c2-49c3-909f-efc17b7d7d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0ef2366-4455-4c96-a930-6d015cfc0dee', 'volume_name': 'volume-c0ef2366-4455-4c96-a930-6d015cfc0dee', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0a22bece-10d0-47f3-b278-b62c2be2e4a1 tempest-VolumesTransfersV357Test-301923303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0346629-c268-42fb-a3c2-a9fe31965663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0a22bece-10d0-47f3-b278-b62c2be2e4a1 tempest-VolumesTransfersV357Test-301923303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0346629-c268-42fb-a3c2-a9fe31965663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0a22bece-10d0-47f3-b278-b62c2be2e4a1 tempest-VolumesTransfersV357Test-301923303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07c1dc64-a7a0-43a0-9310-794cd6abdbd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:06 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-0a22bece-10d0-47f3-b278-b62c2be2e4a1 tempest-VolumesTransfersV357Test-301923303 None] Volume c0ef2366-4455-4c96-a930-6d015cfc0dee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0ef2366-4455-4c96-a930-6d015cfc0dee', 'volume_size': 1} Sep 23 00:20:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0a22bece-10d0-47f3-b278-b62c2be2e4a1 tempest-VolumesTransfersV357Test-301923303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0a22bece-10d0-47f3-b278-b62c2be2e4a1 tempest-VolumesTransfersV357Test-301923303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0a22bece-10d0-47f3-b278-b62c2be2e4a1 tempest-VolumesTransfersV357Test-301923303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:20:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-542594907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0ef2366-4455-4c96-a930-6d015cfc0dee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='771d5ca296934223bf015f9f07e21559',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:07Z,use_quota=True,user_id='b4c14145920d433cb19c0099ddf115a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:20:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-0a22bece-10d0-47f3-b278-b62c2be2e4a1 tempest-VolumesTransfersV357Test-301923303 None] Creating volume c0ef2366-4455-4c96-a930-6d015cfc0dee {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:20:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0a22bece-10d0-47f3-b278-b62c2be2e4a1 tempest-VolumesTransfersV357Test-301923303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0a22bece-10d0-47f3-b278-b62c2be2e4a1 tempest-VolumesTransfersV357Test-301923303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0a22bece-10d0-47f3-b278-b62c2be2e4a1 tempest-VolumesTransfersV357Test-301923303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0a22bece-10d0-47f3-b278-b62c2be2e4a1 tempest-VolumesTransfersV357Test-301923303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0a22bece-10d0-47f3-b278-b62c2be2e4a1 tempest-VolumesTransfersV357Test-301923303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0a22bece-10d0-47f3-b278-b62c2be2e4a1 tempest-VolumesTransfersV357Test-301923303 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:20:06 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-0a22bece-10d0-47f3-b278-b62c2be2e4a1 tempest-VolumesTransfersV357Test-301923303 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:20:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0a22bece-10d0-47f3-b278-b62c2be2e4a1 tempest-VolumesTransfersV357Test-301923303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c0ef2366-4455-4c96-a930-6d015cfc0dee 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:06 devstack sudo[97117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c0ef2366-4455-4c96-a930-6d015cfc0dee 1073741824 Sep 23 00:20:06 devstack sudo[97117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:07 devstack sudo[97117]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0a22bece-10d0-47f3-b278-b62c2be2e4a1 tempest-VolumesTransfersV357Test-301923303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c0ef2366-4455-4c96-a930-6d015cfc0dee 1073741824" returned: 0 in 0.683s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0a22bece-10d0-47f3-b278-b62c2be2e4a1 tempest-VolumesTransfersV357Test-301923303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c0ef2366-4455-4c96-a930-6d015cfc0dee {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:07 devstack sudo[97123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c0ef2366-4455-4c96-a930-6d015cfc0dee Sep 23 00:20:07 devstack sudo[97123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:07 devstack sudo[97123]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0a22bece-10d0-47f3-b278-b62c2be2e4a1 tempest-VolumesTransfersV357Test-301923303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c0ef2366-4455-4c96-a930-6d015cfc0dee" returned: 0 in 0.299s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:07 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0a22bece-10d0-47f3-b278-b62c2be2e4a1 tempest-VolumesTransfersV357Test-301923303 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:20:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0a22bece-10d0-47f3-b278-b62c2be2e4a1 tempest-VolumesTransfersV357Test-301923303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0a22bece-10d0-47f3-b278-b62c2be2e4a1 tempest-VolumesTransfersV357Test-301923303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07c1dc64-a7a0-43a0-9310-794cd6abdbd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0ef2366-4455-4c96-a930-6d015cfc0dee', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0a22bece-10d0-47f3-b278-b62c2be2e4a1 tempest-VolumesTransfersV357Test-301923303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18798a27-481d-45b9-ae38-a75da4fc2739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:07 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-0a22bece-10d0-47f3-b278-b62c2be2e4a1 tempest-VolumesTransfersV357Test-301923303 None] Volume volume-c0ef2366-4455-4c96-a930-6d015cfc0dee (c0ef2366-4455-4c96-a930-6d015cfc0dee): created successfully Sep 23 00:20:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0a22bece-10d0-47f3-b278-b62c2be2e4a1 tempest-VolumesTransfersV357Test-301923303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18798a27-481d-45b9-ae38-a75da4fc2739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0a22bece-10d0-47f3-b278-b62c2be2e4a1 tempest-VolumesTransfersV357Test-301923303 None] Flow 'volume_create_manager' (034c124a-f153-49d9-9d49-9a48ecb924f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:20:08 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-0a22bece-10d0-47f3-b278-b62c2be2e4a1 tempest-VolumesTransfersV357Test-301923303 None] Created volume successfully. Sep 23 00:20:09 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-50ddf0d0-268f-45b7-93a9-25e116d7e9dd tempest-VolumesTransfersV357Test-1658309370 None] Acquiring lock "cinder-c0ef2366-4455-4c96-a930-6d015cfc0dee-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:09 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-50ddf0d0-268f-45b7-93a9-25e116d7e9dd tempest-VolumesTransfersV357Test-1658309370 None] Lock "cinder-c0ef2366-4455-4c96-a930-6d015cfc0dee-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:09 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-50ddf0d0-268f-45b7-93a9-25e116d7e9dd tempest-VolumesTransfersV357Test-1658309370 None] Acquiring lock "cinder-quobyte-c0ef2366-4455-4c96-a930-6d015cfc0dee" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:09 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-50ddf0d0-268f-45b7-93a9-25e116d7e9dd tempest-VolumesTransfersV357Test-1658309370 None] Lock "cinder-quobyte-c0ef2366-4455-4c96-a930-6d015cfc0dee" acquired by "delete_volume" :: waited 0.036s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:09 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd83cdb1-3d22-4438-86d4-c3e74683fa1b]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-50ddf0d0-268f-45b7-93a9-25e116d7e9dd tempest-VolumesTransfersV357Test-1658309370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c0ef2366-4455-4c96-a930-6d015cfc0dee {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:09 devstack sudo[97127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c0ef2366-4455-4c96-a930-6d015cfc0dee Sep 23 00:20:09 devstack sudo[97127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:10 devstack sudo[97127]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-50ddf0d0-268f-45b7-93a9-25e116d7e9dd tempest-VolumesTransfersV357Test-1658309370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c0ef2366-4455-4c96-a930-6d015cfc0dee" returned: 0 in 0.552s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-50ddf0d0-268f-45b7-93a9-25e116d7e9dd tempest-VolumesTransfersV357Test-1658309370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c0ef2366-4455-4c96-a930-6d015cfc0dee {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:10 devstack sudo[97137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c0ef2366-4455-4c96-a930-6d015cfc0dee Sep 23 00:20:10 devstack sudo[97137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:10 devstack sudo[97137]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-50ddf0d0-268f-45b7-93a9-25e116d7e9dd tempest-VolumesTransfersV357Test-1658309370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c0ef2366-4455-4c96-a930-6d015cfc0dee" returned: 0 in 0.422s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:10 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-50ddf0d0-268f-45b7-93a9-25e116d7e9dd tempest-VolumesTransfersV357Test-1658309370 None] Lock "cinder-quobyte-c0ef2366-4455-4c96-a930-6d015cfc0dee" released by "delete_volume" :: held 1.039s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:10 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-50ddf0d0-268f-45b7-93a9-25e116d7e9dd tempest-VolumesTransfersV357Test-1658309370 None] Created reservations ['c9a575cf-8bf7-40b5-b2ed-d458d476ef13', 'f53d624e-0dee-4e71-ab0b-4c967ffa962b', 'ee21379b-0d7d-4334-9be5-de70873d859b', '356dd1ab-92c0-4272-994f-08b3a8e5916a'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:20:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-50ddf0d0-268f-45b7-93a9-25e116d7e9dd tempest-VolumesTransfersV357Test-1658309370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-50ddf0d0-268f-45b7-93a9-25e116d7e9dd tempest-VolumesTransfersV357Test-1658309370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:10 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-50ddf0d0-268f-45b7-93a9-25e116d7e9dd tempest-VolumesTransfersV357Test-1658309370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:10 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-50ddf0d0-268f-45b7-93a9-25e116d7e9dd tempest-VolumesTransfersV357Test-1658309370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-50ddf0d0-268f-45b7-93a9-25e116d7e9dd tempest-VolumesTransfersV357Test-1658309370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-50ddf0d0-268f-45b7-93a9-25e116d7e9dd tempest-VolumesTransfersV357Test-1658309370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:10 devstack sudo[97140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:20:10 devstack sudo[97140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:11 devstack sudo[97140]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-50ddf0d0-268f-45b7-93a9-25e116d7e9dd tempest-VolumesTransfersV357Test-1658309370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.400s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:11 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-50ddf0d0-268f-45b7-93a9-25e116d7e9dd tempest-VolumesTransfersV357Test-1658309370 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:20:11 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-50ddf0d0-268f-45b7-93a9-25e116d7e9dd tempest-VolumesTransfersV357Test-1658309370 None] Deleted volume successfully. Sep 23 00:20:11 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-50ddf0d0-268f-45b7-93a9-25e116d7e9dd tempest-VolumesTransfersV357Test-1658309370 None] Lock "cinder-c0ef2366-4455-4c96-a930-6d015cfc0dee-delete_volume" released by "delete_volume" :: held 1.821s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:14 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-53dc4983-01d3-4c98-98dd-71bfa451b8d6 tempest-VolumeRetypeWithoutMigrationTest-398270416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:20:14 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53dc4983-01d3-4c98-98dd-71bfa451b8d6 tempest-VolumeRetypeWithoutMigrationTest-398270416 None] Flow 'volume_create_manager' (8f479743-c380-48c2-82a0-07049477c107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:20:14 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53dc4983-01d3-4c98-98dd-71bfa451b8d6 tempest-VolumeRetypeWithoutMigrationTest-398270416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37981d36-a0ac-43d8-90a1-d044bd1a364b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:14 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53dc4983-01d3-4c98-98dd-71bfa451b8d6 tempest-VolumeRetypeWithoutMigrationTest-398270416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37981d36-a0ac-43d8-90a1-d044bd1a364b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:20:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1265048316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6588542e-3597-430a-9ea9-78f074462396,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c9ef65c219d41bbb13755040e9b1a4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:14Z,use_quota=True,user_id='c1c34f5c8d834a6cac8ef2435f169a66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e37b16c3-b7b2-4d11-ae40-c065a8f0e27d),volume_type_id=e37b16c3-b7b2-4d11-ae40-c065a8f0e27d)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:14 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53dc4983-01d3-4c98-98dd-71bfa451b8d6 tempest-VolumeRetypeWithoutMigrationTest-398270416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77236f28-37d0-4397-8322-618177cc7043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:14 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53dc4983-01d3-4c98-98dd-71bfa451b8d6 tempest-VolumeRetypeWithoutMigrationTest-398270416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77236f28-37d0-4397-8322-618177cc7043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:14 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53dc4983-01d3-4c98-98dd-71bfa451b8d6 tempest-VolumeRetypeWithoutMigrationTest-398270416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7bdfd44-6e43-4f7b-9803-277a6123a1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:14 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53dc4983-01d3-4c98-98dd-71bfa451b8d6 tempest-VolumeRetypeWithoutMigrationTest-398270416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7bdfd44-6e43-4f7b-9803-277a6123a1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6588542e-3597-430a-9ea9-78f074462396', 'volume_name': 'volume-6588542e-3597-430a-9ea9-78f074462396', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:14 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53dc4983-01d3-4c98-98dd-71bfa451b8d6 tempest-VolumeRetypeWithoutMigrationTest-398270416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04c1560e-27dc-4acb-aa18-ef9cde07b474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:14 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53dc4983-01d3-4c98-98dd-71bfa451b8d6 tempest-VolumeRetypeWithoutMigrationTest-398270416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04c1560e-27dc-4acb-aa18-ef9cde07b474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:14 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53dc4983-01d3-4c98-98dd-71bfa451b8d6 tempest-VolumeRetypeWithoutMigrationTest-398270416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62b5d527-4b52-4f8d-9e15-7e5a9e4f2b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:14 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-53dc4983-01d3-4c98-98dd-71bfa451b8d6 tempest-VolumeRetypeWithoutMigrationTest-398270416 None] Volume 6588542e-3597-430a-9ea9-78f074462396: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6588542e-3597-430a-9ea9-78f074462396', 'volume_size': 1} Sep 23 00:20:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-53dc4983-01d3-4c98-98dd-71bfa451b8d6 tempest-VolumeRetypeWithoutMigrationTest-398270416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-53dc4983-01d3-4c98-98dd-71bfa451b8d6 tempest-VolumeRetypeWithoutMigrationTest-398270416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:14 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-53dc4983-01d3-4c98-98dd-71bfa451b8d6 tempest-VolumeRetypeWithoutMigrationTest-398270416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:20:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1265048316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6588542e-3597-430a-9ea9-78f074462396,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c9ef65c219d41bbb13755040e9b1a4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:14Z,use_quota=True,user_id='c1c34f5c8d834a6cac8ef2435f169a66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e37b16c3-b7b2-4d11-ae40-c065a8f0e27d),volume_type_id=e37b16c3-b7b2-4d11-ae40-c065a8f0e27d)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:20:14 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-53dc4983-01d3-4c98-98dd-71bfa451b8d6 tempest-VolumeRetypeWithoutMigrationTest-398270416 None] Creating volume 6588542e-3597-430a-9ea9-78f074462396 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:20:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-53dc4983-01d3-4c98-98dd-71bfa451b8d6 tempest-VolumeRetypeWithoutMigrationTest-398270416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-53dc4983-01d3-4c98-98dd-71bfa451b8d6 tempest-VolumeRetypeWithoutMigrationTest-398270416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:14 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-53dc4983-01d3-4c98-98dd-71bfa451b8d6 tempest-VolumeRetypeWithoutMigrationTest-398270416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:14 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-53dc4983-01d3-4c98-98dd-71bfa451b8d6 tempest-VolumeRetypeWithoutMigrationTest-398270416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-53dc4983-01d3-4c98-98dd-71bfa451b8d6 tempest-VolumeRetypeWithoutMigrationTest-398270416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:14 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-53dc4983-01d3-4c98-98dd-71bfa451b8d6 tempest-VolumeRetypeWithoutMigrationTest-398270416 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:20:14 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-53dc4983-01d3-4c98-98dd-71bfa451b8d6 tempest-VolumeRetypeWithoutMigrationTest-398270416 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:20:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-53dc4983-01d3-4c98-98dd-71bfa451b8d6 tempest-VolumeRetypeWithoutMigrationTest-398270416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6588542e-3597-430a-9ea9-78f074462396 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:14 devstack sudo[97143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6588542e-3597-430a-9ea9-78f074462396 1073741824 Sep 23 00:20:14 devstack sudo[97143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:15 devstack sudo[97143]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-53dc4983-01d3-4c98-98dd-71bfa451b8d6 tempest-VolumeRetypeWithoutMigrationTest-398270416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6588542e-3597-430a-9ea9-78f074462396 1073741824" returned: 0 in 0.721s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-53dc4983-01d3-4c98-98dd-71bfa451b8d6 tempest-VolumeRetypeWithoutMigrationTest-398270416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6588542e-3597-430a-9ea9-78f074462396 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:15 devstack sudo[97149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6588542e-3597-430a-9ea9-78f074462396 Sep 23 00:20:15 devstack sudo[97149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:15 devstack sudo[97149]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-53dc4983-01d3-4c98-98dd-71bfa451b8d6 tempest-VolumeRetypeWithoutMigrationTest-398270416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6588542e-3597-430a-9ea9-78f074462396" returned: 0 in 0.419s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:15 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-53dc4983-01d3-4c98-98dd-71bfa451b8d6 tempest-VolumeRetypeWithoutMigrationTest-398270416 None] <== create_volume: return (1223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:20:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-53dc4983-01d3-4c98-98dd-71bfa451b8d6 tempest-VolumeRetypeWithoutMigrationTest-398270416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.227s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:15 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=103,cinder:INSERT=33,cinder:UPDATE=127,cinder:DELETE=9 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:20:15 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53dc4983-01d3-4c98-98dd-71bfa451b8d6 tempest-VolumeRetypeWithoutMigrationTest-398270416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62b5d527-4b52-4f8d-9e15-7e5a9e4f2b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6588542e-3597-430a-9ea9-78f074462396', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:15 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53dc4983-01d3-4c98-98dd-71bfa451b8d6 tempest-VolumeRetypeWithoutMigrationTest-398270416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e963e7a-0fc2-4f6d-8101-a9493f18f41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:15 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=96,cinder:INSERT=32,cinder:UPDATE=126,cinder:DELETE=6 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:20:15 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-53dc4983-01d3-4c98-98dd-71bfa451b8d6 tempest-VolumeRetypeWithoutMigrationTest-398270416 None] Volume volume-6588542e-3597-430a-9ea9-78f074462396 (6588542e-3597-430a-9ea9-78f074462396): created successfully Sep 23 00:20:15 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53dc4983-01d3-4c98-98dd-71bfa451b8d6 tempest-VolumeRetypeWithoutMigrationTest-398270416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e963e7a-0fc2-4f6d-8101-a9493f18f41e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:15 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53dc4983-01d3-4c98-98dd-71bfa451b8d6 tempest-VolumeRetypeWithoutMigrationTest-398270416 None] Flow 'volume_create_manager' (8f479743-c380-48c2-82a0-07049477c107) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:20:15 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-53dc4983-01d3-4c98-98dd-71bfa451b8d6 tempest-VolumeRetypeWithoutMigrationTest-398270416 None] Created volume successfully. Sep 23 00:20:16 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:20:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:16 devstack sudo[97154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:20:16 devstack sudo[97154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:17 devstack sudo[97154]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.438s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:17 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:20:17 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running periodic task VolumeManager._thread_info {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:20:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] thread count: 29 {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:20:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] thread info: [<_MainThread(MainThread, started 135440660459648)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:20:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-049abd72-e1a7-4c3f-9c68-0359712c63be tempest-VolumeRetypeWithoutMigrationTest-398270416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-049abd72-e1a7-4c3f-9c68-0359712c63be tempest-VolumeRetypeWithoutMigrationTest-398270416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:17 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-049abd72-e1a7-4c3f-9c68-0359712c63be tempest-VolumeRetypeWithoutMigrationTest-398270416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:17 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-049abd72-e1a7-4c3f-9c68-0359712c63be tempest-VolumeRetypeWithoutMigrationTest-398270416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-049abd72-e1a7-4c3f-9c68-0359712c63be tempest-VolumeRetypeWithoutMigrationTest-398270416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-049abd72-e1a7-4c3f-9c68-0359712c63be tempest-VolumeRetypeWithoutMigrationTest-398270416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:17 devstack sudo[97157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:20:17 devstack sudo[97157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:17 devstack sudo[97157]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-049abd72-e1a7-4c3f-9c68-0359712c63be tempest-VolumeRetypeWithoutMigrationTest-398270416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.405s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:17 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-049abd72-e1a7-4c3f-9c68-0359712c63be tempest-VolumeRetypeWithoutMigrationTest-398270416 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:20:17 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-049abd72-e1a7-4c3f-9c68-0359712c63be tempest-VolumeRetypeWithoutMigrationTest-398270416 None] Retype volume completed successfully. Sep 23 00:20:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a4fff90f-08e6-44c8-9239-bc1e7a0372ce tempest-VolumeRetypeWithoutMigrationTest-398270416 None] Acquiring lock "cinder-6588542e-3597-430a-9ea9-78f074462396-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a4fff90f-08e6-44c8-9239-bc1e7a0372ce tempest-VolumeRetypeWithoutMigrationTest-398270416 None] Lock "cinder-6588542e-3597-430a-9ea9-78f074462396-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a4fff90f-08e6-44c8-9239-bc1e7a0372ce tempest-VolumeRetypeWithoutMigrationTest-398270416 None] Acquiring lock "cinder-quobyte-6588542e-3597-430a-9ea9-78f074462396" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a4fff90f-08e6-44c8-9239-bc1e7a0372ce tempest-VolumeRetypeWithoutMigrationTest-398270416 None] Lock "cinder-quobyte-6588542e-3597-430a-9ea9-78f074462396" acquired by "delete_volume" :: waited 0.036s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:19 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[07cd1da5-3dd9-4188-99e6-156d9e50c669]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a4fff90f-08e6-44c8-9239-bc1e7a0372ce tempest-VolumeRetypeWithoutMigrationTest-398270416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6588542e-3597-430a-9ea9-78f074462396 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:19 devstack sudo[97160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6588542e-3597-430a-9ea9-78f074462396 Sep 23 00:20:19 devstack sudo[97160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:19 devstack sudo[97160]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a4fff90f-08e6-44c8-9239-bc1e7a0372ce tempest-VolumeRetypeWithoutMigrationTest-398270416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6588542e-3597-430a-9ea9-78f074462396" returned: 0 in 0.657s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a4fff90f-08e6-44c8-9239-bc1e7a0372ce tempest-VolumeRetypeWithoutMigrationTest-398270416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6588542e-3597-430a-9ea9-78f074462396 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:19 devstack sudo[97165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6588542e-3597-430a-9ea9-78f074462396 Sep 23 00:20:19 devstack sudo[97165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:20 devstack sudo[97165]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a4fff90f-08e6-44c8-9239-bc1e7a0372ce tempest-VolumeRetypeWithoutMigrationTest-398270416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6588542e-3597-430a-9ea9-78f074462396" returned: 0 in 0.492s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:20 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a4fff90f-08e6-44c8-9239-bc1e7a0372ce tempest-VolumeRetypeWithoutMigrationTest-398270416 None] Lock "cinder-quobyte-6588542e-3597-430a-9ea9-78f074462396" released by "delete_volume" :: held 1.230s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:20 devstack cinder-volume[86591]: WARNING cinder.quota [None req-a4fff90f-08e6-44c8-9239-bc1e7a0372ce tempest-VolumeRetypeWithoutMigrationTest-398270416 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:20:20 devstack cinder-volume[86591]: WARNING cinder.quota [None req-a4fff90f-08e6-44c8-9239-bc1e7a0372ce tempest-VolumeRetypeWithoutMigrationTest-398270416 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:20:20 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-a4fff90f-08e6-44c8-9239-bc1e7a0372ce tempest-VolumeRetypeWithoutMigrationTest-398270416 None] Created reservations ['37d1995d-233a-4f34-8f99-337947f5fcd9', '5b3783de-2942-4125-aa2a-1aa03a2831ae', 'dddd139d-e115-42da-a876-f53a68436c11', '57b0a84f-2621-4472-8735-85a0abc831c8'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:20:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a4fff90f-08e6-44c8-9239-bc1e7a0372ce tempest-VolumeRetypeWithoutMigrationTest-398270416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a4fff90f-08e6-44c8-9239-bc1e7a0372ce tempest-VolumeRetypeWithoutMigrationTest-398270416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:20 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a4fff90f-08e6-44c8-9239-bc1e7a0372ce tempest-VolumeRetypeWithoutMigrationTest-398270416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:20 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a4fff90f-08e6-44c8-9239-bc1e7a0372ce tempest-VolumeRetypeWithoutMigrationTest-398270416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a4fff90f-08e6-44c8-9239-bc1e7a0372ce tempest-VolumeRetypeWithoutMigrationTest-398270416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a4fff90f-08e6-44c8-9239-bc1e7a0372ce tempest-VolumeRetypeWithoutMigrationTest-398270416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:20 devstack sudo[97168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:20:20 devstack sudo[97168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:20 devstack sudo[97168]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a4fff90f-08e6-44c8-9239-bc1e7a0372ce tempest-VolumeRetypeWithoutMigrationTest-398270416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.291s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:20 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-a4fff90f-08e6-44c8-9239-bc1e7a0372ce tempest-VolumeRetypeWithoutMigrationTest-398270416 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:20:20 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-a4fff90f-08e6-44c8-9239-bc1e7a0372ce tempest-VolumeRetypeWithoutMigrationTest-398270416 None] Deleted volume successfully. Sep 23 00:20:20 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a4fff90f-08e6-44c8-9239-bc1e7a0372ce tempest-VolumeRetypeWithoutMigrationTest-398270416 None] Lock "cinder-6588542e-3597-430a-9ea9-78f074462396-delete_volume" released by "delete_volume" :: held 1.927s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:26 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-a23ac148-f41f-4839-bfb8-6a3f1bae42ad req-1be128f7-838c-40a9-b70b-ac845221fbd7 tempest-AttachVolumeTestJSON-1775429087 None] Terminate volume connection completed successfully. Sep 23 00:20:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-a23ac148-f41f-4839-bfb8-6a3f1bae42ad req-1be128f7-838c-40a9-b70b-ac845221fbd7 tempest-AttachVolumeTestJSON-1775429087 None] Deleting attachment 6697c454-e0dc-42df-b7dd-df61cd07813d. {{(pid=86591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:20:33 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-d543957b-d8bb-47d6-b64f-9ea6a5e56d5b tempest-VolumeTypesAccessTest-19854647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:20:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d543957b-d8bb-47d6-b64f-9ea6a5e56d5b tempest-VolumeTypesAccessTest-19854647 None] Flow 'volume_create_manager' (29f9357d-f79f-48cb-ac20-6550617b6774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:20:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d543957b-d8bb-47d6-b64f-9ea6a5e56d5b tempest-VolumeTypesAccessTest-19854647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11a2a1f9-d646-4dc8-9ecd-675a7b50424a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d543957b-d8bb-47d6-b64f-9ea6a5e56d5b tempest-VolumeTypesAccessTest-19854647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11a2a1f9-d646-4dc8-9ecd-675a7b50424a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2141570621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e1ebc3c-8772-4c81-8b75-33a492d7a190,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c19286cf4f0499b81195443a4acc058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:34Z,use_quota=True,user_id='b62f09e9a9784473a26e5ecbceb47887',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc5cfb54-31a3-44a0-b2d4-b79de6b2680a),volume_type_id=bc5cfb54-31a3-44a0-b2d4-b79de6b2680a)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d543957b-d8bb-47d6-b64f-9ea6a5e56d5b tempest-VolumeTypesAccessTest-19854647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4f2b4f9-148d-4e5d-9974-3bf7f78a681f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d543957b-d8bb-47d6-b64f-9ea6a5e56d5b tempest-VolumeTypesAccessTest-19854647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4f2b4f9-148d-4e5d-9974-3bf7f78a681f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d543957b-d8bb-47d6-b64f-9ea6a5e56d5b tempest-VolumeTypesAccessTest-19854647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2a79578-bf46-4fc6-b602-4c7b0bbc0154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d543957b-d8bb-47d6-b64f-9ea6a5e56d5b tempest-VolumeTypesAccessTest-19854647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2a79578-bf46-4fc6-b602-4c7b0bbc0154) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e1ebc3c-8772-4c81-8b75-33a492d7a190', 'volume_name': 'volume-8e1ebc3c-8772-4c81-8b75-33a492d7a190', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d543957b-d8bb-47d6-b64f-9ea6a5e56d5b tempest-VolumeTypesAccessTest-19854647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f20b231-fbab-4ffd-a5bd-587b2e71315e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d543957b-d8bb-47d6-b64f-9ea6a5e56d5b tempest-VolumeTypesAccessTest-19854647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f20b231-fbab-4ffd-a5bd-587b2e71315e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d543957b-d8bb-47d6-b64f-9ea6a5e56d5b tempest-VolumeTypesAccessTest-19854647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f641303f-ff9e-41cf-9df3-462df55829f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:33 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-d543957b-d8bb-47d6-b64f-9ea6a5e56d5b tempest-VolumeTypesAccessTest-19854647 None] Volume 8e1ebc3c-8772-4c81-8b75-33a492d7a190: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e1ebc3c-8772-4c81-8b75-33a492d7a190', 'volume_size': 1} Sep 23 00:20:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d543957b-d8bb-47d6-b64f-9ea6a5e56d5b tempest-VolumeTypesAccessTest-19854647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d543957b-d8bb-47d6-b64f-9ea6a5e56d5b tempest-VolumeTypesAccessTest-19854647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:33 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d543957b-d8bb-47d6-b64f-9ea6a5e56d5b tempest-VolumeTypesAccessTest-19854647 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2141570621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e1ebc3c-8772-4c81-8b75-33a492d7a190,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c19286cf4f0499b81195443a4acc058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:34Z,use_quota=True,user_id='b62f09e9a9784473a26e5ecbceb47887',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc5cfb54-31a3-44a0-b2d4-b79de6b2680a),volume_type_id=bc5cfb54-31a3-44a0-b2d4-b79de6b2680a)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:20:33 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-d543957b-d8bb-47d6-b64f-9ea6a5e56d5b tempest-VolumeTypesAccessTest-19854647 None] Creating volume 8e1ebc3c-8772-4c81-8b75-33a492d7a190 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:20:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d543957b-d8bb-47d6-b64f-9ea6a5e56d5b tempest-VolumeTypesAccessTest-19854647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d543957b-d8bb-47d6-b64f-9ea6a5e56d5b tempest-VolumeTypesAccessTest-19854647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:33 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d543957b-d8bb-47d6-b64f-9ea6a5e56d5b tempest-VolumeTypesAccessTest-19854647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:33 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d543957b-d8bb-47d6-b64f-9ea6a5e56d5b tempest-VolumeTypesAccessTest-19854647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d543957b-d8bb-47d6-b64f-9ea6a5e56d5b tempest-VolumeTypesAccessTest-19854647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:33 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d543957b-d8bb-47d6-b64f-9ea6a5e56d5b tempest-VolumeTypesAccessTest-19854647 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:20:33 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-d543957b-d8bb-47d6-b64f-9ea6a5e56d5b tempest-VolumeTypesAccessTest-19854647 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:20:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d543957b-d8bb-47d6-b64f-9ea6a5e56d5b tempest-VolumeTypesAccessTest-19854647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8e1ebc3c-8772-4c81-8b75-33a492d7a190 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:33 devstack sudo[97180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8e1ebc3c-8772-4c81-8b75-33a492d7a190 1073741824 Sep 23 00:20:33 devstack sudo[97180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:34 devstack sudo[97180]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d543957b-d8bb-47d6-b64f-9ea6a5e56d5b tempest-VolumeTypesAccessTest-19854647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8e1ebc3c-8772-4c81-8b75-33a492d7a190 1073741824" returned: 0 in 0.738s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d543957b-d8bb-47d6-b64f-9ea6a5e56d5b tempest-VolumeTypesAccessTest-19854647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8e1ebc3c-8772-4c81-8b75-33a492d7a190 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:34 devstack sudo[97186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8e1ebc3c-8772-4c81-8b75-33a492d7a190 Sep 23 00:20:34 devstack sudo[97186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:35 devstack sudo[97186]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d543957b-d8bb-47d6-b64f-9ea6a5e56d5b tempest-VolumeTypesAccessTest-19854647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8e1ebc3c-8772-4c81-8b75-33a492d7a190" returned: 0 in 0.420s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:35 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d543957b-d8bb-47d6-b64f-9ea6a5e56d5b tempest-VolumeTypesAccessTest-19854647 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:20:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d543957b-d8bb-47d6-b64f-9ea6a5e56d5b tempest-VolumeTypesAccessTest-19854647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.238s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d543957b-d8bb-47d6-b64f-9ea6a5e56d5b tempest-VolumeTypesAccessTest-19854647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f641303f-ff9e-41cf-9df3-462df55829f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e1ebc3c-8772-4c81-8b75-33a492d7a190', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d543957b-d8bb-47d6-b64f-9ea6a5e56d5b tempest-VolumeTypesAccessTest-19854647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (305aaf21-a701-4bf4-b1d8-199370cf6af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:35 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-d543957b-d8bb-47d6-b64f-9ea6a5e56d5b tempest-VolumeTypesAccessTest-19854647 None] Volume volume-8e1ebc3c-8772-4c81-8b75-33a492d7a190 (8e1ebc3c-8772-4c81-8b75-33a492d7a190): created successfully Sep 23 00:20:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d543957b-d8bb-47d6-b64f-9ea6a5e56d5b tempest-VolumeTypesAccessTest-19854647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (305aaf21-a701-4bf4-b1d8-199370cf6af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d543957b-d8bb-47d6-b64f-9ea6a5e56d5b tempest-VolumeTypesAccessTest-19854647 None] Flow 'volume_create_manager' (29f9357d-f79f-48cb-ac20-6550617b6774) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:20:35 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-d543957b-d8bb-47d6-b64f-9ea6a5e56d5b tempest-VolumeTypesAccessTest-19854647 None] Created volume successfully. Sep 23 00:20:36 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-07188d87-ad4b-459d-8ba8-1e97037d70e8 tempest-VolumeTypesAccessTest-19854647 None] Acquiring lock "cinder-8e1ebc3c-8772-4c81-8b75-33a492d7a190-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:36 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-07188d87-ad4b-459d-8ba8-1e97037d70e8 tempest-VolumeTypesAccessTest-19854647 None] Lock "cinder-8e1ebc3c-8772-4c81-8b75-33a492d7a190-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:36 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-07188d87-ad4b-459d-8ba8-1e97037d70e8 tempest-VolumeTypesAccessTest-19854647 None] Acquiring lock "cinder-quobyte-8e1ebc3c-8772-4c81-8b75-33a492d7a190" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:36 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-07188d87-ad4b-459d-8ba8-1e97037d70e8 tempest-VolumeTypesAccessTest-19854647 None] Lock "cinder-quobyte-8e1ebc3c-8772-4c81-8b75-33a492d7a190" acquired by "delete_volume" :: waited 0.015s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:36 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87c35e4-d9e5-4b56-a3cf-598a2b18dad4]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-07188d87-ad4b-459d-8ba8-1e97037d70e8 tempest-VolumeTypesAccessTest-19854647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8e1ebc3c-8772-4c81-8b75-33a492d7a190 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:36 devstack sudo[97189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8e1ebc3c-8772-4c81-8b75-33a492d7a190 Sep 23 00:20:36 devstack sudo[97189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:36 devstack sudo[97189]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-07188d87-ad4b-459d-8ba8-1e97037d70e8 tempest-VolumeTypesAccessTest-19854647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8e1ebc3c-8772-4c81-8b75-33a492d7a190" returned: 0 in 0.525s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-07188d87-ad4b-459d-8ba8-1e97037d70e8 tempest-VolumeTypesAccessTest-19854647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8e1ebc3c-8772-4c81-8b75-33a492d7a190 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:36 devstack sudo[97195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8e1ebc3c-8772-4c81-8b75-33a492d7a190 Sep 23 00:20:36 devstack sudo[97195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:37 devstack sudo[97195]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-07188d87-ad4b-459d-8ba8-1e97037d70e8 tempest-VolumeTypesAccessTest-19854647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8e1ebc3c-8772-4c81-8b75-33a492d7a190" returned: 0 in 0.374s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:37 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-07188d87-ad4b-459d-8ba8-1e97037d70e8 tempest-VolumeTypesAccessTest-19854647 None] Lock "cinder-quobyte-8e1ebc3c-8772-4c81-8b75-33a492d7a190" released by "delete_volume" :: held 0.972s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:37 devstack cinder-volume[86591]: WARNING cinder.quota [None req-07188d87-ad4b-459d-8ba8-1e97037d70e8 tempest-VolumeTypesAccessTest-19854647 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-270717654 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-270717654, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:20:37 devstack cinder-volume[86591]: WARNING cinder.quota [None req-07188d87-ad4b-459d-8ba8-1e97037d70e8 tempest-VolumeTypesAccessTest-19854647 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-270717654 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-270717654, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:20:37 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-07188d87-ad4b-459d-8ba8-1e97037d70e8 tempest-VolumeTypesAccessTest-19854647 None] Created reservations ['9d83cce6-902e-42fa-bb32-08d9ec8a07d6', '7385b6c6-6be0-4b00-adb5-b0e44a446802', '0937dc8a-67ca-4d90-90a8-c6738ec12cd9', 'edc51bcb-e36f-4391-be94-062cf16a1047'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:20:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-07188d87-ad4b-459d-8ba8-1e97037d70e8 tempest-VolumeTypesAccessTest-19854647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-07188d87-ad4b-459d-8ba8-1e97037d70e8 tempest-VolumeTypesAccessTest-19854647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-07188d87-ad4b-459d-8ba8-1e97037d70e8 tempest-VolumeTypesAccessTest-19854647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-07188d87-ad4b-459d-8ba8-1e97037d70e8 tempest-VolumeTypesAccessTest-19854647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-07188d87-ad4b-459d-8ba8-1e97037d70e8 tempest-VolumeTypesAccessTest-19854647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-07188d87-ad4b-459d-8ba8-1e97037d70e8 tempest-VolumeTypesAccessTest-19854647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:37 devstack sudo[97198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:20:37 devstack sudo[97198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:37 devstack sudo[97198]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-07188d87-ad4b-459d-8ba8-1e97037d70e8 tempest-VolumeTypesAccessTest-19854647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.328s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:37 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-07188d87-ad4b-459d-8ba8-1e97037d70e8 tempest-VolumeTypesAccessTest-19854647 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:20:37 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-07188d87-ad4b-459d-8ba8-1e97037d70e8 tempest-VolumeTypesAccessTest-19854647 None] Deleted volume successfully. Sep 23 00:20:37 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-07188d87-ad4b-459d-8ba8-1e97037d70e8 tempest-VolumeTypesAccessTest-19854647 None] Lock "cinder-8e1ebc3c-8772-4c81-8b75-33a492d7a190-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:46 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-e561471b-f7e5-45b8-ad85-621bf1b9c79d tempest-TestServerVolumeAttachmentScenario-1621019023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:20:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e561471b-f7e5-45b8-ad85-621bf1b9c79d tempest-TestServerVolumeAttachmentScenario-1621019023 None] Flow 'volume_create_manager' (bae96bd3-cddd-4019-ac83-29ce4b3e51c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:20:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e561471b-f7e5-45b8-ad85-621bf1b9c79d tempest-TestServerVolumeAttachmentScenario-1621019023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61eb308c-9f96-4b7f-ba53-fad21cc4ac53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e561471b-f7e5-45b8-ad85-621bf1b9c79d tempest-TestServerVolumeAttachmentScenario-1621019023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61eb308c-9f96-4b7f-ba53-fad21cc4ac53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:20:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-480442531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64c3de24-4f62-4790-b61d-8332fa6761c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76a095f68a544293ade9ee13ebdde508',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:46Z,use_quota=True,user_id='75f009f3728a492395e8c282d243d5e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e561471b-f7e5-45b8-ad85-621bf1b9c79d tempest-TestServerVolumeAttachmentScenario-1621019023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5cafe5b-939d-4723-b1fa-9d32fde3a2e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e561471b-f7e5-45b8-ad85-621bf1b9c79d tempest-TestServerVolumeAttachmentScenario-1621019023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5cafe5b-939d-4723-b1fa-9d32fde3a2e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e561471b-f7e5-45b8-ad85-621bf1b9c79d tempest-TestServerVolumeAttachmentScenario-1621019023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (500aaf47-de7b-49e5-a98f-5e6ecea5d639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e561471b-f7e5-45b8-ad85-621bf1b9c79d tempest-TestServerVolumeAttachmentScenario-1621019023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (500aaf47-de7b-49e5-a98f-5e6ecea5d639) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64c3de24-4f62-4790-b61d-8332fa6761c1', 'volume_name': 'volume-64c3de24-4f62-4790-b61d-8332fa6761c1', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e561471b-f7e5-45b8-ad85-621bf1b9c79d tempest-TestServerVolumeAttachmentScenario-1621019023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a04931d7-ff7e-46d7-80ff-49c2c8d45c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e561471b-f7e5-45b8-ad85-621bf1b9c79d tempest-TestServerVolumeAttachmentScenario-1621019023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a04931d7-ff7e-46d7-80ff-49c2c8d45c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e561471b-f7e5-45b8-ad85-621bf1b9c79d tempest-TestServerVolumeAttachmentScenario-1621019023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87427d4e-72b9-402e-a973-a6eb4e6fa7d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:46 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-e561471b-f7e5-45b8-ad85-621bf1b9c79d tempest-TestServerVolumeAttachmentScenario-1621019023 None] Volume 64c3de24-4f62-4790-b61d-8332fa6761c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64c3de24-4f62-4790-b61d-8332fa6761c1', 'volume_size': 1} Sep 23 00:20:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e561471b-f7e5-45b8-ad85-621bf1b9c79d tempest-TestServerVolumeAttachmentScenario-1621019023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e561471b-f7e5-45b8-ad85-621bf1b9c79d tempest-TestServerVolumeAttachmentScenario-1621019023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e561471b-f7e5-45b8-ad85-621bf1b9c79d tempest-TestServerVolumeAttachmentScenario-1621019023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:20:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-480442531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64c3de24-4f62-4790-b61d-8332fa6761c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76a095f68a544293ade9ee13ebdde508',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:46Z,use_quota=True,user_id='75f009f3728a492395e8c282d243d5e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:20:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-e561471b-f7e5-45b8-ad85-621bf1b9c79d tempest-TestServerVolumeAttachmentScenario-1621019023 None] Creating volume 64c3de24-4f62-4790-b61d-8332fa6761c1 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:20:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e561471b-f7e5-45b8-ad85-621bf1b9c79d tempest-TestServerVolumeAttachmentScenario-1621019023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e561471b-f7e5-45b8-ad85-621bf1b9c79d tempest-TestServerVolumeAttachmentScenario-1621019023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e561471b-f7e5-45b8-ad85-621bf1b9c79d tempest-TestServerVolumeAttachmentScenario-1621019023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e561471b-f7e5-45b8-ad85-621bf1b9c79d tempest-TestServerVolumeAttachmentScenario-1621019023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e561471b-f7e5-45b8-ad85-621bf1b9c79d tempest-TestServerVolumeAttachmentScenario-1621019023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e561471b-f7e5-45b8-ad85-621bf1b9c79d tempest-TestServerVolumeAttachmentScenario-1621019023 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:20:46 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-e561471b-f7e5-45b8-ad85-621bf1b9c79d tempest-TestServerVolumeAttachmentScenario-1621019023 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:20:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e561471b-f7e5-45b8-ad85-621bf1b9c79d tempest-TestServerVolumeAttachmentScenario-1621019023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-64c3de24-4f62-4790-b61d-8332fa6761c1 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:46 devstack sudo[97202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-64c3de24-4f62-4790-b61d-8332fa6761c1 1073741824 Sep 23 00:20:46 devstack sudo[97202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:47 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-8806aa72-9df5-480f-bf78-6a751bbcac1d tempest-TestServerVolumeAttachmentScenario-1621019023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:20:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8806aa72-9df5-480f-bf78-6a751bbcac1d tempest-TestServerVolumeAttachmentScenario-1621019023 None] Flow 'volume_create_manager' (fc2eee44-eba7-46d4-8477-f93d140173dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:20:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8806aa72-9df5-480f-bf78-6a751bbcac1d tempest-TestServerVolumeAttachmentScenario-1621019023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7f8a9ef-bf8a-48de-b95f-54d4f6cc3b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8806aa72-9df5-480f-bf78-6a751bbcac1d tempest-TestServerVolumeAttachmentScenario-1621019023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7f8a9ef-bf8a-48de-b95f-54d4f6cc3b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-672205626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8770a6b0-2354-4861-8d3a-07542e2d75b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76a095f68a544293ade9ee13ebdde508',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:47Z,use_quota=True,user_id='75f009f3728a492395e8c282d243d5e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8806aa72-9df5-480f-bf78-6a751bbcac1d tempest-TestServerVolumeAttachmentScenario-1621019023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f19ff0bc-4d29-4dd4-bcd7-6caa8dff4871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8806aa72-9df5-480f-bf78-6a751bbcac1d tempest-TestServerVolumeAttachmentScenario-1621019023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f19ff0bc-4d29-4dd4-bcd7-6caa8dff4871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8806aa72-9df5-480f-bf78-6a751bbcac1d tempest-TestServerVolumeAttachmentScenario-1621019023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b97e3fe-a534-4364-a18b-f83a4a2aba43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8806aa72-9df5-480f-bf78-6a751bbcac1d tempest-TestServerVolumeAttachmentScenario-1621019023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b97e3fe-a534-4364-a18b-f83a4a2aba43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8770a6b0-2354-4861-8d3a-07542e2d75b2', 'volume_name': 'volume-8770a6b0-2354-4861-8d3a-07542e2d75b2', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8806aa72-9df5-480f-bf78-6a751bbcac1d tempest-TestServerVolumeAttachmentScenario-1621019023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e88dd29b-2ae1-46f8-bfe9-d346d6934a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8806aa72-9df5-480f-bf78-6a751bbcac1d tempest-TestServerVolumeAttachmentScenario-1621019023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e88dd29b-2ae1-46f8-bfe9-d346d6934a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8806aa72-9df5-480f-bf78-6a751bbcac1d tempest-TestServerVolumeAttachmentScenario-1621019023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01dee7f5-fb9e-456a-bb4f-c9ffe14c6533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:47 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-8806aa72-9df5-480f-bf78-6a751bbcac1d tempest-TestServerVolumeAttachmentScenario-1621019023 None] Volume 8770a6b0-2354-4861-8d3a-07542e2d75b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8770a6b0-2354-4861-8d3a-07542e2d75b2', 'volume_size': 1} Sep 23 00:20:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8806aa72-9df5-480f-bf78-6a751bbcac1d tempest-TestServerVolumeAttachmentScenario-1621019023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:47 devstack sudo[97202]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e561471b-f7e5-45b8-ad85-621bf1b9c79d tempest-TestServerVolumeAttachmentScenario-1621019023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-64c3de24-4f62-4790-b61d-8332fa6761c1 1073741824" returned: 0 in 0.750s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e561471b-f7e5-45b8-ad85-621bf1b9c79d tempest-TestServerVolumeAttachmentScenario-1621019023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-64c3de24-4f62-4790-b61d-8332fa6761c1 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:47 devstack sudo[97208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-64c3de24-4f62-4790-b61d-8332fa6761c1 Sep 23 00:20:47 devstack sudo[97208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:47 devstack sudo[97208]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e561471b-f7e5-45b8-ad85-621bf1b9c79d tempest-TestServerVolumeAttachmentScenario-1621019023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-64c3de24-4f62-4790-b61d-8332fa6761c1" returned: 0 in 0.321s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:47 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e561471b-f7e5-45b8-ad85-621bf1b9c79d tempest-TestServerVolumeAttachmentScenario-1621019023 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:20:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e561471b-f7e5-45b8-ad85-621bf1b9c79d tempest-TestServerVolumeAttachmentScenario-1621019023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8806aa72-9df5-480f-bf78-6a751bbcac1d tempest-TestServerVolumeAttachmentScenario-1621019023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.539s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:47 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-8806aa72-9df5-480f-bf78-6a751bbcac1d tempest-TestServerVolumeAttachmentScenario-1621019023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-672205626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8770a6b0-2354-4861-8d3a-07542e2d75b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76a095f68a544293ade9ee13ebdde508',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:47Z,use_quota=True,user_id='75f009f3728a492395e8c282d243d5e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:20:47 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-8806aa72-9df5-480f-bf78-6a751bbcac1d tempest-TestServerVolumeAttachmentScenario-1621019023 None] Creating volume 8770a6b0-2354-4861-8d3a-07542e2d75b2 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:20:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8806aa72-9df5-480f-bf78-6a751bbcac1d tempest-TestServerVolumeAttachmentScenario-1621019023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8806aa72-9df5-480f-bf78-6a751bbcac1d tempest-TestServerVolumeAttachmentScenario-1621019023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:47 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-8806aa72-9df5-480f-bf78-6a751bbcac1d tempest-TestServerVolumeAttachmentScenario-1621019023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:47 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-8806aa72-9df5-480f-bf78-6a751bbcac1d tempest-TestServerVolumeAttachmentScenario-1621019023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8806aa72-9df5-480f-bf78-6a751bbcac1d tempest-TestServerVolumeAttachmentScenario-1621019023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:47 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-8806aa72-9df5-480f-bf78-6a751bbcac1d tempest-TestServerVolumeAttachmentScenario-1621019023 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:20:47 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-8806aa72-9df5-480f-bf78-6a751bbcac1d tempest-TestServerVolumeAttachmentScenario-1621019023 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:20:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8806aa72-9df5-480f-bf78-6a751bbcac1d tempest-TestServerVolumeAttachmentScenario-1621019023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8770a6b0-2354-4861-8d3a-07542e2d75b2 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e561471b-f7e5-45b8-ad85-621bf1b9c79d tempest-TestServerVolumeAttachmentScenario-1621019023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87427d4e-72b9-402e-a973-a6eb4e6fa7d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64c3de24-4f62-4790-b61d-8332fa6761c1', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:47 devstack sudo[97211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8770a6b0-2354-4861-8d3a-07542e2d75b2 1073741824 Sep 23 00:20:47 devstack sudo[97211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e561471b-f7e5-45b8-ad85-621bf1b9c79d tempest-TestServerVolumeAttachmentScenario-1621019023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29e4ad83-6ee9-45a4-b4be-dca5977b56a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:47 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-e561471b-f7e5-45b8-ad85-621bf1b9c79d tempest-TestServerVolumeAttachmentScenario-1621019023 None] Volume volume-64c3de24-4f62-4790-b61d-8332fa6761c1 (64c3de24-4f62-4790-b61d-8332fa6761c1): created successfully Sep 23 00:20:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e561471b-f7e5-45b8-ad85-621bf1b9c79d tempest-TestServerVolumeAttachmentScenario-1621019023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29e4ad83-6ee9-45a4-b4be-dca5977b56a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e561471b-f7e5-45b8-ad85-621bf1b9c79d tempest-TestServerVolumeAttachmentScenario-1621019023 None] Flow 'volume_create_manager' (bae96bd3-cddd-4019-ac83-29ce4b3e51c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:20:47 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-e561471b-f7e5-45b8-ad85-621bf1b9c79d tempest-TestServerVolumeAttachmentScenario-1621019023 None] Created volume successfully. Sep 23 00:20:48 devstack sudo[97211]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8806aa72-9df5-480f-bf78-6a751bbcac1d tempest-TestServerVolumeAttachmentScenario-1621019023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8770a6b0-2354-4861-8d3a-07542e2d75b2 1073741824" returned: 0 in 0.642s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8806aa72-9df5-480f-bf78-6a751bbcac1d tempest-TestServerVolumeAttachmentScenario-1621019023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8770a6b0-2354-4861-8d3a-07542e2d75b2 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:48 devstack sudo[97217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8770a6b0-2354-4861-8d3a-07542e2d75b2 Sep 23 00:20:48 devstack sudo[97217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:48 devstack sudo[97217]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8806aa72-9df5-480f-bf78-6a751bbcac1d tempest-TestServerVolumeAttachmentScenario-1621019023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8770a6b0-2354-4861-8d3a-07542e2d75b2" returned: 0 in 0.425s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:48 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-8806aa72-9df5-480f-bf78-6a751bbcac1d tempest-TestServerVolumeAttachmentScenario-1621019023 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:20:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8806aa72-9df5-480f-bf78-6a751bbcac1d tempest-TestServerVolumeAttachmentScenario-1621019023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:48 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8806aa72-9df5-480f-bf78-6a751bbcac1d tempest-TestServerVolumeAttachmentScenario-1621019023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01dee7f5-fb9e-456a-bb4f-c9ffe14c6533) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8770a6b0-2354-4861-8d3a-07542e2d75b2', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8806aa72-9df5-480f-bf78-6a751bbcac1d tempest-TestServerVolumeAttachmentScenario-1621019023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0c781f6-b5cd-4a44-b54e-600006a40408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:49 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-8806aa72-9df5-480f-bf78-6a751bbcac1d tempest-TestServerVolumeAttachmentScenario-1621019023 None] Volume volume-8770a6b0-2354-4861-8d3a-07542e2d75b2 (8770a6b0-2354-4861-8d3a-07542e2d75b2): created successfully Sep 23 00:20:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8806aa72-9df5-480f-bf78-6a751bbcac1d tempest-TestServerVolumeAttachmentScenario-1621019023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0c781f6-b5cd-4a44-b54e-600006a40408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8806aa72-9df5-480f-bf78-6a751bbcac1d tempest-TestServerVolumeAttachmentScenario-1621019023 None] Flow 'volume_create_manager' (fc2eee44-eba7-46d4-8477-f93d140173dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:20:49 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-8806aa72-9df5-480f-bf78-6a751bbcac1d tempest-TestServerVolumeAttachmentScenario-1621019023 None] Created volume successfully. Sep 23 00:21:05 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=20,cinder:UPDATE=33,cinder:INSERT=6,cinder:DELETE=3 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:21:05 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:UPDATE=28,cinder:DELETE=3,cinder:SELECT=29,cinder:INSERT=5 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:21:16 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:21:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:21:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:21:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:16 devstack sudo[97462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:21:16 devstack sudo[97462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:17 devstack sudo[97462]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 1.079s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:17 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:21:17 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running periodic task VolumeManager._thread_info {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:21:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] thread count: 29 {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:21:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] thread info: [<_MainThread(MainThread, started 135440660459648)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:21:39 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-f780117b-8e68-45e8-8ccf-703450ad88f1 tempest-VolumesMetadataTest-18950863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:21:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f780117b-8e68-45e8-8ccf-703450ad88f1 tempest-VolumesMetadataTest-18950863 None] Flow 'volume_create_manager' (22ee6db0-557b-4d72-a874-28c5f7146fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:21:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f780117b-8e68-45e8-8ccf-703450ad88f1 tempest-VolumesMetadataTest-18950863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34cfade8-fe2b-441d-942d-abd76421bc0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f780117b-8e68-45e8-8ccf-703450ad88f1 tempest-VolumesMetadataTest-18950863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34cfade8-fe2b-441d-942d-abd76421bc0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:21:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-866615552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c621ea03-6466-44db-aafa-ec668209490c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18d1e6fb21324dec84e1d18f7239f472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:39Z,use_quota=True,user_id='39d4cc440f94415291d8daa69876246e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f780117b-8e68-45e8-8ccf-703450ad88f1 tempest-VolumesMetadataTest-18950863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39ceb6a1-5d44-4ea0-bc28-e5fb98bab682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f780117b-8e68-45e8-8ccf-703450ad88f1 tempest-VolumesMetadataTest-18950863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39ceb6a1-5d44-4ea0-bc28-e5fb98bab682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f780117b-8e68-45e8-8ccf-703450ad88f1 tempest-VolumesMetadataTest-18950863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef95af08-0a14-4bbf-a499-703045a7c7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f780117b-8e68-45e8-8ccf-703450ad88f1 tempest-VolumesMetadataTest-18950863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef95af08-0a14-4bbf-a499-703045a7c7e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c621ea03-6466-44db-aafa-ec668209490c', 'volume_name': 'volume-c621ea03-6466-44db-aafa-ec668209490c', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f780117b-8e68-45e8-8ccf-703450ad88f1 tempest-VolumesMetadataTest-18950863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61447f55-11aa-42df-a911-43cce08f4db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f780117b-8e68-45e8-8ccf-703450ad88f1 tempest-VolumesMetadataTest-18950863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61447f55-11aa-42df-a911-43cce08f4db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f780117b-8e68-45e8-8ccf-703450ad88f1 tempest-VolumesMetadataTest-18950863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49c2be32-db23-43f7-8bf7-a9812536f0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:39 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-f780117b-8e68-45e8-8ccf-703450ad88f1 tempest-VolumesMetadataTest-18950863 None] Volume c621ea03-6466-44db-aafa-ec668209490c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c621ea03-6466-44db-aafa-ec668209490c', 'volume_size': 1} Sep 23 00:21:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f780117b-8e68-45e8-8ccf-703450ad88f1 tempest-VolumesMetadataTest-18950863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f780117b-8e68-45e8-8ccf-703450ad88f1 tempest-VolumesMetadataTest-18950863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:39 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f780117b-8e68-45e8-8ccf-703450ad88f1 tempest-VolumesMetadataTest-18950863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:21:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-866615552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c621ea03-6466-44db-aafa-ec668209490c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18d1e6fb21324dec84e1d18f7239f472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:39Z,use_quota=True,user_id='39d4cc440f94415291d8daa69876246e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:21:39 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-f780117b-8e68-45e8-8ccf-703450ad88f1 tempest-VolumesMetadataTest-18950863 None] Creating volume c621ea03-6466-44db-aafa-ec668209490c {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:21:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f780117b-8e68-45e8-8ccf-703450ad88f1 tempest-VolumesMetadataTest-18950863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f780117b-8e68-45e8-8ccf-703450ad88f1 tempest-VolumesMetadataTest-18950863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:39 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f780117b-8e68-45e8-8ccf-703450ad88f1 tempest-VolumesMetadataTest-18950863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:21:39 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f780117b-8e68-45e8-8ccf-703450ad88f1 tempest-VolumesMetadataTest-18950863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:21:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f780117b-8e68-45e8-8ccf-703450ad88f1 tempest-VolumesMetadataTest-18950863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:39 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f780117b-8e68-45e8-8ccf-703450ad88f1 tempest-VolumesMetadataTest-18950863 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:21:39 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-f780117b-8e68-45e8-8ccf-703450ad88f1 tempest-VolumesMetadataTest-18950863 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:21:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f780117b-8e68-45e8-8ccf-703450ad88f1 tempest-VolumesMetadataTest-18950863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c621ea03-6466-44db-aafa-ec668209490c 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:39 devstack sudo[97635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c621ea03-6466-44db-aafa-ec668209490c 1073741824 Sep 23 00:21:39 devstack sudo[97635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:39 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-78c28c12-6381-4fff-b523-7f83e655f605 tempest-AttachVolumeTestJSON-1775429087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:21:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-78c28c12-6381-4fff-b523-7f83e655f605 tempest-AttachVolumeTestJSON-1775429087 None] Flow 'volume_create_manager' (5b800751-9453-4a19-ab46-6fdd140ef98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:21:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-78c28c12-6381-4fff-b523-7f83e655f605 tempest-AttachVolumeTestJSON-1775429087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e2406ef-b098-4950-b5f7-19b8a6779488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-78c28c12-6381-4fff-b523-7f83e655f605 tempest-AttachVolumeTestJSON-1775429087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e2406ef-b098-4950-b5f7-19b8a6779488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:21:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-8647472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e223c731-0c87-4b5e-8698-47dbb23a2225,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af53b1db3fee46049ab1e7d617ac9600',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:39Z,use_quota=True,user_id='2766cb7c74324c74a6c350b59e29f6f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-78c28c12-6381-4fff-b523-7f83e655f605 tempest-AttachVolumeTestJSON-1775429087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fada4acf-b02f-4363-8c3c-7596a19c8764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-78c28c12-6381-4fff-b523-7f83e655f605 tempest-AttachVolumeTestJSON-1775429087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fada4acf-b02f-4363-8c3c-7596a19c8764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-78c28c12-6381-4fff-b523-7f83e655f605 tempest-AttachVolumeTestJSON-1775429087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (825bed74-d731-4eef-93f7-02bc77d33726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-78c28c12-6381-4fff-b523-7f83e655f605 tempest-AttachVolumeTestJSON-1775429087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (825bed74-d731-4eef-93f7-02bc77d33726) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e223c731-0c87-4b5e-8698-47dbb23a2225', 'volume_name': 'volume-e223c731-0c87-4b5e-8698-47dbb23a2225', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-78c28c12-6381-4fff-b523-7f83e655f605 tempest-AttachVolumeTestJSON-1775429087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (359359ff-6214-4601-b0e7-4003f2a9c443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-78c28c12-6381-4fff-b523-7f83e655f605 tempest-AttachVolumeTestJSON-1775429087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (359359ff-6214-4601-b0e7-4003f2a9c443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-78c28c12-6381-4fff-b523-7f83e655f605 tempest-AttachVolumeTestJSON-1775429087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (192ada9e-011c-4569-ac20-35df4aefdbb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:39 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-78c28c12-6381-4fff-b523-7f83e655f605 tempest-AttachVolumeTestJSON-1775429087 None] Volume e223c731-0c87-4b5e-8698-47dbb23a2225: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e223c731-0c87-4b5e-8698-47dbb23a2225', 'volume_size': 1} Sep 23 00:21:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-78c28c12-6381-4fff-b523-7f83e655f605 tempest-AttachVolumeTestJSON-1775429087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:39 devstack sudo[97635]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f780117b-8e68-45e8-8ccf-703450ad88f1 tempest-VolumesMetadataTest-18950863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c621ea03-6466-44db-aafa-ec668209490c 1073741824" returned: 0 in 0.549s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f780117b-8e68-45e8-8ccf-703450ad88f1 tempest-VolumesMetadataTest-18950863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c621ea03-6466-44db-aafa-ec668209490c {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:40 devstack sudo[97641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c621ea03-6466-44db-aafa-ec668209490c Sep 23 00:21:40 devstack sudo[97641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:40 devstack sudo[97641]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f780117b-8e68-45e8-8ccf-703450ad88f1 tempest-VolumesMetadataTest-18950863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c621ea03-6466-44db-aafa-ec668209490c" returned: 0 in 0.290s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:40 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f780117b-8e68-45e8-8ccf-703450ad88f1 tempest-VolumesMetadataTest-18950863 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:21:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f780117b-8e68-45e8-8ccf-703450ad88f1 tempest-VolumesMetadataTest-18950863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-78c28c12-6381-4fff-b523-7f83e655f605 tempest-AttachVolumeTestJSON-1775429087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.618s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:40 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-78c28c12-6381-4fff-b523-7f83e655f605 tempest-AttachVolumeTestJSON-1775429087 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:21:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-8647472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e223c731-0c87-4b5e-8698-47dbb23a2225,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af53b1db3fee46049ab1e7d617ac9600',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:39Z,use_quota=True,user_id='2766cb7c74324c74a6c350b59e29f6f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:21:40 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-78c28c12-6381-4fff-b523-7f83e655f605 tempest-AttachVolumeTestJSON-1775429087 None] Creating volume e223c731-0c87-4b5e-8698-47dbb23a2225 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:21:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-78c28c12-6381-4fff-b523-7f83e655f605 tempest-AttachVolumeTestJSON-1775429087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-78c28c12-6381-4fff-b523-7f83e655f605 tempest-AttachVolumeTestJSON-1775429087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:40 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-78c28c12-6381-4fff-b523-7f83e655f605 tempest-AttachVolumeTestJSON-1775429087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:21:40 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-78c28c12-6381-4fff-b523-7f83e655f605 tempest-AttachVolumeTestJSON-1775429087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:21:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-78c28c12-6381-4fff-b523-7f83e655f605 tempest-AttachVolumeTestJSON-1775429087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:40 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-78c28c12-6381-4fff-b523-7f83e655f605 tempest-AttachVolumeTestJSON-1775429087 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:21:40 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-78c28c12-6381-4fff-b523-7f83e655f605 tempest-AttachVolumeTestJSON-1775429087 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:21:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-78c28c12-6381-4fff-b523-7f83e655f605 tempest-AttachVolumeTestJSON-1775429087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e223c731-0c87-4b5e-8698-47dbb23a2225 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:40 devstack sudo[97644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e223c731-0c87-4b5e-8698-47dbb23a2225 1073741824 Sep 23 00:21:40 devstack sudo[97644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f780117b-8e68-45e8-8ccf-703450ad88f1 tempest-VolumesMetadataTest-18950863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49c2be32-db23-43f7-8bf7-a9812536f0ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c621ea03-6466-44db-aafa-ec668209490c', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f780117b-8e68-45e8-8ccf-703450ad88f1 tempest-VolumesMetadataTest-18950863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3df88ee-719b-467b-abc9-53a53239613d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:40 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-f780117b-8e68-45e8-8ccf-703450ad88f1 tempest-VolumesMetadataTest-18950863 None] Volume volume-c621ea03-6466-44db-aafa-ec668209490c (c621ea03-6466-44db-aafa-ec668209490c): created successfully Sep 23 00:21:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f780117b-8e68-45e8-8ccf-703450ad88f1 tempest-VolumesMetadataTest-18950863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3df88ee-719b-467b-abc9-53a53239613d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f780117b-8e68-45e8-8ccf-703450ad88f1 tempest-VolumesMetadataTest-18950863 None] Flow 'volume_create_manager' (22ee6db0-557b-4d72-a874-28c5f7146fed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:21:40 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-f780117b-8e68-45e8-8ccf-703450ad88f1 tempest-VolumesMetadataTest-18950863 None] Created volume successfully. Sep 23 00:21:40 devstack sudo[97644]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-78c28c12-6381-4fff-b523-7f83e655f605 tempest-AttachVolumeTestJSON-1775429087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e223c731-0c87-4b5e-8698-47dbb23a2225 1073741824" returned: 0 in 0.548s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-78c28c12-6381-4fff-b523-7f83e655f605 tempest-AttachVolumeTestJSON-1775429087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e223c731-0c87-4b5e-8698-47dbb23a2225 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:40 devstack sudo[97650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e223c731-0c87-4b5e-8698-47dbb23a2225 Sep 23 00:21:40 devstack sudo[97650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:41 devstack sudo[97650]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-78c28c12-6381-4fff-b523-7f83e655f605 tempest-AttachVolumeTestJSON-1775429087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e223c731-0c87-4b5e-8698-47dbb23a2225" returned: 0 in 0.315s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-78c28c12-6381-4fff-b523-7f83e655f605 tempest-AttachVolumeTestJSON-1775429087 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:21:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-78c28c12-6381-4fff-b523-7f83e655f605 tempest-AttachVolumeTestJSON-1775429087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-78c28c12-6381-4fff-b523-7f83e655f605 tempest-AttachVolumeTestJSON-1775429087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (192ada9e-011c-4569-ac20-35df4aefdbb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e223c731-0c87-4b5e-8698-47dbb23a2225', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-78c28c12-6381-4fff-b523-7f83e655f605 tempest-AttachVolumeTestJSON-1775429087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6899dfa-65fd-40a6-b64c-20768014ffaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:41 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-78c28c12-6381-4fff-b523-7f83e655f605 tempest-AttachVolumeTestJSON-1775429087 None] Volume volume-e223c731-0c87-4b5e-8698-47dbb23a2225 (e223c731-0c87-4b5e-8698-47dbb23a2225): created successfully Sep 23 00:21:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-78c28c12-6381-4fff-b523-7f83e655f605 tempest-AttachVolumeTestJSON-1775429087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6899dfa-65fd-40a6-b64c-20768014ffaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-78c28c12-6381-4fff-b523-7f83e655f605 tempest-AttachVolumeTestJSON-1775429087 None] Flow 'volume_create_manager' (5b800751-9453-4a19-ab46-6fdd140ef98d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:21:41 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-78c28c12-6381-4fff-b523-7f83e655f605 tempest-AttachVolumeTestJSON-1775429087 None] Created volume successfully. Sep 23 00:21:42 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9314ce93-b96b-4cfc-942c-e4d855283331 tempest-VolumesMetadataTest-18950863 None] Acquiring lock "cinder-c621ea03-6466-44db-aafa-ec668209490c-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:42 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9314ce93-b96b-4cfc-942c-e4d855283331 tempest-VolumesMetadataTest-18950863 None] Lock "cinder-c621ea03-6466-44db-aafa-ec668209490c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:42 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9314ce93-b96b-4cfc-942c-e4d855283331 tempest-VolumesMetadataTest-18950863 None] Acquiring lock "cinder-quobyte-c621ea03-6466-44db-aafa-ec668209490c" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:42 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9314ce93-b96b-4cfc-942c-e4d855283331 tempest-VolumesMetadataTest-18950863 None] Lock "cinder-quobyte-c621ea03-6466-44db-aafa-ec668209490c" acquired by "delete_volume" :: waited 0.023s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:42 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4e2b9b-d80b-48c0-9c75-d7d8b33a121e]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:21:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9314ce93-b96b-4cfc-942c-e4d855283331 tempest-VolumesMetadataTest-18950863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c621ea03-6466-44db-aafa-ec668209490c {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:42 devstack sudo[97656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c621ea03-6466-44db-aafa-ec668209490c Sep 23 00:21:42 devstack sudo[97656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-ba554455-38c3-4805-b2ef-56f1fcafa976 req-e99c195e-35ba-4a7e-a315-d13745aa9565 tempest-AttachVolumeTestJSON-1775429087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-ba554455-38c3-4805-b2ef-56f1fcafa976 req-e99c195e-35ba-4a7e-a315-d13745aa9565 tempest-AttachVolumeTestJSON-1775429087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-ba554455-38c3-4805-b2ef-56f1fcafa976 req-e99c195e-35ba-4a7e-a315-d13745aa9565 tempest-AttachVolumeTestJSON-1775429087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-ba554455-38c3-4805-b2ef-56f1fcafa976 req-e99c195e-35ba-4a7e-a315-d13745aa9565 tempest-AttachVolumeTestJSON-1775429087 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974', 'name': 'volume-e223c731-0c87-4b5e-8698-47dbb23a2225', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '544cddd7-4120-4418-b451-b260c3469c7e', 'enforce_multipath': True} {{(pid=86591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:21:42 devstack sudo[97656]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9314ce93-b96b-4cfc-942c-e4d855283331 tempest-VolumesMetadataTest-18950863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c621ea03-6466-44db-aafa-ec668209490c" returned: 0 in 0.456s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9314ce93-b96b-4cfc-942c-e4d855283331 tempest-VolumesMetadataTest-18950863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c621ea03-6466-44db-aafa-ec668209490c {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:42 devstack sudo[97669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c621ea03-6466-44db-aafa-ec668209490c Sep 23 00:21:42 devstack sudo[97669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:42 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-ba554455-38c3-4805-b2ef-56f1fcafa976 req-e99c195e-35ba-4a7e-a315-d13745aa9565 tempest-AttachVolumeTestJSON-1775429087 None] attachment_update completed successfully. Sep 23 00:21:43 devstack sudo[97669]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9314ce93-b96b-4cfc-942c-e4d855283331 tempest-VolumesMetadataTest-18950863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c621ea03-6466-44db-aafa-ec668209490c" returned: 0 in 0.353s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:43 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9314ce93-b96b-4cfc-942c-e4d855283331 tempest-VolumesMetadataTest-18950863 None] Lock "cinder-quobyte-c621ea03-6466-44db-aafa-ec668209490c" released by "delete_volume" :: held 0.865s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:43 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-9314ce93-b96b-4cfc-942c-e4d855283331 tempest-VolumesMetadataTest-18950863 None] Created reservations ['00f884da-1324-4010-a226-870e03b7a0fe', '4f0d4e6d-1118-4bae-add2-f13932e3f9c7', '7c607f8d-6985-4ada-b14c-9f6b6be226ef', '5eb45333-bea7-4a55-8fe2-7a45aad66f31'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:21:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9314ce93-b96b-4cfc-942c-e4d855283331 tempest-VolumesMetadataTest-18950863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9314ce93-b96b-4cfc-942c-e4d855283331 tempest-VolumesMetadataTest-18950863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:43 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9314ce93-b96b-4cfc-942c-e4d855283331 tempest-VolumesMetadataTest-18950863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:21:43 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9314ce93-b96b-4cfc-942c-e4d855283331 tempest-VolumesMetadataTest-18950863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:21:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9314ce93-b96b-4cfc-942c-e4d855283331 tempest-VolumesMetadataTest-18950863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9314ce93-b96b-4cfc-942c-e4d855283331 tempest-VolumesMetadataTest-18950863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:43 devstack sudo[98084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:21:43 devstack sudo[98084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:43 devstack sudo[98084]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9314ce93-b96b-4cfc-942c-e4d855283331 tempest-VolumesMetadataTest-18950863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.485s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:43 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-9314ce93-b96b-4cfc-942c-e4d855283331 tempest-VolumesMetadataTest-18950863 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:21:43 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-9314ce93-b96b-4cfc-942c-e4d855283331 tempest-VolumesMetadataTest-18950863 None] Deleted volume successfully. Sep 23 00:21:43 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9314ce93-b96b-4cfc-942c-e4d855283331 tempest-VolumesMetadataTest-18950863 None] Lock "cinder-c621ea03-6466-44db-aafa-ec668209490c-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:45 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d80812b-051c-4217-aa7f-60f0c0dfbdf8 tempest-AttachVolumeTestJSON-1775429087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:21:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7d80812b-051c-4217-aa7f-60f0c0dfbdf8 tempest-AttachVolumeTestJSON-1775429087 None] Flow 'volume_create_manager' (09013c06-adbd-4df5-9e20-399d456ad02c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:21:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7d80812b-051c-4217-aa7f-60f0c0dfbdf8 tempest-AttachVolumeTestJSON-1775429087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8d5b48e-9806-4acb-b4f9-39638f553b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7d80812b-051c-4217-aa7f-60f0c0dfbdf8 tempest-AttachVolumeTestJSON-1775429087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8d5b48e-9806-4acb-b4f9-39638f553b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:21:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1526907914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53575736-35c3-4ee0-b920-e54e6b941645,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af53b1db3fee46049ab1e7d617ac9600',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:46Z,use_quota=True,user_id='2766cb7c74324c74a6c350b59e29f6f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7d80812b-051c-4217-aa7f-60f0c0dfbdf8 tempest-AttachVolumeTestJSON-1775429087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f1a63eb-4b53-4cd4-a526-9376d7c41257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7d80812b-051c-4217-aa7f-60f0c0dfbdf8 tempest-AttachVolumeTestJSON-1775429087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f1a63eb-4b53-4cd4-a526-9376d7c41257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7d80812b-051c-4217-aa7f-60f0c0dfbdf8 tempest-AttachVolumeTestJSON-1775429087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5de52e28-305e-4ac3-83cd-36d8de58f5be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7d80812b-051c-4217-aa7f-60f0c0dfbdf8 tempest-AttachVolumeTestJSON-1775429087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5de52e28-305e-4ac3-83cd-36d8de58f5be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53575736-35c3-4ee0-b920-e54e6b941645', 'volume_name': 'volume-53575736-35c3-4ee0-b920-e54e6b941645', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7d80812b-051c-4217-aa7f-60f0c0dfbdf8 tempest-AttachVolumeTestJSON-1775429087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1c28c22-bfba-4b67-af12-3678871856ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7d80812b-051c-4217-aa7f-60f0c0dfbdf8 tempest-AttachVolumeTestJSON-1775429087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1c28c22-bfba-4b67-af12-3678871856ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7d80812b-051c-4217-aa7f-60f0c0dfbdf8 tempest-AttachVolumeTestJSON-1775429087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c92fea60-cb56-4b78-afca-0274ccba0649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:46 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-7d80812b-051c-4217-aa7f-60f0c0dfbdf8 tempest-AttachVolumeTestJSON-1775429087 None] Volume 53575736-35c3-4ee0-b920-e54e6b941645: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53575736-35c3-4ee0-b920-e54e6b941645', 'volume_size': 1} Sep 23 00:21:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7d80812b-051c-4217-aa7f-60f0c0dfbdf8 tempest-AttachVolumeTestJSON-1775429087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7d80812b-051c-4217-aa7f-60f0c0dfbdf8 tempest-AttachVolumeTestJSON-1775429087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7d80812b-051c-4217-aa7f-60f0c0dfbdf8 tempest-AttachVolumeTestJSON-1775429087 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:21:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1526907914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53575736-35c3-4ee0-b920-e54e6b941645,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af53b1db3fee46049ab1e7d617ac9600',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:46Z,use_quota=True,user_id='2766cb7c74324c74a6c350b59e29f6f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:21:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-7d80812b-051c-4217-aa7f-60f0c0dfbdf8 tempest-AttachVolumeTestJSON-1775429087 None] Creating volume 53575736-35c3-4ee0-b920-e54e6b941645 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:21:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7d80812b-051c-4217-aa7f-60f0c0dfbdf8 tempest-AttachVolumeTestJSON-1775429087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7d80812b-051c-4217-aa7f-60f0c0dfbdf8 tempest-AttachVolumeTestJSON-1775429087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7d80812b-051c-4217-aa7f-60f0c0dfbdf8 tempest-AttachVolumeTestJSON-1775429087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:21:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7d80812b-051c-4217-aa7f-60f0c0dfbdf8 tempest-AttachVolumeTestJSON-1775429087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:21:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7d80812b-051c-4217-aa7f-60f0c0dfbdf8 tempest-AttachVolumeTestJSON-1775429087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7d80812b-051c-4217-aa7f-60f0c0dfbdf8 tempest-AttachVolumeTestJSON-1775429087 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:21:46 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-7d80812b-051c-4217-aa7f-60f0c0dfbdf8 tempest-AttachVolumeTestJSON-1775429087 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:21:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7d80812b-051c-4217-aa7f-60f0c0dfbdf8 tempest-AttachVolumeTestJSON-1775429087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-53575736-35c3-4ee0-b920-e54e6b941645 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:46 devstack sudo[98101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-53575736-35c3-4ee0-b920-e54e6b941645 1073741824 Sep 23 00:21:46 devstack sudo[98101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-13631419-b5a4-4f6e-9559-9d6f1434abf7 req-3ecaa722-7f61-417e-b3ca-c236d6a48140 tempest-TestServerVolumeAttachmentScenario-1621019023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:46 devstack sudo[98101]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7d80812b-051c-4217-aa7f-60f0c0dfbdf8 tempest-AttachVolumeTestJSON-1775429087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-53575736-35c3-4ee0-b920-e54e6b941645 1073741824" returned: 0 in 0.776s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7d80812b-051c-4217-aa7f-60f0c0dfbdf8 tempest-AttachVolumeTestJSON-1775429087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-53575736-35c3-4ee0-b920-e54e6b941645 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:46 devstack sudo[98110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-53575736-35c3-4ee0-b920-e54e6b941645 Sep 23 00:21:46 devstack sudo[98110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:47 devstack sudo[98110]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7d80812b-051c-4217-aa7f-60f0c0dfbdf8 tempest-AttachVolumeTestJSON-1775429087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-53575736-35c3-4ee0-b920-e54e6b941645" returned: 0 in 0.363s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:47 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7d80812b-051c-4217-aa7f-60f0c0dfbdf8 tempest-AttachVolumeTestJSON-1775429087 None] <== create_volume: return (1211ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:21:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7d80812b-051c-4217-aa7f-60f0c0dfbdf8 tempest-AttachVolumeTestJSON-1775429087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.215s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-13631419-b5a4-4f6e-9559-9d6f1434abf7 req-3ecaa722-7f61-417e-b3ca-c236d6a48140 tempest-TestServerVolumeAttachmentScenario-1621019023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.063s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7d80812b-051c-4217-aa7f-60f0c0dfbdf8 tempest-AttachVolumeTestJSON-1775429087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c92fea60-cb56-4b78-afca-0274ccba0649) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53575736-35c3-4ee0-b920-e54e6b941645', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7d80812b-051c-4217-aa7f-60f0c0dfbdf8 tempest-AttachVolumeTestJSON-1775429087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dd4f7e7-c268-4601-a14e-a6ad8734c8aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-13631419-b5a4-4f6e-9559-9d6f1434abf7 req-3ecaa722-7f61-417e-b3ca-c236d6a48140 tempest-TestServerVolumeAttachmentScenario-1621019023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.051s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:47 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-7d80812b-051c-4217-aa7f-60f0c0dfbdf8 tempest-AttachVolumeTestJSON-1775429087 None] Volume volume-53575736-35c3-4ee0-b920-e54e6b941645 (53575736-35c3-4ee0-b920-e54e6b941645): created successfully Sep 23 00:21:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7d80812b-051c-4217-aa7f-60f0c0dfbdf8 tempest-AttachVolumeTestJSON-1775429087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dd4f7e7-c268-4601-a14e-a6ad8734c8aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7d80812b-051c-4217-aa7f-60f0c0dfbdf8 tempest-AttachVolumeTestJSON-1775429087 None] Flow 'volume_create_manager' (09013c06-adbd-4df5-9e20-399d456ad02c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:21:47 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-7d80812b-051c-4217-aa7f-60f0c0dfbdf8 tempest-AttachVolumeTestJSON-1775429087 None] Created volume successfully. Sep 23 00:21:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-13631419-b5a4-4f6e-9559-9d6f1434abf7 req-3ecaa722-7f61-417e-b3ca-c236d6a48140 tempest-TestServerVolumeAttachmentScenario-1621019023 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974', 'name': 'volume-64c3de24-4f62-4790-b61d-8332fa6761c1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c91a339b-6945-4ae2-b6c1-af85f8c44ad9', 'enforce_multipath': True} {{(pid=86591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:21:47 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-13631419-b5a4-4f6e-9559-9d6f1434abf7 req-3ecaa722-7f61-417e-b3ca-c236d6a48140 tempest-TestServerVolumeAttachmentScenario-1621019023 None] attachment_update completed successfully. Sep 23 00:21:48 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-739cd34d-6e30-4a59-bf3b-2fb2d8dbd488 tempest-TestServerVolumeAttachScenarioOldVersion-1146155017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:21:48 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-739cd34d-6e30-4a59-bf3b-2fb2d8dbd488 tempest-TestServerVolumeAttachScenarioOldVersion-1146155017 None] Flow 'volume_create_manager' (6325a9dd-24c4-48cd-84a3-f67a70281807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:21:48 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-739cd34d-6e30-4a59-bf3b-2fb2d8dbd488 tempest-TestServerVolumeAttachScenarioOldVersion-1146155017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b809e05-a3dd-4a08-9bd0-bfbcf4955757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:48 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-739cd34d-6e30-4a59-bf3b-2fb2d8dbd488 tempest-TestServerVolumeAttachScenarioOldVersion-1146155017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b809e05-a3dd-4a08-9bd0-bfbcf4955757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:21:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-954206074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33a81647-f265-4681-abb6-61a6cf6a6589,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1749553dbab5456693ca75aa3293a9d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:48Z,use_quota=True,user_id='8fba0da7e14e486a8c5a8dbba505850c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:48 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-739cd34d-6e30-4a59-bf3b-2fb2d8dbd488 tempest-TestServerVolumeAttachScenarioOldVersion-1146155017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b97f962f-9641-4c97-8415-69ef24c22680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:48 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-739cd34d-6e30-4a59-bf3b-2fb2d8dbd488 tempest-TestServerVolumeAttachScenarioOldVersion-1146155017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b97f962f-9641-4c97-8415-69ef24c22680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:48 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-739cd34d-6e30-4a59-bf3b-2fb2d8dbd488 tempest-TestServerVolumeAttachScenarioOldVersion-1146155017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e391d71e-7b79-4429-a9f6-b084b58a77c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:48 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-739cd34d-6e30-4a59-bf3b-2fb2d8dbd488 tempest-TestServerVolumeAttachScenarioOldVersion-1146155017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e391d71e-7b79-4429-a9f6-b084b58a77c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33a81647-f265-4681-abb6-61a6cf6a6589', 'volume_name': 'volume-33a81647-f265-4681-abb6-61a6cf6a6589', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:48 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-739cd34d-6e30-4a59-bf3b-2fb2d8dbd488 tempest-TestServerVolumeAttachScenarioOldVersion-1146155017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f02a5728-bef8-4f1d-8107-1a10aa639810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:48 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-739cd34d-6e30-4a59-bf3b-2fb2d8dbd488 tempest-TestServerVolumeAttachScenarioOldVersion-1146155017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f02a5728-bef8-4f1d-8107-1a10aa639810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:48 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-739cd34d-6e30-4a59-bf3b-2fb2d8dbd488 tempest-TestServerVolumeAttachScenarioOldVersion-1146155017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6405338c-6b62-4ffb-93aa-c48898f300c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:48 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-739cd34d-6e30-4a59-bf3b-2fb2d8dbd488 tempest-TestServerVolumeAttachScenarioOldVersion-1146155017 None] Volume 33a81647-f265-4681-abb6-61a6cf6a6589: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33a81647-f265-4681-abb6-61a6cf6a6589', 'volume_size': 1} Sep 23 00:21:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-739cd34d-6e30-4a59-bf3b-2fb2d8dbd488 tempest-TestServerVolumeAttachScenarioOldVersion-1146155017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-739cd34d-6e30-4a59-bf3b-2fb2d8dbd488 tempest-TestServerVolumeAttachScenarioOldVersion-1146155017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:48 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-739cd34d-6e30-4a59-bf3b-2fb2d8dbd488 tempest-TestServerVolumeAttachScenarioOldVersion-1146155017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:21:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-954206074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33a81647-f265-4681-abb6-61a6cf6a6589,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1749553dbab5456693ca75aa3293a9d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:48Z,use_quota=True,user_id='8fba0da7e14e486a8c5a8dbba505850c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:21:48 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-739cd34d-6e30-4a59-bf3b-2fb2d8dbd488 tempest-TestServerVolumeAttachScenarioOldVersion-1146155017 None] Creating volume 33a81647-f265-4681-abb6-61a6cf6a6589 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:21:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-739cd34d-6e30-4a59-bf3b-2fb2d8dbd488 tempest-TestServerVolumeAttachScenarioOldVersion-1146155017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-739cd34d-6e30-4a59-bf3b-2fb2d8dbd488 tempest-TestServerVolumeAttachScenarioOldVersion-1146155017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:48 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-739cd34d-6e30-4a59-bf3b-2fb2d8dbd488 tempest-TestServerVolumeAttachScenarioOldVersion-1146155017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:21:48 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-739cd34d-6e30-4a59-bf3b-2fb2d8dbd488 tempest-TestServerVolumeAttachScenarioOldVersion-1146155017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:21:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-739cd34d-6e30-4a59-bf3b-2fb2d8dbd488 tempest-TestServerVolumeAttachScenarioOldVersion-1146155017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:48 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-739cd34d-6e30-4a59-bf3b-2fb2d8dbd488 tempest-TestServerVolumeAttachScenarioOldVersion-1146155017 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:21:48 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-739cd34d-6e30-4a59-bf3b-2fb2d8dbd488 tempest-TestServerVolumeAttachScenarioOldVersion-1146155017 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:21:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-739cd34d-6e30-4a59-bf3b-2fb2d8dbd488 tempest-TestServerVolumeAttachScenarioOldVersion-1146155017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-33a81647-f265-4681-abb6-61a6cf6a6589 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:48 devstack sudo[98118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-33a81647-f265-4681-abb6-61a6cf6a6589 1073741824 Sep 23 00:21:48 devstack sudo[98118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:49 devstack sudo[98118]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-739cd34d-6e30-4a59-bf3b-2fb2d8dbd488 tempest-TestServerVolumeAttachScenarioOldVersion-1146155017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-33a81647-f265-4681-abb6-61a6cf6a6589 1073741824" returned: 0 in 0.743s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-910c0bf7-5f2e-448f-a542-3eea7496f887 req-1728a872-149b-4683-a7dd-5c4170a24835 tempest-AttachVolumeTestJSON-1775429087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-739cd34d-6e30-4a59-bf3b-2fb2d8dbd488 tempest-TestServerVolumeAttachScenarioOldVersion-1146155017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-33a81647-f265-4681-abb6-61a6cf6a6589 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:49 devstack sudo[98132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-33a81647-f265-4681-abb6-61a6cf6a6589 Sep 23 00:21:49 devstack sudo[98132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:49 devstack sudo[98132]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-739cd34d-6e30-4a59-bf3b-2fb2d8dbd488 tempest-TestServerVolumeAttachScenarioOldVersion-1146155017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-33a81647-f265-4681-abb6-61a6cf6a6589" returned: 0 in 0.314s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:49 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-739cd34d-6e30-4a59-bf3b-2fb2d8dbd488 tempest-TestServerVolumeAttachScenarioOldVersion-1146155017 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:21:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-739cd34d-6e30-4a59-bf3b-2fb2d8dbd488 tempest-TestServerVolumeAttachScenarioOldVersion-1146155017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-910c0bf7-5f2e-448f-a542-3eea7496f887 req-1728a872-149b-4683-a7dd-5c4170a24835 tempest-AttachVolumeTestJSON-1775429087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.362s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-739cd34d-6e30-4a59-bf3b-2fb2d8dbd488 tempest-TestServerVolumeAttachScenarioOldVersion-1146155017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6405338c-6b62-4ffb-93aa-c48898f300c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33a81647-f265-4681-abb6-61a6cf6a6589', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-739cd34d-6e30-4a59-bf3b-2fb2d8dbd488 tempest-TestServerVolumeAttachScenarioOldVersion-1146155017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03ea0af5-3ea9-4767-a009-d255fe27e7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-910c0bf7-5f2e-448f-a542-3eea7496f887 req-1728a872-149b-4683-a7dd-5c4170a24835 tempest-AttachVolumeTestJSON-1775429087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:49 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-739cd34d-6e30-4a59-bf3b-2fb2d8dbd488 tempest-TestServerVolumeAttachScenarioOldVersion-1146155017 None] Volume volume-33a81647-f265-4681-abb6-61a6cf6a6589 (33a81647-f265-4681-abb6-61a6cf6a6589): created successfully Sep 23 00:21:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-739cd34d-6e30-4a59-bf3b-2fb2d8dbd488 tempest-TestServerVolumeAttachScenarioOldVersion-1146155017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03ea0af5-3ea9-4767-a009-d255fe27e7e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-739cd34d-6e30-4a59-bf3b-2fb2d8dbd488 tempest-TestServerVolumeAttachScenarioOldVersion-1146155017 None] Flow 'volume_create_manager' (6325a9dd-24c4-48cd-84a3-f67a70281807) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:21:49 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-739cd34d-6e30-4a59-bf3b-2fb2d8dbd488 tempest-TestServerVolumeAttachScenarioOldVersion-1146155017 None] Created volume successfully. Sep 23 00:21:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-910c0bf7-5f2e-448f-a542-3eea7496f887 req-1728a872-149b-4683-a7dd-5c4170a24835 tempest-AttachVolumeTestJSON-1775429087 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974', 'name': 'volume-53575736-35c3-4ee0-b920-e54e6b941645', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '53d0bfab-933b-4226-98a4-09c5007dfea6', 'enforce_multipath': True} {{(pid=86591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:21:49 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-910c0bf7-5f2e-448f-a542-3eea7496f887 req-1728a872-149b-4683-a7dd-5c4170a24835 tempest-AttachVolumeTestJSON-1775429087 None] attachment_update completed successfully. Sep 23 00:21:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-1b8fc5ed-57f1-49eb-b612-c4d011f145f4 req-5505b880-2616-437a-a5b3-022e08b4ef70 tempest-TestServerVolumeAttachScenarioOldVersion-1146155017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-1b8fc5ed-57f1-49eb-b612-c4d011f145f4 req-5505b880-2616-437a-a5b3-022e08b4ef70 tempest-TestServerVolumeAttachScenarioOldVersion-1146155017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-1b8fc5ed-57f1-49eb-b612-c4d011f145f4 req-5505b880-2616-437a-a5b3-022e08b4ef70 tempest-TestServerVolumeAttachScenarioOldVersion-1146155017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-1b8fc5ed-57f1-49eb-b612-c4d011f145f4 req-5505b880-2616-437a-a5b3-022e08b4ef70 tempest-TestServerVolumeAttachScenarioOldVersion-1146155017 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974', 'name': 'volume-33a81647-f265-4681-abb6-61a6cf6a6589', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c9d71b11-ac7a-4811-9479-2c856c60a32d', 'enforce_multipath': True} {{(pid=86591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:21:51 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-1b8fc5ed-57f1-49eb-b612-c4d011f145f4 req-5505b880-2616-437a-a5b3-022e08b4ef70 tempest-TestServerVolumeAttachScenarioOldVersion-1146155017 None] attachment_update completed successfully. Sep 23 00:21:52 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-930ed511-b273-4a38-ab74-e76dcb96e85e req-4a2b8d41-005c-471f-ac9b-594d87a6ff5d tempest-AttachVolumeTestJSON-1775429087 None] Terminate volume connection completed successfully. Sep 23 00:21:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-930ed511-b273-4a38-ab74-e76dcb96e85e req-4a2b8d41-005c-471f-ac9b-594d87a6ff5d tempest-AttachVolumeTestJSON-1775429087 None] Deleting attachment 544cddd7-4120-4418-b451-b260c3469c7e. {{(pid=86591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:21:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-03358373-80f9-4315-965d-c0b05c74740f req-613a5eb8-72a0-4233-a2f9-4c6c0ea1370e tempest-TestServerVolumeAttachmentScenario-1621019023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-03358373-80f9-4315-965d-c0b05c74740f req-613a5eb8-72a0-4233-a2f9-4c6c0ea1370e tempest-TestServerVolumeAttachmentScenario-1621019023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-03358373-80f9-4315-965d-c0b05c74740f req-613a5eb8-72a0-4233-a2f9-4c6c0ea1370e tempest-TestServerVolumeAttachmentScenario-1621019023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-03358373-80f9-4315-965d-c0b05c74740f req-613a5eb8-72a0-4233-a2f9-4c6c0ea1370e tempest-TestServerVolumeAttachmentScenario-1621019023 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974', 'name': 'volume-8770a6b0-2354-4861-8d3a-07542e2d75b2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b5a0570c-ac32-4842-b6f0-10e85d3aca64', 'enforce_multipath': True} {{(pid=86591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:21:54 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-03358373-80f9-4315-965d-c0b05c74740f req-613a5eb8-72a0-4233-a2f9-4c6c0ea1370e tempest-TestServerVolumeAttachmentScenario-1621019023 None] attachment_update completed successfully. Sep 23 00:21:54 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-fd1fe755-a864-48e4-ab19-31f2e9c2cbb5 req-87e5e432-cfc8-4d2c-bca1-22dd22687e20 tempest-AttachVolumeTestJSON-1775429087 None] Terminate volume connection completed successfully. Sep 23 00:21:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-fd1fe755-a864-48e4-ab19-31f2e9c2cbb5 req-87e5e432-cfc8-4d2c-bca1-22dd22687e20 tempest-AttachVolumeTestJSON-1775429087 None] Deleting attachment 53d0bfab-933b-4226-98a4-09c5007dfea6. {{(pid=86591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:21:55 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-a85aacad-1387-4870-ac80-50dd0ad14f6c req-e56c54d6-c892-4e26-b79d-5434a37db7f0 tempest-TestServerVolumeAttachScenarioOldVersion-1146155017 None] Terminate volume connection completed successfully. Sep 23 00:21:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-a85aacad-1387-4870-ac80-50dd0ad14f6c req-e56c54d6-c892-4e26-b79d-5434a37db7f0 tempest-TestServerVolumeAttachScenarioOldVersion-1146155017 None] Deleting attachment c9d71b11-ac7a-4811-9479-2c856c60a32d. {{(pid=86591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:21:56 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6e1a6d4d-bb65-4685-bbdc-a181085c9ca5 tempest-TestServerVolumeAttachScenarioOldVersion-1146155017 None] Acquiring lock "cinder-33a81647-f265-4681-abb6-61a6cf6a6589-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:56 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6e1a6d4d-bb65-4685-bbdc-a181085c9ca5 tempest-TestServerVolumeAttachScenarioOldVersion-1146155017 None] Lock "cinder-33a81647-f265-4681-abb6-61a6cf6a6589-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:57 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6e1a6d4d-bb65-4685-bbdc-a181085c9ca5 tempest-TestServerVolumeAttachScenarioOldVersion-1146155017 None] Acquiring lock "cinder-quobyte-33a81647-f265-4681-abb6-61a6cf6a6589" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:57 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6e1a6d4d-bb65-4685-bbdc-a181085c9ca5 tempest-TestServerVolumeAttachScenarioOldVersion-1146155017 None] Lock "cinder-quobyte-33a81647-f265-4681-abb6-61a6cf6a6589" acquired by "delete_volume" :: waited 0.031s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:57 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c4f5e9-118a-450a-8c6c-a7b332b6437c]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:21:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6e1a6d4d-bb65-4685-bbdc-a181085c9ca5 tempest-TestServerVolumeAttachScenarioOldVersion-1146155017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-33a81647-f265-4681-abb6-61a6cf6a6589 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:57 devstack sudo[98194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-33a81647-f265-4681-abb6-61a6cf6a6589 Sep 23 00:21:57 devstack sudo[98194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:57 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-f92362b5-47cb-4e39-869f-dd4cb2317b42 req-1b0965e1-0bfe-40cd-a8e3-7b792d2c09c1 tempest-TestServerVolumeAttachmentScenario-1621019023 None] Terminate volume connection completed successfully. Sep 23 00:21:57 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-f92362b5-47cb-4e39-869f-dd4cb2317b42 req-1b0965e1-0bfe-40cd-a8e3-7b792d2c09c1 tempest-TestServerVolumeAttachmentScenario-1621019023 None] Deleting attachment b5a0570c-ac32-4842-b6f0-10e85d3aca64. {{(pid=86591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:21:57 devstack sudo[98194]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6e1a6d4d-bb65-4685-bbdc-a181085c9ca5 tempest-TestServerVolumeAttachScenarioOldVersion-1146155017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-33a81647-f265-4681-abb6-61a6cf6a6589" returned: 0 in 0.647s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6e1a6d4d-bb65-4685-bbdc-a181085c9ca5 tempest-TestServerVolumeAttachScenarioOldVersion-1146155017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-33a81647-f265-4681-abb6-61a6cf6a6589 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:57 devstack sudo[98202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-33a81647-f265-4681-abb6-61a6cf6a6589 Sep 23 00:21:57 devstack sudo[98202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:58 devstack sudo[98202]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6e1a6d4d-bb65-4685-bbdc-a181085c9ca5 tempest-TestServerVolumeAttachScenarioOldVersion-1146155017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-33a81647-f265-4681-abb6-61a6cf6a6589" returned: 0 in 0.507s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:58 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6e1a6d4d-bb65-4685-bbdc-a181085c9ca5 tempest-TestServerVolumeAttachScenarioOldVersion-1146155017 None] Lock "cinder-quobyte-33a81647-f265-4681-abb6-61a6cf6a6589" released by "delete_volume" :: held 1.244s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:58 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-6e1a6d4d-bb65-4685-bbdc-a181085c9ca5 tempest-TestServerVolumeAttachScenarioOldVersion-1146155017 None] Created reservations ['9e5d0612-4d65-4362-9c63-07b4b0e9e1a8', 'eb6f0105-7dab-4afc-9c26-619ab593374c', 'c7ffece2-a52b-492f-aedc-cdbb227cc0f1', 'f2602d5a-174f-4610-97cd-ff9b9458d013'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:21:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6e1a6d4d-bb65-4685-bbdc-a181085c9ca5 tempest-TestServerVolumeAttachScenarioOldVersion-1146155017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6e1a6d4d-bb65-4685-bbdc-a181085c9ca5 tempest-TestServerVolumeAttachScenarioOldVersion-1146155017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:58 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6e1a6d4d-bb65-4685-bbdc-a181085c9ca5 tempest-TestServerVolumeAttachScenarioOldVersion-1146155017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:21:58 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6e1a6d4d-bb65-4685-bbdc-a181085c9ca5 tempest-TestServerVolumeAttachScenarioOldVersion-1146155017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:21:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6e1a6d4d-bb65-4685-bbdc-a181085c9ca5 tempest-TestServerVolumeAttachScenarioOldVersion-1146155017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6e1a6d4d-bb65-4685-bbdc-a181085c9ca5 tempest-TestServerVolumeAttachScenarioOldVersion-1146155017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:58 devstack sudo[98205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:21:58 devstack sudo[98205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:58 devstack sudo[98205]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6e1a6d4d-bb65-4685-bbdc-a181085c9ca5 tempest-TestServerVolumeAttachScenarioOldVersion-1146155017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.448s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:58 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-6e1a6d4d-bb65-4685-bbdc-a181085c9ca5 tempest-TestServerVolumeAttachScenarioOldVersion-1146155017 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:21:58 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-6e1a6d4d-bb65-4685-bbdc-a181085c9ca5 tempest-TestServerVolumeAttachScenarioOldVersion-1146155017 None] Deleted volume successfully. Sep 23 00:21:59 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6e1a6d4d-bb65-4685-bbdc-a181085c9ca5 tempest-TestServerVolumeAttachScenarioOldVersion-1146155017 None] Lock "cinder-33a81647-f265-4681-abb6-61a6cf6a6589-delete_volume" released by "delete_volume" :: held 2.072s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:59 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-ec461a8b-c186-4c18-917c-d7a0f0fdd52c req-51a342f3-5117-4d9d-a23e-9e6d9bd733f6 tempest-TestServerVolumeAttachmentScenario-1621019023 None] Terminate volume connection completed successfully. Sep 23 00:21:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-ec461a8b-c186-4c18-917c-d7a0f0fdd52c req-51a342f3-5117-4d9d-a23e-9e6d9bd733f6 tempest-TestServerVolumeAttachmentScenario-1621019023 None] Deleting attachment c91a339b-6945-4ae2-b6c1-af85f8c44ad9. {{(pid=86591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:22:05 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2981d18-ddc7-4991-a18e-7a664c058dec tempest-VolumesActionsTest-1479696757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:22:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d2981d18-ddc7-4991-a18e-7a664c058dec tempest-VolumesActionsTest-1479696757 None] Flow 'volume_create_manager' (5d3347d6-1200-48d9-9119-d6ed508e344e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d2981d18-ddc7-4991-a18e-7a664c058dec tempest-VolumesActionsTest-1479696757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe22ac56-bc14-4d64-8f66-2d93a9fd8be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d2981d18-ddc7-4991-a18e-7a664c058dec tempest-VolumesActionsTest-1479696757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe22ac56-bc14-4d64-8f66-2d93a9fd8be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-680358230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a67aca6-ef90-438d-9197-57b23fb901c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96457a7dcd39467cad8224ec9422da79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:06Z,use_quota=True,user_id='3f54e468be7a471182acdbaa05f7b508',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d2981d18-ddc7-4991-a18e-7a664c058dec tempest-VolumesActionsTest-1479696757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e115afe2-5e7f-4598-b35a-b7b9bc00f8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d2981d18-ddc7-4991-a18e-7a664c058dec tempest-VolumesActionsTest-1479696757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e115afe2-5e7f-4598-b35a-b7b9bc00f8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d2981d18-ddc7-4991-a18e-7a664c058dec tempest-VolumesActionsTest-1479696757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d88b545e-e09a-43aa-8af2-5a84f4172d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d2981d18-ddc7-4991-a18e-7a664c058dec tempest-VolumesActionsTest-1479696757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d88b545e-e09a-43aa-8af2-5a84f4172d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a67aca6-ef90-438d-9197-57b23fb901c4', 'volume_name': 'volume-0a67aca6-ef90-438d-9197-57b23fb901c4', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d2981d18-ddc7-4991-a18e-7a664c058dec tempest-VolumesActionsTest-1479696757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84dbb13d-cfd2-4651-ae66-ff2ae2398092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d2981d18-ddc7-4991-a18e-7a664c058dec tempest-VolumesActionsTest-1479696757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84dbb13d-cfd2-4651-ae66-ff2ae2398092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d2981d18-ddc7-4991-a18e-7a664c058dec tempest-VolumesActionsTest-1479696757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2aacad23-69c0-4b11-ad8b-427d615a0da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:05 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-d2981d18-ddc7-4991-a18e-7a664c058dec tempest-VolumesActionsTest-1479696757 None] Volume 0a67aca6-ef90-438d-9197-57b23fb901c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a67aca6-ef90-438d-9197-57b23fb901c4', 'volume_size': 1} Sep 23 00:22:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d2981d18-ddc7-4991-a18e-7a664c058dec tempest-VolumesActionsTest-1479696757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d2981d18-ddc7-4991-a18e-7a664c058dec tempest-VolumesActionsTest-1479696757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:05 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d2981d18-ddc7-4991-a18e-7a664c058dec tempest-VolumesActionsTest-1479696757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-680358230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a67aca6-ef90-438d-9197-57b23fb901c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96457a7dcd39467cad8224ec9422da79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:06Z,use_quota=True,user_id='3f54e468be7a471182acdbaa05f7b508',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:22:05 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-d2981d18-ddc7-4991-a18e-7a664c058dec tempest-VolumesActionsTest-1479696757 None] Creating volume 0a67aca6-ef90-438d-9197-57b23fb901c4 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:22:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d2981d18-ddc7-4991-a18e-7a664c058dec tempest-VolumesActionsTest-1479696757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d2981d18-ddc7-4991-a18e-7a664c058dec tempest-VolumesActionsTest-1479696757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:05 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d2981d18-ddc7-4991-a18e-7a664c058dec tempest-VolumesActionsTest-1479696757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:05 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d2981d18-ddc7-4991-a18e-7a664c058dec tempest-VolumesActionsTest-1479696757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d2981d18-ddc7-4991-a18e-7a664c058dec tempest-VolumesActionsTest-1479696757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:05 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d2981d18-ddc7-4991-a18e-7a664c058dec tempest-VolumesActionsTest-1479696757 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:22:05 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-d2981d18-ddc7-4991-a18e-7a664c058dec tempest-VolumesActionsTest-1479696757 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:22:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d2981d18-ddc7-4991-a18e-7a664c058dec tempest-VolumesActionsTest-1479696757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-0a67aca6-ef90-438d-9197-57b23fb901c4 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:05 devstack sudo[98281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-0a67aca6-ef90-438d-9197-57b23fb901c4 1073741824 Sep 23 00:22:05 devstack sudo[98281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:06 devstack sudo[98281]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d2981d18-ddc7-4991-a18e-7a664c058dec tempest-VolumesActionsTest-1479696757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-0a67aca6-ef90-438d-9197-57b23fb901c4 1073741824" returned: 0 in 0.987s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d2981d18-ddc7-4991-a18e-7a664c058dec tempest-VolumesActionsTest-1479696757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-0a67aca6-ef90-438d-9197-57b23fb901c4 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:07 devstack sudo[98289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-0a67aca6-ef90-438d-9197-57b23fb901c4 Sep 23 00:22:07 devstack sudo[98289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:07 devstack sudo[98289]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d2981d18-ddc7-4991-a18e-7a664c058dec tempest-VolumesActionsTest-1479696757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-0a67aca6-ef90-438d-9197-57b23fb901c4" returned: 0 in 0.834s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:07 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d2981d18-ddc7-4991-a18e-7a664c058dec tempest-VolumesActionsTest-1479696757 None] <== create_volume: return (1934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:22:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d2981d18-ddc7-4991-a18e-7a664c058dec tempest-VolumesActionsTest-1479696757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.948s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d2981d18-ddc7-4991-a18e-7a664c058dec tempest-VolumesActionsTest-1479696757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2aacad23-69c0-4b11-ad8b-427d615a0da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a67aca6-ef90-438d-9197-57b23fb901c4', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d2981d18-ddc7-4991-a18e-7a664c058dec tempest-VolumesActionsTest-1479696757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5ae9cd3-3c75-44bc-94c4-cd9cf932fd21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:07 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-d2981d18-ddc7-4991-a18e-7a664c058dec tempest-VolumesActionsTest-1479696757 None] Volume volume-0a67aca6-ef90-438d-9197-57b23fb901c4 (0a67aca6-ef90-438d-9197-57b23fb901c4): created successfully Sep 23 00:22:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d2981d18-ddc7-4991-a18e-7a664c058dec tempest-VolumesActionsTest-1479696757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5ae9cd3-3c75-44bc-94c4-cd9cf932fd21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d2981d18-ddc7-4991-a18e-7a664c058dec tempest-VolumesActionsTest-1479696757 None] Flow 'volume_create_manager' (5d3347d6-1200-48d9-9119-d6ed508e344e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:08 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-d2981d18-ddc7-4991-a18e-7a664c058dec tempest-VolumesActionsTest-1479696757 None] Created volume successfully. Sep 23 00:22:10 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-2daaeb5b-1ba2-4d61-895a-2feb304694cb tempest-AttachVolumeTestJSON-1775429087 None] Acquiring lock "cinder-53575736-35c3-4ee0-b920-e54e6b941645-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:10 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-2daaeb5b-1ba2-4d61-895a-2feb304694cb tempest-AttachVolumeTestJSON-1775429087 None] Lock "cinder-53575736-35c3-4ee0-b920-e54e6b941645-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:10 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-2daaeb5b-1ba2-4d61-895a-2feb304694cb tempest-AttachVolumeTestJSON-1775429087 None] Acquiring lock "cinder-quobyte-53575736-35c3-4ee0-b920-e54e6b941645" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:10 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-2daaeb5b-1ba2-4d61-895a-2feb304694cb tempest-AttachVolumeTestJSON-1775429087 None] Lock "cinder-quobyte-53575736-35c3-4ee0-b920-e54e6b941645" acquired by "delete_volume" :: waited 0.026s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:10 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc30b728-54c6-49d8-92b9-2a54e3b22429]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2daaeb5b-1ba2-4d61-895a-2feb304694cb tempest-AttachVolumeTestJSON-1775429087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-53575736-35c3-4ee0-b920-e54e6b941645 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:10 devstack sudo[98334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-53575736-35c3-4ee0-b920-e54e6b941645 Sep 23 00:22:10 devstack sudo[98334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:10 devstack sudo[98334]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2daaeb5b-1ba2-4d61-895a-2feb304694cb tempest-AttachVolumeTestJSON-1775429087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-53575736-35c3-4ee0-b920-e54e6b941645" returned: 0 in 0.521s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2daaeb5b-1ba2-4d61-895a-2feb304694cb tempest-AttachVolumeTestJSON-1775429087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-53575736-35c3-4ee0-b920-e54e6b941645 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:10 devstack sudo[98339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-53575736-35c3-4ee0-b920-e54e6b941645 Sep 23 00:22:10 devstack sudo[98339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:11 devstack sudo[98339]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2daaeb5b-1ba2-4d61-895a-2feb304694cb tempest-AttachVolumeTestJSON-1775429087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-53575736-35c3-4ee0-b920-e54e6b941645" returned: 0 in 0.436s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:11 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-2daaeb5b-1ba2-4d61-895a-2feb304694cb tempest-AttachVolumeTestJSON-1775429087 None] Lock "cinder-quobyte-53575736-35c3-4ee0-b920-e54e6b941645" released by "delete_volume" :: held 1.034s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:11 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-2daaeb5b-1ba2-4d61-895a-2feb304694cb tempest-AttachVolumeTestJSON-1775429087 None] Created reservations ['ad6175e4-cf36-4ee8-b682-217e0115abbc', 'c2584ab0-b895-4752-85b4-6a103acbeada', '55afdda7-b9b3-4159-a798-0ec3a8a62d6a', '954773d5-9cb7-405c-8ffa-a5a5bcaa2d24'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:22:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2daaeb5b-1ba2-4d61-895a-2feb304694cb tempest-AttachVolumeTestJSON-1775429087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2daaeb5b-1ba2-4d61-895a-2feb304694cb tempest-AttachVolumeTestJSON-1775429087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:11 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2daaeb5b-1ba2-4d61-895a-2feb304694cb tempest-AttachVolumeTestJSON-1775429087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:11 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2daaeb5b-1ba2-4d61-895a-2feb304694cb tempest-AttachVolumeTestJSON-1775429087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2daaeb5b-1ba2-4d61-895a-2feb304694cb tempest-AttachVolumeTestJSON-1775429087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2daaeb5b-1ba2-4d61-895a-2feb304694cb tempest-AttachVolumeTestJSON-1775429087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:11 devstack sudo[98343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:22:11 devstack sudo[98343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:11 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-585fa092-31e1-42ad-992a-2bb6c65148d1 tempest-TestServerVolumeAttachmentScenario-1621019023 None] Acquiring lock "cinder-8770a6b0-2354-4861-8d3a-07542e2d75b2-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:11 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-585fa092-31e1-42ad-992a-2bb6c65148d1 tempest-TestServerVolumeAttachmentScenario-1621019023 None] Lock "cinder-8770a6b0-2354-4861-8d3a-07542e2d75b2-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:11 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-585fa092-31e1-42ad-992a-2bb6c65148d1 tempest-TestServerVolumeAttachmentScenario-1621019023 None] Acquiring lock "cinder-quobyte-8770a6b0-2354-4861-8d3a-07542e2d75b2" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:11 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-585fa092-31e1-42ad-992a-2bb6c65148d1 tempest-TestServerVolumeAttachmentScenario-1621019023 None] Lock "cinder-quobyte-8770a6b0-2354-4861-8d3a-07542e2d75b2" acquired by "delete_volume" :: waited 0.019s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:11 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[16002f0f-0b92-4426-9bae-1ed735ed3765]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-585fa092-31e1-42ad-992a-2bb6c65148d1 tempest-TestServerVolumeAttachmentScenario-1621019023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8770a6b0-2354-4861-8d3a-07542e2d75b2 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:11 devstack sudo[98343]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2daaeb5b-1ba2-4d61-895a-2feb304694cb tempest-AttachVolumeTestJSON-1775429087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.383s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:11 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-2daaeb5b-1ba2-4d61-895a-2feb304694cb tempest-AttachVolumeTestJSON-1775429087 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:22:11 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-2daaeb5b-1ba2-4d61-895a-2feb304694cb tempest-AttachVolumeTestJSON-1775429087 None] Deleted volume successfully. Sep 23 00:22:11 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-2daaeb5b-1ba2-4d61-895a-2feb304694cb tempest-AttachVolumeTestJSON-1775429087 None] Lock "cinder-53575736-35c3-4ee0-b920-e54e6b941645-delete_volume" released by "delete_volume" :: held 1.763s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:12 devstack sudo[98345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8770a6b0-2354-4861-8d3a-07542e2d75b2 Sep 23 00:22:12 devstack sudo[98345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:12 devstack sudo[98345]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-585fa092-31e1-42ad-992a-2bb6c65148d1 tempest-TestServerVolumeAttachmentScenario-1621019023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8770a6b0-2354-4861-8d3a-07542e2d75b2" returned: 0 in 0.511s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-585fa092-31e1-42ad-992a-2bb6c65148d1 tempest-TestServerVolumeAttachmentScenario-1621019023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8770a6b0-2354-4861-8d3a-07542e2d75b2 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:12 devstack sudo[98354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8770a6b0-2354-4861-8d3a-07542e2d75b2 Sep 23 00:22:12 devstack sudo[98354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:12 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5900576a-bb25-47bd-bdc4-a98fdc91ca5b tempest-AttachVolumeTestJSON-1775429087 None] Acquiring lock "cinder-e223c731-0c87-4b5e-8698-47dbb23a2225-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:12 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5900576a-bb25-47bd-bdc4-a98fdc91ca5b tempest-AttachVolumeTestJSON-1775429087 None] Lock "cinder-e223c731-0c87-4b5e-8698-47dbb23a2225-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:12 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5900576a-bb25-47bd-bdc4-a98fdc91ca5b tempest-AttachVolumeTestJSON-1775429087 None] Acquiring lock "cinder-quobyte-e223c731-0c87-4b5e-8698-47dbb23a2225" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:12 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5900576a-bb25-47bd-bdc4-a98fdc91ca5b tempest-AttachVolumeTestJSON-1775429087 None] Lock "cinder-quobyte-e223c731-0c87-4b5e-8698-47dbb23a2225" acquired by "delete_volume" :: waited 0.023s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:12 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[04aabf0c-4905-48e6-8b02-5247bb7b83a4]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5900576a-bb25-47bd-bdc4-a98fdc91ca5b tempest-AttachVolumeTestJSON-1775429087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e223c731-0c87-4b5e-8698-47dbb23a2225 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:12 devstack sudo[98354]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-585fa092-31e1-42ad-992a-2bb6c65148d1 tempest-TestServerVolumeAttachmentScenario-1621019023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8770a6b0-2354-4861-8d3a-07542e2d75b2" returned: 0 in 0.462s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:12 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-585fa092-31e1-42ad-992a-2bb6c65148d1 tempest-TestServerVolumeAttachmentScenario-1621019023 None] Lock "cinder-quobyte-8770a6b0-2354-4861-8d3a-07542e2d75b2" released by "delete_volume" :: held 1.059s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:12 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-585fa092-31e1-42ad-992a-2bb6c65148d1 tempest-TestServerVolumeAttachmentScenario-1621019023 None] Created reservations ['ee767485-838c-4be6-9561-e500c2a5f432', 'acd2d48a-b238-4b76-bd4c-2aed1dce23ac', 'd2a5592b-00a5-4a07-bdeb-acfae8aca4cb', 'bcb3e95c-b7ba-45b2-95cf-84a265d09820'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:22:13 devstack sudo[98357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e223c731-0c87-4b5e-8698-47dbb23a2225 Sep 23 00:22:13 devstack sudo[98357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-585fa092-31e1-42ad-992a-2bb6c65148d1 tempest-TestServerVolumeAttachmentScenario-1621019023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-585fa092-31e1-42ad-992a-2bb6c65148d1 tempest-TestServerVolumeAttachmentScenario-1621019023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:13 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-585fa092-31e1-42ad-992a-2bb6c65148d1 tempest-TestServerVolumeAttachmentScenario-1621019023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:13 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-585fa092-31e1-42ad-992a-2bb6c65148d1 tempest-TestServerVolumeAttachmentScenario-1621019023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-585fa092-31e1-42ad-992a-2bb6c65148d1 tempest-TestServerVolumeAttachmentScenario-1621019023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-585fa092-31e1-42ad-992a-2bb6c65148d1 tempest-TestServerVolumeAttachmentScenario-1621019023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:13 devstack sudo[98359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:22:13 devstack sudo[98359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:13 devstack sudo[98357]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5900576a-bb25-47bd-bdc4-a98fdc91ca5b tempest-AttachVolumeTestJSON-1775429087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e223c731-0c87-4b5e-8698-47dbb23a2225" returned: 0 in 0.653s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5900576a-bb25-47bd-bdc4-a98fdc91ca5b tempest-AttachVolumeTestJSON-1775429087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e223c731-0c87-4b5e-8698-47dbb23a2225 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:13 devstack sudo[98364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e223c731-0c87-4b5e-8698-47dbb23a2225 Sep 23 00:22:13 devstack sudo[98364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:13 devstack sudo[98359]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-585fa092-31e1-42ad-992a-2bb6c65148d1 tempest-TestServerVolumeAttachmentScenario-1621019023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.479s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:13 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-585fa092-31e1-42ad-992a-2bb6c65148d1 tempest-TestServerVolumeAttachmentScenario-1621019023 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:22:13 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-585fa092-31e1-42ad-992a-2bb6c65148d1 tempest-TestServerVolumeAttachmentScenario-1621019023 None] Deleted volume successfully. Sep 23 00:22:13 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-585fa092-31e1-42ad-992a-2bb6c65148d1 tempest-TestServerVolumeAttachmentScenario-1621019023 None] Lock "cinder-8770a6b0-2354-4861-8d3a-07542e2d75b2-delete_volume" released by "delete_volume" :: held 2.052s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:13 devstack sudo[98364]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5900576a-bb25-47bd-bdc4-a98fdc91ca5b tempest-AttachVolumeTestJSON-1775429087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e223c731-0c87-4b5e-8698-47dbb23a2225" returned: 0 in 0.529s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:13 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5900576a-bb25-47bd-bdc4-a98fdc91ca5b tempest-AttachVolumeTestJSON-1775429087 None] Lock "cinder-quobyte-e223c731-0c87-4b5e-8698-47dbb23a2225" released by "delete_volume" :: held 1.273s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:14 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9b8d097b-859b-4568-93a5-62e0804b87af tempest-TestServerVolumeAttachmentScenario-1621019023 None] Acquiring lock "cinder-64c3de24-4f62-4790-b61d-8332fa6761c1-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:14 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-5900576a-bb25-47bd-bdc4-a98fdc91ca5b tempest-AttachVolumeTestJSON-1775429087 None] Created reservations ['9db00ae5-a055-4618-a990-bf719f154b34', 'b923466d-3c0d-4b32-bc82-8709b0188d4b', '82521530-0db9-4470-9209-0c7150307b83', '15fc7c3f-2e03-4431-a11e-76d5ae0fd251'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:22:14 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9b8d097b-859b-4568-93a5-62e0804b87af tempest-TestServerVolumeAttachmentScenario-1621019023 None] Lock "cinder-64c3de24-4f62-4790-b61d-8332fa6761c1-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:14 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9b8d097b-859b-4568-93a5-62e0804b87af tempest-TestServerVolumeAttachmentScenario-1621019023 None] Acquiring lock "cinder-quobyte-64c3de24-4f62-4790-b61d-8332fa6761c1" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:14 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9b8d097b-859b-4568-93a5-62e0804b87af tempest-TestServerVolumeAttachmentScenario-1621019023 None] Lock "cinder-quobyte-64c3de24-4f62-4790-b61d-8332fa6761c1" acquired by "delete_volume" :: waited 0.032s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5900576a-bb25-47bd-bdc4-a98fdc91ca5b tempest-AttachVolumeTestJSON-1775429087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5900576a-bb25-47bd-bdc4-a98fdc91ca5b tempest-AttachVolumeTestJSON-1775429087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:14 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5900576a-bb25-47bd-bdc4-a98fdc91ca5b tempest-AttachVolumeTestJSON-1775429087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:14 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5900576a-bb25-47bd-bdc4-a98fdc91ca5b tempest-AttachVolumeTestJSON-1775429087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5900576a-bb25-47bd-bdc4-a98fdc91ca5b tempest-AttachVolumeTestJSON-1775429087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5900576a-bb25-47bd-bdc4-a98fdc91ca5b tempest-AttachVolumeTestJSON-1775429087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:14 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00bdeb9-19f8-4ce2-b365-5e0f073eda79]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9b8d097b-859b-4568-93a5-62e0804b87af tempest-TestServerVolumeAttachmentScenario-1621019023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-64c3de24-4f62-4790-b61d-8332fa6761c1 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:14 devstack sudo[98368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:22:14 devstack sudo[98368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:14 devstack sudo[98369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-64c3de24-4f62-4790-b61d-8332fa6761c1 Sep 23 00:22:14 devstack sudo[98369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:14 devstack sudo[98368]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5900576a-bb25-47bd-bdc4-a98fdc91ca5b tempest-AttachVolumeTestJSON-1775429087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.657s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:14 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-5900576a-bb25-47bd-bdc4-a98fdc91ca5b tempest-AttachVolumeTestJSON-1775429087 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:22:15 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-5900576a-bb25-47bd-bdc4-a98fdc91ca5b tempest-AttachVolumeTestJSON-1775429087 None] Deleted volume successfully. Sep 23 00:22:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5900576a-bb25-47bd-bdc4-a98fdc91ca5b tempest-AttachVolumeTestJSON-1775429087 None] Lock "cinder-e223c731-0c87-4b5e-8698-47dbb23a2225-delete_volume" released by "delete_volume" :: held 2.440s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:15 devstack sudo[98369]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9b8d097b-859b-4568-93a5-62e0804b87af tempest-TestServerVolumeAttachmentScenario-1621019023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-64c3de24-4f62-4790-b61d-8332fa6761c1" returned: 0 in 0.835s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9b8d097b-859b-4568-93a5-62e0804b87af tempest-TestServerVolumeAttachmentScenario-1621019023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-64c3de24-4f62-4790-b61d-8332fa6761c1 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:15 devstack sudo[98376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-64c3de24-4f62-4790-b61d-8332fa6761c1 Sep 23 00:22:15 devstack sudo[98376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4ce110c4-8383-4c27-a2be-13126cfde804 tempest-AttachVolumeTestJSON-1775429087 None] Acquiring lock "cinder-590c0ac5-22f0-4a2a-85fd-ff39a46eca1b-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4ce110c4-8383-4c27-a2be-13126cfde804 tempest-AttachVolumeTestJSON-1775429087 None] Lock "cinder-590c0ac5-22f0-4a2a-85fd-ff39a46eca1b-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4ce110c4-8383-4c27-a2be-13126cfde804 tempest-AttachVolumeTestJSON-1775429087 None] Acquiring lock "cinder-quobyte-590c0ac5-22f0-4a2a-85fd-ff39a46eca1b" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4ce110c4-8383-4c27-a2be-13126cfde804 tempest-AttachVolumeTestJSON-1775429087 None] Lock "cinder-quobyte-590c0ac5-22f0-4a2a-85fd-ff39a46eca1b" acquired by "delete_volume" :: waited 0.041s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:15 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[c20e8a7a-555f-4577-a686-0c2af4163373]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4ce110c4-8383-4c27-a2be-13126cfde804 tempest-AttachVolumeTestJSON-1775429087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-590c0ac5-22f0-4a2a-85fd-ff39a46eca1b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:15 devstack sudo[98381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-590c0ac5-22f0-4a2a-85fd-ff39a46eca1b Sep 23 00:22:15 devstack sudo[98381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:15 devstack sudo[98376]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9b8d097b-859b-4568-93a5-62e0804b87af tempest-TestServerVolumeAttachmentScenario-1621019023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-64c3de24-4f62-4790-b61d-8332fa6761c1" returned: 0 in 0.588s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9b8d097b-859b-4568-93a5-62e0804b87af tempest-TestServerVolumeAttachmentScenario-1621019023 None] Lock "cinder-quobyte-64c3de24-4f62-4790-b61d-8332fa6761c1" released by "delete_volume" :: held 1.516s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:15 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-9b8d097b-859b-4568-93a5-62e0804b87af tempest-TestServerVolumeAttachmentScenario-1621019023 None] Created reservations ['ef09c82c-8eb9-4f1a-8b6b-14a057ef230d', 'ae89178f-6ab6-402c-b28e-c2f9cfca0551', '5619cadb-ec91-4db7-ad98-5260d40f0074', 'e2322e30-6810-42a5-bf8b-ff1cd67d542a'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:22:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9b8d097b-859b-4568-93a5-62e0804b87af tempest-TestServerVolumeAttachmentScenario-1621019023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9b8d097b-859b-4568-93a5-62e0804b87af tempest-TestServerVolumeAttachmentScenario-1621019023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9b8d097b-859b-4568-93a5-62e0804b87af tempest-TestServerVolumeAttachmentScenario-1621019023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9b8d097b-859b-4568-93a5-62e0804b87af tempest-TestServerVolumeAttachmentScenario-1621019023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9b8d097b-859b-4568-93a5-62e0804b87af tempest-TestServerVolumeAttachmentScenario-1621019023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9b8d097b-859b-4568-93a5-62e0804b87af tempest-TestServerVolumeAttachmentScenario-1621019023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:16 devstack sudo[98395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:22:16 devstack sudo[98395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:16 devstack sudo[98381]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4ce110c4-8383-4c27-a2be-13126cfde804 tempest-AttachVolumeTestJSON-1775429087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-590c0ac5-22f0-4a2a-85fd-ff39a46eca1b" returned: 0 in 0.750s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4ce110c4-8383-4c27-a2be-13126cfde804 tempest-AttachVolumeTestJSON-1775429087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-590c0ac5-22f0-4a2a-85fd-ff39a46eca1b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:16 devstack sudo[98402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-590c0ac5-22f0-4a2a-85fd-ff39a46eca1b Sep 23 00:22:16 devstack sudo[98402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:16 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:22:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:16 devstack sudo[98395]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9b8d097b-859b-4568-93a5-62e0804b87af tempest-TestServerVolumeAttachmentScenario-1621019023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.626s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:16 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-9b8d097b-859b-4568-93a5-62e0804b87af tempest-TestServerVolumeAttachmentScenario-1621019023 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:22:16 devstack sudo[98409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:22:16 devstack sudo[98409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:16 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-9b8d097b-859b-4568-93a5-62e0804b87af tempest-TestServerVolumeAttachmentScenario-1621019023 None] Deleted volume successfully. Sep 23 00:22:16 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9b8d097b-859b-4568-93a5-62e0804b87af tempest-TestServerVolumeAttachmentScenario-1621019023 None] Lock "cinder-64c3de24-4f62-4790-b61d-8332fa6761c1-delete_volume" released by "delete_volume" :: held 2.625s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:16 devstack sudo[98402]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4ce110c4-8383-4c27-a2be-13126cfde804 tempest-AttachVolumeTestJSON-1775429087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-590c0ac5-22f0-4a2a-85fd-ff39a46eca1b" returned: 0 in 0.465s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:16 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4ce110c4-8383-4c27-a2be-13126cfde804 tempest-AttachVolumeTestJSON-1775429087 None] Lock "cinder-quobyte-590c0ac5-22f0-4a2a-85fd-ff39a46eca1b" released by "delete_volume" :: held 1.290s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:16 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-4ce110c4-8383-4c27-a2be-13126cfde804 tempest-AttachVolumeTestJSON-1775429087 None] Created reservations ['327a01ce-8bfd-4a50-983d-cb060aaa09fe', 'bad5ed83-1369-4e67-8d37-05227990f782', '428c7f81-3812-4b92-a149-a8454670bcba', '694e6f49-4b88-4ebe-acb2-e8565ebacfe0'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:22:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4ce110c4-8383-4c27-a2be-13126cfde804 tempest-AttachVolumeTestJSON-1775429087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4ce110c4-8383-4c27-a2be-13126cfde804 tempest-AttachVolumeTestJSON-1775429087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4ce110c4-8383-4c27-a2be-13126cfde804 tempest-AttachVolumeTestJSON-1775429087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:17 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4ce110c4-8383-4c27-a2be-13126cfde804 tempest-AttachVolumeTestJSON-1775429087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4ce110c4-8383-4c27-a2be-13126cfde804 tempest-AttachVolumeTestJSON-1775429087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4ce110c4-8383-4c27-a2be-13126cfde804 tempest-AttachVolumeTestJSON-1775429087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:17 devstack sudo[98412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:22:17 devstack sudo[98412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:17 devstack sudo[98409]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.479s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:17 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:22:17 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running periodic task VolumeManager._thread_info {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:22:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] thread count: 29 {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:22:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] thread info: [<_MainThread(MainThread, started 135440660459648)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:22:17 devstack sudo[98412]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4ce110c4-8383-4c27-a2be-13126cfde804 tempest-AttachVolumeTestJSON-1775429087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.375s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:17 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-4ce110c4-8383-4c27-a2be-13126cfde804 tempest-AttachVolumeTestJSON-1775429087 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:22:17 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-4ce110c4-8383-4c27-a2be-13126cfde804 tempest-AttachVolumeTestJSON-1775429087 None] Deleted volume successfully. Sep 23 00:22:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4ce110c4-8383-4c27-a2be-13126cfde804 tempest-AttachVolumeTestJSON-1775429087 None] Lock "cinder-590c0ac5-22f0-4a2a-85fd-ff39a46eca1b-delete_volume" released by "delete_volume" :: held 2.052s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:26 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:UPDATE=81,cinder:SELECT=81,cinder:INSERT=17,cinder:DELETE=5 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:22:27 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=84,cinder:UPDATE=76,cinder:INSERT=16,cinder:DELETE=7 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:22:33 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e6abe2b7-0c81-4e35-993f-0c26e0328ab2 tempest-VolumesActionsTest-1479696757 None] Acquiring lock "cinder-0a67aca6-ef90-438d-9197-57b23fb901c4" by "attach_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:33 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e6abe2b7-0c81-4e35-993f-0c26e0328ab2 tempest-VolumesActionsTest-1479696757 None] Lock "cinder-0a67aca6-ef90-438d-9197-57b23fb901c4" acquired by "attach_volume" :: waited 0.026s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:33 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-e6abe2b7-0c81-4e35-993f-0c26e0328ab2 tempest-VolumesActionsTest-1479696757 None] Attaching volume 0a67aca6-ef90-438d-9197-57b23fb901c4 to instance 9d4987ec-be1b-41a8-95c0-b86e37d03300 at mountpoint /dev/vdb on host None. Sep 23 00:22:33 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-e6abe2b7-0c81-4e35-993f-0c26e0328ab2 tempest-VolumesActionsTest-1479696757 None] Attach volume completed successfully. Sep 23 00:22:33 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e6abe2b7-0c81-4e35-993f-0c26e0328ab2 tempest-VolumesActionsTest-1479696757 None] Lock "cinder-0a67aca6-ef90-438d-9197-57b23fb901c4" released by "attach_volume" :: held 0.216s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:33 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-bbbe6957-6914-44f9-a5d2-db99dc1797d6 tempest-VolumesActionsTest-1479696757 None] Acquiring lock "cinder-0a67aca6-ef90-438d-9197-57b23fb901c4-detach_volume" by "detach_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:33 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-bbbe6957-6914-44f9-a5d2-db99dc1797d6 tempest-VolumesActionsTest-1479696757 None] Lock "cinder-0a67aca6-ef90-438d-9197-57b23fb901c4-detach_volume" acquired by "detach_volume" :: waited 0.042s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:33 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-bbbe6957-6914-44f9-a5d2-db99dc1797d6 tempest-VolumesActionsTest-1479696757 None] Detaching volume 0a67aca6-ef90-438d-9197-57b23fb901c4 from instance 9d4987ec-be1b-41a8-95c0-b86e37d03300. Sep 23 00:22:33 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-bbbe6957-6914-44f9-a5d2-db99dc1797d6 tempest-VolumesActionsTest-1479696757 None] Detach volume completed successfully. Sep 23 00:22:33 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-bbbe6957-6914-44f9-a5d2-db99dc1797d6 tempest-VolumesActionsTest-1479696757 None] Lock "cinder-0a67aca6-ef90-438d-9197-57b23fb901c4-detach_volume" released by "detach_volume" :: held 0.176s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:35 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [req-c5539308-b27c-4be0-ad75-3eca149cd829 req-23844844-3f74-4c68-a6cc-43ac41758e7c tempest-VolumesSnapshotsTestJSON-437986313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:22:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-c5539308-b27c-4be0-ad75-3eca149cd829 req-23844844-3f74-4c68-a6cc-43ac41758e7c tempest-VolumesSnapshotsTestJSON-437986313 None] Flow 'volume_create_manager' (5e1818cb-de97-4fc6-91f0-a9a16f013cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-c5539308-b27c-4be0-ad75-3eca149cd829 req-23844844-3f74-4c68-a6cc-43ac41758e7c tempest-VolumesSnapshotsTestJSON-437986313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37d9deb5-dab2-42b4-adc8-069e3b329859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-c5539308-b27c-4be0-ad75-3eca149cd829 req-23844844-3f74-4c68-a6cc-43ac41758e7c tempest-VolumesSnapshotsTestJSON-437986313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37d9deb5-dab2-42b4-adc8-069e3b329859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2022283132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fa0aa78-9087-4a26-bbe6-8e9255e81ac1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dce808a816d349628a7d69f80bb42eb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:35Z,use_quota=True,user_id='1bc2825f435840cc91585bea7ff8d9bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-c5539308-b27c-4be0-ad75-3eca149cd829 req-23844844-3f74-4c68-a6cc-43ac41758e7c tempest-VolumesSnapshotsTestJSON-437986313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (496f85b7-aee5-4513-9f02-74c50865eb86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-c5539308-b27c-4be0-ad75-3eca149cd829 req-23844844-3f74-4c68-a6cc-43ac41758e7c tempest-VolumesSnapshotsTestJSON-437986313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (496f85b7-aee5-4513-9f02-74c50865eb86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-c5539308-b27c-4be0-ad75-3eca149cd829 req-23844844-3f74-4c68-a6cc-43ac41758e7c tempest-VolumesSnapshotsTestJSON-437986313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (356789ae-457f-4265-a9b4-110dabe4a62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-c5539308-b27c-4be0-ad75-3eca149cd829 req-23844844-3f74-4c68-a6cc-43ac41758e7c tempest-VolumesSnapshotsTestJSON-437986313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (356789ae-457f-4265-a9b4-110dabe4a62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fa0aa78-9087-4a26-bbe6-8e9255e81ac1', 'volume_name': 'volume-3fa0aa78-9087-4a26-bbe6-8e9255e81ac1', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-c5539308-b27c-4be0-ad75-3eca149cd829 req-23844844-3f74-4c68-a6cc-43ac41758e7c tempest-VolumesSnapshotsTestJSON-437986313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdd1fdd5-5158-4406-9f40-84b46d25b122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-c5539308-b27c-4be0-ad75-3eca149cd829 req-23844844-3f74-4c68-a6cc-43ac41758e7c tempest-VolumesSnapshotsTestJSON-437986313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdd1fdd5-5158-4406-9f40-84b46d25b122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-c5539308-b27c-4be0-ad75-3eca149cd829 req-23844844-3f74-4c68-a6cc-43ac41758e7c tempest-VolumesSnapshotsTestJSON-437986313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a1e87f0-46c3-4d8c-8d11-685226a8f16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:35 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [req-c5539308-b27c-4be0-ad75-3eca149cd829 req-23844844-3f74-4c68-a6cc-43ac41758e7c tempest-VolumesSnapshotsTestJSON-437986313 None] Volume 3fa0aa78-9087-4a26-bbe6-8e9255e81ac1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fa0aa78-9087-4a26-bbe6-8e9255e81ac1', 'volume_size': 1} Sep 23 00:22:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-c5539308-b27c-4be0-ad75-3eca149cd829 req-23844844-3f74-4c68-a6cc-43ac41758e7c tempest-VolumesSnapshotsTestJSON-437986313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-c5539308-b27c-4be0-ad75-3eca149cd829 req-23844844-3f74-4c68-a6cc-43ac41758e7c tempest-VolumesSnapshotsTestJSON-437986313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:35 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [req-c5539308-b27c-4be0-ad75-3eca149cd829 req-23844844-3f74-4c68-a6cc-43ac41758e7c tempest-VolumesSnapshotsTestJSON-437986313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2022283132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fa0aa78-9087-4a26-bbe6-8e9255e81ac1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dce808a816d349628a7d69f80bb42eb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:35Z,use_quota=True,user_id='1bc2825f435840cc91585bea7ff8d9bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:22:35 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [req-c5539308-b27c-4be0-ad75-3eca149cd829 req-23844844-3f74-4c68-a6cc-43ac41758e7c tempest-VolumesSnapshotsTestJSON-437986313 None] Creating volume 3fa0aa78-9087-4a26-bbe6-8e9255e81ac1 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:22:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-c5539308-b27c-4be0-ad75-3eca149cd829 req-23844844-3f74-4c68-a6cc-43ac41758e7c tempest-VolumesSnapshotsTestJSON-437986313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-c5539308-b27c-4be0-ad75-3eca149cd829 req-23844844-3f74-4c68-a6cc-43ac41758e7c tempest-VolumesSnapshotsTestJSON-437986313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:35 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [req-c5539308-b27c-4be0-ad75-3eca149cd829 req-23844844-3f74-4c68-a6cc-43ac41758e7c tempest-VolumesSnapshotsTestJSON-437986313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:35 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [req-c5539308-b27c-4be0-ad75-3eca149cd829 req-23844844-3f74-4c68-a6cc-43ac41758e7c tempest-VolumesSnapshotsTestJSON-437986313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-c5539308-b27c-4be0-ad75-3eca149cd829 req-23844844-3f74-4c68-a6cc-43ac41758e7c tempest-VolumesSnapshotsTestJSON-437986313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:35 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [req-c5539308-b27c-4be0-ad75-3eca149cd829 req-23844844-3f74-4c68-a6cc-43ac41758e7c tempest-VolumesSnapshotsTestJSON-437986313 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:22:35 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [req-c5539308-b27c-4be0-ad75-3eca149cd829 req-23844844-3f74-4c68-a6cc-43ac41758e7c tempest-VolumesSnapshotsTestJSON-437986313 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:22:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-c5539308-b27c-4be0-ad75-3eca149cd829 req-23844844-3f74-4c68-a6cc-43ac41758e7c tempest-VolumesSnapshotsTestJSON-437986313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fa0aa78-9087-4a26-bbe6-8e9255e81ac1 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:35 devstack sudo[98517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fa0aa78-9087-4a26-bbe6-8e9255e81ac1 1073741824 Sep 23 00:22:35 devstack sudo[98517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:36 devstack sudo[98517]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-c5539308-b27c-4be0-ad75-3eca149cd829 req-23844844-3f74-4c68-a6cc-43ac41758e7c tempest-VolumesSnapshotsTestJSON-437986313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fa0aa78-9087-4a26-bbe6-8e9255e81ac1 1073741824" returned: 0 in 0.704s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-c5539308-b27c-4be0-ad75-3eca149cd829 req-23844844-3f74-4c68-a6cc-43ac41758e7c tempest-VolumesSnapshotsTestJSON-437986313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fa0aa78-9087-4a26-bbe6-8e9255e81ac1 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:36 devstack sudo[98530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fa0aa78-9087-4a26-bbe6-8e9255e81ac1 Sep 23 00:22:36 devstack sudo[98530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:36 devstack sudo[98530]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-c5539308-b27c-4be0-ad75-3eca149cd829 req-23844844-3f74-4c68-a6cc-43ac41758e7c tempest-VolumesSnapshotsTestJSON-437986313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fa0aa78-9087-4a26-bbe6-8e9255e81ac1" returned: 0 in 0.571s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:36 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [req-c5539308-b27c-4be0-ad75-3eca149cd829 req-23844844-3f74-4c68-a6cc-43ac41758e7c tempest-VolumesSnapshotsTestJSON-437986313 None] <== create_volume: return (1366ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:22:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-c5539308-b27c-4be0-ad75-3eca149cd829 req-23844844-3f74-4c68-a6cc-43ac41758e7c tempest-VolumesSnapshotsTestJSON-437986313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.372s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-c5539308-b27c-4be0-ad75-3eca149cd829 req-23844844-3f74-4c68-a6cc-43ac41758e7c tempest-VolumesSnapshotsTestJSON-437986313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a1e87f0-46c3-4d8c-8d11-685226a8f16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fa0aa78-9087-4a26-bbe6-8e9255e81ac1', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-c5539308-b27c-4be0-ad75-3eca149cd829 req-23844844-3f74-4c68-a6cc-43ac41758e7c tempest-VolumesSnapshotsTestJSON-437986313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d702a43-0c16-492a-9f65-658d84e5f106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:36 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [req-c5539308-b27c-4be0-ad75-3eca149cd829 req-23844844-3f74-4c68-a6cc-43ac41758e7c tempest-VolumesSnapshotsTestJSON-437986313 None] Volume volume-3fa0aa78-9087-4a26-bbe6-8e9255e81ac1 (3fa0aa78-9087-4a26-bbe6-8e9255e81ac1): created successfully Sep 23 00:22:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-c5539308-b27c-4be0-ad75-3eca149cd829 req-23844844-3f74-4c68-a6cc-43ac41758e7c tempest-VolumesSnapshotsTestJSON-437986313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d702a43-0c16-492a-9f65-658d84e5f106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-c5539308-b27c-4be0-ad75-3eca149cd829 req-23844844-3f74-4c68-a6cc-43ac41758e7c tempest-VolumesSnapshotsTestJSON-437986313 None] Flow 'volume_create_manager' (5e1818cb-de97-4fc6-91f0-a9a16f013cce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:36 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-c5539308-b27c-4be0-ad75-3eca149cd829 req-23844844-3f74-4c68-a6cc-43ac41758e7c tempest-VolumesSnapshotsTestJSON-437986313 None] Created volume successfully. Sep 23 00:22:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-190789e5-e417-410e-8f50-cf2c5132e0b5 req-eb39a36e-dccd-4154-bb7a-bccce0a97650 tempest-VolumesSnapshotsTestJSON-437986313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-190789e5-e417-410e-8f50-cf2c5132e0b5 req-eb39a36e-dccd-4154-bb7a-bccce0a97650 tempest-VolumesSnapshotsTestJSON-437986313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:38 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [req-190789e5-e417-410e-8f50-cf2c5132e0b5 req-eb39a36e-dccd-4154-bb7a-bccce0a97650 tempest-VolumesSnapshotsTestJSON-437986313 None] Creating offline snapshot 88829758-c724-4264-8e75-b4508f7f2393 of volume 3fa0aa78-9087-4a26-bbe6-8e9255e81ac1 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:22:38 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b54d8bc-a996-405b-a37c-3aab56671d30]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-190789e5-e417-410e-8f50-cf2c5132e0b5 req-eb39a36e-dccd-4154-bb7a-bccce0a97650 tempest-VolumesSnapshotsTestJSON-437986313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fa0aa78-9087-4a26-bbe6-8e9255e81ac1 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:38 devstack sudo[98536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fa0aa78-9087-4a26-bbe6-8e9255e81ac1 Sep 23 00:22:38 devstack sudo[98536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:38 devstack sudo[98536]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-190789e5-e417-410e-8f50-cf2c5132e0b5 req-eb39a36e-dccd-4154-bb7a-bccce0a97650 tempest-VolumesSnapshotsTestJSON-437986313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fa0aa78-9087-4a26-bbe6-8e9255e81ac1" returned: 0 in 0.645s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-190789e5-e417-410e-8f50-cf2c5132e0b5 req-eb39a36e-dccd-4154-bb7a-bccce0a97650 tempest-VolumesSnapshotsTestJSON-437986313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fa0aa78-9087-4a26-bbe6-8e9255e81ac1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fa0aa78-9087-4a26-bbe6-8e9255e81ac1.88829758-c724-4264-8e75-b4508f7f2393 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:38 devstack sudo[98541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fa0aa78-9087-4a26-bbe6-8e9255e81ac1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fa0aa78-9087-4a26-bbe6-8e9255e81ac1.88829758-c724-4264-8e75-b4508f7f2393 1G Sep 23 00:22:38 devstack sudo[98541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:39 devstack sudo[98541]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-190789e5-e417-410e-8f50-cf2c5132e0b5 req-eb39a36e-dccd-4154-bb7a-bccce0a97650 tempest-VolumesSnapshotsTestJSON-437986313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fa0aa78-9087-4a26-bbe6-8e9255e81ac1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fa0aa78-9087-4a26-bbe6-8e9255e81ac1.88829758-c724-4264-8e75-b4508f7f2393 1G" returned: 0 in 0.585s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-190789e5-e417-410e-8f50-cf2c5132e0b5 req-eb39a36e-dccd-4154-bb7a-bccce0a97650 tempest-VolumesSnapshotsTestJSON-437986313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fa0aa78-9087-4a26-bbe6-8e9255e81ac1 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fa0aa78-9087-4a26-bbe6-8e9255e81ac1.88829758-c724-4264-8e75-b4508f7f2393 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:39 devstack sudo[98547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fa0aa78-9087-4a26-bbe6-8e9255e81ac1 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fa0aa78-9087-4a26-bbe6-8e9255e81ac1.88829758-c724-4264-8e75-b4508f7f2393 Sep 23 00:22:39 devstack sudo[98547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:39 devstack sudo[98547]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-190789e5-e417-410e-8f50-cf2c5132e0b5 req-eb39a36e-dccd-4154-bb7a-bccce0a97650 tempest-VolumesSnapshotsTestJSON-437986313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fa0aa78-9087-4a26-bbe6-8e9255e81ac1 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fa0aa78-9087-4a26-bbe6-8e9255e81ac1.88829758-c724-4264-8e75-b4508f7f2393" returned: 0 in 0.456s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:39 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [req-190789e5-e417-410e-8f50-cf2c5132e0b5 req-eb39a36e-dccd-4154-bb7a-bccce0a97650 tempest-VolumesSnapshotsTestJSON-437986313 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fa0aa78-9087-4a26-bbe6-8e9255e81ac1.88829758-c724-4264-8e75-b4508f7f2393 is being set with open permissions: ugo+rw Sep 23 00:22:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-190789e5-e417-410e-8f50-cf2c5132e0b5 req-eb39a36e-dccd-4154-bb7a-bccce0a97650 tempest-VolumesSnapshotsTestJSON-437986313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fa0aa78-9087-4a26-bbe6-8e9255e81ac1.88829758-c724-4264-8e75-b4508f7f2393 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:40 devstack sudo[98552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fa0aa78-9087-4a26-bbe6-8e9255e81ac1.88829758-c724-4264-8e75-b4508f7f2393 Sep 23 00:22:40 devstack sudo[98552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:40 devstack sudo[98552]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-190789e5-e417-410e-8f50-cf2c5132e0b5 req-eb39a36e-dccd-4154-bb7a-bccce0a97650 tempest-VolumesSnapshotsTestJSON-437986313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fa0aa78-9087-4a26-bbe6-8e9255e81ac1.88829758-c724-4264-8e75-b4508f7f2393" returned: 0 in 0.404s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-190789e5-e417-410e-8f50-cf2c5132e0b5 req-eb39a36e-dccd-4154-bb7a-bccce0a97650 tempest-VolumesSnapshotsTestJSON-437986313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fa0aa78-9087-4a26-bbe6-8e9255e81ac1.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:40 devstack sudo[98558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fa0aa78-9087-4a26-bbe6-8e9255e81ac1.info Sep 23 00:22:40 devstack sudo[98558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:40 devstack sudo[98558]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-190789e5-e417-410e-8f50-cf2c5132e0b5 req-eb39a36e-dccd-4154-bb7a-bccce0a97650 tempest-VolumesSnapshotsTestJSON-437986313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fa0aa78-9087-4a26-bbe6-8e9255e81ac1.info" returned: 0 in 0.404s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:40 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [req-190789e5-e417-410e-8f50-cf2c5132e0b5 req-eb39a36e-dccd-4154-bb7a-bccce0a97650 tempest-VolumesSnapshotsTestJSON-437986313 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fa0aa78-9087-4a26-bbe6-8e9255e81ac1.info is being set with open permissions: ugo+rw Sep 23 00:22:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-190789e5-e417-410e-8f50-cf2c5132e0b5 req-eb39a36e-dccd-4154-bb7a-bccce0a97650 tempest-VolumesSnapshotsTestJSON-437986313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fa0aa78-9087-4a26-bbe6-8e9255e81ac1.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:40 devstack sudo[98561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fa0aa78-9087-4a26-bbe6-8e9255e81ac1.info Sep 23 00:22:40 devstack sudo[98561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:41 devstack sudo[98561]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-190789e5-e417-410e-8f50-cf2c5132e0b5 req-eb39a36e-dccd-4154-bb7a-bccce0a97650 tempest-VolumesSnapshotsTestJSON-437986313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fa0aa78-9087-4a26-bbe6-8e9255e81ac1.info" returned: 0 in 0.397s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-190789e5-e417-410e-8f50-cf2c5132e0b5 req-eb39a36e-dccd-4154-bb7a-bccce0a97650 tempest-VolumesSnapshotsTestJSON-437986313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.122s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:41 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-190789e5-e417-410e-8f50-cf2c5132e0b5 req-eb39a36e-dccd-4154-bb7a-bccce0a97650 tempest-VolumesSnapshotsTestJSON-437986313 None] Create snapshot completed successfully Sep 23 00:22:41 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-545df011-2c37-46f7-b153-6b0ba9a2b884 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:22:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-545df011-2c37-46f7-b153-6b0ba9a2b884 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Flow 'volume_create_manager' (1849e8f5-23c4-4cf2-aead-bcc3b2cf02f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-545df011-2c37-46f7-b153-6b0ba9a2b884 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bafc69b0-3f27-4198-8bdf-614dcec6c823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-545df011-2c37-46f7-b153-6b0ba9a2b884 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bafc69b0-3f27-4198-8bdf-614dcec6c823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2146282963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b08ee333-054b-4efa-b746-d5db8baff438,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a55a62446441349c3ac9eb7bc18e0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:42Z,use_quota=True,user_id='cc6158edd6274cc1983a049412fdf56f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-545df011-2c37-46f7-b153-6b0ba9a2b884 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68cd0282-d0cc-43f4-996f-36e9bcf1136a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-545df011-2c37-46f7-b153-6b0ba9a2b884 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68cd0282-d0cc-43f4-996f-36e9bcf1136a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-545df011-2c37-46f7-b153-6b0ba9a2b884 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50061496-6f0b-4217-bd8b-039102b4a27f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-545df011-2c37-46f7-b153-6b0ba9a2b884 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50061496-6f0b-4217-bd8b-039102b4a27f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b08ee333-054b-4efa-b746-d5db8baff438', 'volume_name': 'volume-b08ee333-054b-4efa-b746-d5db8baff438', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-545df011-2c37-46f7-b153-6b0ba9a2b884 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5354ea39-58a7-49b5-bc26-448424810b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-545df011-2c37-46f7-b153-6b0ba9a2b884 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5354ea39-58a7-49b5-bc26-448424810b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-545df011-2c37-46f7-b153-6b0ba9a2b884 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15700ad4-9cab-4d79-916a-ab8f8d6c703b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:41 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-545df011-2c37-46f7-b153-6b0ba9a2b884 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Volume b08ee333-054b-4efa-b746-d5db8baff438: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b08ee333-054b-4efa-b746-d5db8baff438', 'volume_size': 1} Sep 23 00:22:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-545df011-2c37-46f7-b153-6b0ba9a2b884 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-545df011-2c37-46f7-b153-6b0ba9a2b884 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-545df011-2c37-46f7-b153-6b0ba9a2b884 tempest-CreateVolumesFromSnapshotTest-1553016444 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2146282963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b08ee333-054b-4efa-b746-d5db8baff438,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a55a62446441349c3ac9eb7bc18e0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:42Z,use_quota=True,user_id='cc6158edd6274cc1983a049412fdf56f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:22:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-545df011-2c37-46f7-b153-6b0ba9a2b884 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Creating volume b08ee333-054b-4efa-b746-d5db8baff438 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:22:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-545df011-2c37-46f7-b153-6b0ba9a2b884 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-545df011-2c37-46f7-b153-6b0ba9a2b884 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-545df011-2c37-46f7-b153-6b0ba9a2b884 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-545df011-2c37-46f7-b153-6b0ba9a2b884 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-545df011-2c37-46f7-b153-6b0ba9a2b884 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-545df011-2c37-46f7-b153-6b0ba9a2b884 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:22:41 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-545df011-2c37-46f7-b153-6b0ba9a2b884 tempest-CreateVolumesFromSnapshotTest-1553016444 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:22:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-545df011-2c37-46f7-b153-6b0ba9a2b884 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b08ee333-054b-4efa-b746-d5db8baff438 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:41 devstack sudo[98564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b08ee333-054b-4efa-b746-d5db8baff438 1073741824 Sep 23 00:22:41 devstack sudo[98564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:42 devstack cinder-volume[86591]: DEBUG cinder.coordination [req-04ecff0a-adb1-4300-b323-80115bc1902c req-6577e7b6-cfea-491c-9174-7a1df224bd05 tempest-VolumesSnapshotsTestJSON-437986313 None] Acquiring lock "cinder-88829758-c724-4264-8e75-b4508f7f2393-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:42 devstack cinder-volume[86591]: DEBUG cinder.coordination [req-04ecff0a-adb1-4300-b323-80115bc1902c req-6577e7b6-cfea-491c-9174-7a1df224bd05 tempest-VolumesSnapshotsTestJSON-437986313 None] Lock "cinder-88829758-c724-4264-8e75-b4508f7f2393-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:42 devstack cinder-volume[86591]: DEBUG cinder.coordination [req-04ecff0a-adb1-4300-b323-80115bc1902c req-6577e7b6-cfea-491c-9174-7a1df224bd05 tempest-VolumesSnapshotsTestJSON-437986313 None] Acquiring lock "cinder-quobyte-3fa0aa78-9087-4a26-bbe6-8e9255e81ac1" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:42 devstack cinder-volume[86591]: DEBUG cinder.coordination [req-04ecff0a-adb1-4300-b323-80115bc1902c req-6577e7b6-cfea-491c-9174-7a1df224bd05 tempest-VolumesSnapshotsTestJSON-437986313 None] Lock "cinder-quobyte-3fa0aa78-9087-4a26-bbe6-8e9255e81ac1" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:42 devstack cinder-volume[86591]: DEBUG cinder.coordination [req-04ecff0a-adb1-4300-b323-80115bc1902c req-6577e7b6-cfea-491c-9174-7a1df224bd05 tempest-VolumesSnapshotsTestJSON-437986313 None] Acquiring lock "cinder-quobyte-88829758-c724-4264-8e75-b4508f7f2393" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:42 devstack cinder-volume[86591]: DEBUG cinder.coordination [req-04ecff0a-adb1-4300-b323-80115bc1902c req-6577e7b6-cfea-491c-9174-7a1df224bd05 tempest-VolumesSnapshotsTestJSON-437986313 None] Lock "cinder-quobyte-88829758-c724-4264-8e75-b4508f7f2393" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [req-04ecff0a-adb1-4300-b323-80115bc1902c req-6577e7b6-cfea-491c-9174-7a1df224bd05 tempest-VolumesSnapshotsTestJSON-437986313 None] Deleting offline snapshot 88829758-c724-4264-8e75-b4508f7f2393 of volume 3fa0aa78-9087-4a26-bbe6-8e9255e81ac1 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:22:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [req-04ecff0a-adb1-4300-b323-80115bc1902c req-6577e7b6-cfea-491c-9174-7a1df224bd05 tempest-VolumesSnapshotsTestJSON-437986313 None] snapshot_file for this snap is: volume-3fa0aa78-9087-4a26-bbe6-8e9255e81ac1.88829758-c724-4264-8e75-b4508f7f2393 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:22:42 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a60b3b33-54b6-4076-a450-ae8e0a2f38a7]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-04ecff0a-adb1-4300-b323-80115bc1902c req-6577e7b6-cfea-491c-9174-7a1df224bd05 tempest-VolumesSnapshotsTestJSON-437986313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fa0aa78-9087-4a26-bbe6-8e9255e81ac1.88829758-c724-4264-8e75-b4508f7f2393 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:42 devstack sudo[98564]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-545df011-2c37-46f7-b153-6b0ba9a2b884 tempest-CreateVolumesFromSnapshotTest-1553016444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b08ee333-054b-4efa-b746-d5db8baff438 1073741824" returned: 0 in 0.756s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-545df011-2c37-46f7-b153-6b0ba9a2b884 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b08ee333-054b-4efa-b746-d5db8baff438 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:42 devstack sudo[98572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b08ee333-054b-4efa-b746-d5db8baff438 Sep 23 00:22:42 devstack sudo[98572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:42 devstack sudo[98570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fa0aa78-9087-4a26-bbe6-8e9255e81ac1.88829758-c724-4264-8e75-b4508f7f2393 Sep 23 00:22:42 devstack sudo[98570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:42 devstack sudo[98572]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-545df011-2c37-46f7-b153-6b0ba9a2b884 tempest-CreateVolumesFromSnapshotTest-1553016444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b08ee333-054b-4efa-b746-d5db8baff438" returned: 0 in 0.357s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-545df011-2c37-46f7-b153-6b0ba9a2b884 tempest-CreateVolumesFromSnapshotTest-1553016444 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:22:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-545df011-2c37-46f7-b153-6b0ba9a2b884 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-545df011-2c37-46f7-b153-6b0ba9a2b884 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15700ad4-9cab-4d79-916a-ab8f8d6c703b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b08ee333-054b-4efa-b746-d5db8baff438', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:43 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-545df011-2c37-46f7-b153-6b0ba9a2b884 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6a94428-eda8-46e8-8248-c69c2c8e9589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:43 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-545df011-2c37-46f7-b153-6b0ba9a2b884 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Volume volume-b08ee333-054b-4efa-b746-d5db8baff438 (b08ee333-054b-4efa-b746-d5db8baff438): created successfully Sep 23 00:22:43 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-545df011-2c37-46f7-b153-6b0ba9a2b884 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6a94428-eda8-46e8-8248-c69c2c8e9589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:43 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-545df011-2c37-46f7-b153-6b0ba9a2b884 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Flow 'volume_create_manager' (1849e8f5-23c4-4cf2-aead-bcc3b2cf02f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:43 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-545df011-2c37-46f7-b153-6b0ba9a2b884 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Created volume successfully. Sep 23 00:22:43 devstack sudo[98570]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-04ecff0a-adb1-4300-b323-80115bc1902c req-6577e7b6-cfea-491c-9174-7a1df224bd05 tempest-VolumesSnapshotsTestJSON-437986313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fa0aa78-9087-4a26-bbe6-8e9255e81ac1.88829758-c724-4264-8e75-b4508f7f2393" returned: 0 in 0.667s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:43 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [req-04ecff0a-adb1-4300-b323-80115bc1902c req-6577e7b6-cfea-491c-9174-7a1df224bd05 tempest-VolumesSnapshotsTestJSON-437986313 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3fa0aa78-9087-4a26-bbe6-8e9255e81ac1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:22:43 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e425f1dd-c157-4dfa-980a-5f50216a6a32]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-04ecff0a-adb1-4300-b323-80115bc1902c req-6577e7b6-cfea-491c-9174-7a1df224bd05 tempest-VolumesSnapshotsTestJSON-437986313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fa0aa78-9087-4a26-bbe6-8e9255e81ac1 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:43 devstack sudo[98592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fa0aa78-9087-4a26-bbe6-8e9255e81ac1 Sep 23 00:22:43 devstack sudo[98592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:43 devstack sudo[98592]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-04ecff0a-adb1-4300-b323-80115bc1902c req-6577e7b6-cfea-491c-9174-7a1df224bd05 tempest-VolumesSnapshotsTestJSON-437986313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fa0aa78-9087-4a26-bbe6-8e9255e81ac1" returned: 0 in 0.652s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-04ecff0a-adb1-4300-b323-80115bc1902c req-6577e7b6-cfea-491c-9174-7a1df224bd05 tempest-VolumesSnapshotsTestJSON-437986313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fa0aa78-9087-4a26-bbe6-8e9255e81ac1.88829758-c724-4264-8e75-b4508f7f2393 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:43 devstack sudo[98602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fa0aa78-9087-4a26-bbe6-8e9255e81ac1.88829758-c724-4264-8e75-b4508f7f2393 Sep 23 00:22:43 devstack sudo[98602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e695be8f-b720-468b-b034-18578a1c379a tempest-CreateVolumesFromSnapshotTest-1553016444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e695be8f-b720-468b-b034-18578a1c379a tempest-CreateVolumesFromSnapshotTest-1553016444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:44 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-e695be8f-b720-468b-b034-18578a1c379a tempest-CreateVolumesFromSnapshotTest-1553016444 None] Creating offline snapshot 86ad55f3-a40a-4549-9bd5-7b776e25ce8a of volume b08ee333-054b-4efa-b746-d5db8baff438 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:22:44 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b7a677-d74b-4567-b7bb-cef2a7ec43ad]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e695be8f-b720-468b-b034-18578a1c379a tempest-CreateVolumesFromSnapshotTest-1553016444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b08ee333-054b-4efa-b746-d5db8baff438 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:44 devstack sudo[98602]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-04ecff0a-adb1-4300-b323-80115bc1902c req-6577e7b6-cfea-491c-9174-7a1df224bd05 tempest-VolumesSnapshotsTestJSON-437986313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fa0aa78-9087-4a26-bbe6-8e9255e81ac1.88829758-c724-4264-8e75-b4508f7f2393" returned: 0 in 0.558s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-04ecff0a-adb1-4300-b323-80115bc1902c req-6577e7b6-cfea-491c-9174-7a1df224bd05 tempest-VolumesSnapshotsTestJSON-437986313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fa0aa78-9087-4a26-bbe6-8e9255e81ac1.88829758-c724-4264-8e75-b4508f7f2393 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:44 devstack sudo[98609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fa0aa78-9087-4a26-bbe6-8e9255e81ac1.88829758-c724-4264-8e75-b4508f7f2393 Sep 23 00:22:44 devstack sudo[98609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:44 devstack sudo[98608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b08ee333-054b-4efa-b746-d5db8baff438 Sep 23 00:22:44 devstack sudo[98608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:44 devstack sudo[98609]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-04ecff0a-adb1-4300-b323-80115bc1902c req-6577e7b6-cfea-491c-9174-7a1df224bd05 tempest-VolumesSnapshotsTestJSON-437986313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fa0aa78-9087-4a26-bbe6-8e9255e81ac1.88829758-c724-4264-8e75-b4508f7f2393" returned: 0 in 0.345s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:44 devstack cinder-volume[86591]: DEBUG cinder.coordination [req-04ecff0a-adb1-4300-b323-80115bc1902c req-6577e7b6-cfea-491c-9174-7a1df224bd05 tempest-VolumesSnapshotsTestJSON-437986313 None] Lock "cinder-quobyte-88829758-c724-4264-8e75-b4508f7f2393" released by "_delete_snapshot" :: held 2.427s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:44 devstack cinder-volume[86591]: DEBUG cinder.coordination [req-04ecff0a-adb1-4300-b323-80115bc1902c req-6577e7b6-cfea-491c-9174-7a1df224bd05 tempest-VolumesSnapshotsTestJSON-437986313 None] Lock "cinder-quobyte-3fa0aa78-9087-4a26-bbe6-8e9255e81ac1" released by "delete_snapshot" :: held 2.459s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:44 devstack sudo[98608]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e695be8f-b720-468b-b034-18578a1c379a tempest-CreateVolumesFromSnapshotTest-1553016444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b08ee333-054b-4efa-b746-d5db8baff438" returned: 0 in 0.520s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e695be8f-b720-468b-b034-18578a1c379a tempest-CreateVolumesFromSnapshotTest-1553016444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b08ee333-054b-4efa-b746-d5db8baff438,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b08ee333-054b-4efa-b746-d5db8baff438.86ad55f3-a40a-4549-9bd5-7b776e25ce8a 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:44 devstack sudo[98616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b08ee333-054b-4efa-b746-d5db8baff438,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b08ee333-054b-4efa-b746-d5db8baff438.86ad55f3-a40a-4549-9bd5-7b776e25ce8a 1G Sep 23 00:22:44 devstack sudo[98616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:44 devstack cinder-volume[86591]: DEBUG cinder.quota [req-04ecff0a-adb1-4300-b323-80115bc1902c req-6577e7b6-cfea-491c-9174-7a1df224bd05 tempest-VolumesSnapshotsTestJSON-437986313 None] Created reservations ['8b47e1c1-9481-4477-b2f1-3b4d2ff2dda6', '0621ea00-4ec9-4765-897c-9122d0ae0a2d', 'bddfb912-5df8-40ed-b425-2062af017475', 'cb4dfc4f-80d8-4022-8bdb-0daeebcbd215'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:22:45 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-04ecff0a-adb1-4300-b323-80115bc1902c req-6577e7b6-cfea-491c-9174-7a1df224bd05 tempest-VolumesSnapshotsTestJSON-437986313 None] Delete snapshot completed successfully. Sep 23 00:22:45 devstack cinder-volume[86591]: DEBUG cinder.coordination [req-04ecff0a-adb1-4300-b323-80115bc1902c req-6577e7b6-cfea-491c-9174-7a1df224bd05 tempest-VolumesSnapshotsTestJSON-437986313 None] Lock "cinder-88829758-c724-4264-8e75-b4508f7f2393-delete_snapshot" released by "delete_snapshot" :: held 2.720s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:45 devstack sudo[98616]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e695be8f-b720-468b-b034-18578a1c379a tempest-CreateVolumesFromSnapshotTest-1553016444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b08ee333-054b-4efa-b746-d5db8baff438,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b08ee333-054b-4efa-b746-d5db8baff438.86ad55f3-a40a-4549-9bd5-7b776e25ce8a 1G" returned: 0 in 0.645s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e695be8f-b720-468b-b034-18578a1c379a tempest-CreateVolumesFromSnapshotTest-1553016444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b08ee333-054b-4efa-b746-d5db8baff438 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b08ee333-054b-4efa-b746-d5db8baff438.86ad55f3-a40a-4549-9bd5-7b776e25ce8a {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:45 devstack sudo[98622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b08ee333-054b-4efa-b746-d5db8baff438 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b08ee333-054b-4efa-b746-d5db8baff438.86ad55f3-a40a-4549-9bd5-7b776e25ce8a Sep 23 00:22:45 devstack sudo[98622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:45 devstack cinder-volume[86591]: DEBUG cinder.coordination [req-ca1555dc-31f4-468b-8204-085591b67565 req-2c6f0760-a742-4251-90a9-7da21736b99a tempest-VolumesSnapshotsTestJSON-437986313 None] Acquiring lock "cinder-3fa0aa78-9087-4a26-bbe6-8e9255e81ac1-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:45 devstack cinder-volume[86591]: DEBUG cinder.coordination [req-ca1555dc-31f4-468b-8204-085591b67565 req-2c6f0760-a742-4251-90a9-7da21736b99a tempest-VolumesSnapshotsTestJSON-437986313 None] Lock "cinder-3fa0aa78-9087-4a26-bbe6-8e9255e81ac1-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:45 devstack cinder-volume[86591]: DEBUG cinder.coordination [req-ca1555dc-31f4-468b-8204-085591b67565 req-2c6f0760-a742-4251-90a9-7da21736b99a tempest-VolumesSnapshotsTestJSON-437986313 None] Acquiring lock "cinder-quobyte-3fa0aa78-9087-4a26-bbe6-8e9255e81ac1" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:45 devstack cinder-volume[86591]: DEBUG cinder.coordination [req-ca1555dc-31f4-468b-8204-085591b67565 req-2c6f0760-a742-4251-90a9-7da21736b99a tempest-VolumesSnapshotsTestJSON-437986313 None] Lock "cinder-quobyte-3fa0aa78-9087-4a26-bbe6-8e9255e81ac1" acquired by "delete_volume" :: waited 0.016s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:46 devstack sudo[98622]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e695be8f-b720-468b-b034-18578a1c379a tempest-CreateVolumesFromSnapshotTest-1553016444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b08ee333-054b-4efa-b746-d5db8baff438 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b08ee333-054b-4efa-b746-d5db8baff438.86ad55f3-a40a-4549-9bd5-7b776e25ce8a" returned: 0 in 0.568s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:46 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-e695be8f-b720-468b-b034-18578a1c379a tempest-CreateVolumesFromSnapshotTest-1553016444 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b08ee333-054b-4efa-b746-d5db8baff438.86ad55f3-a40a-4549-9bd5-7b776e25ce8a is being set with open permissions: ugo+rw Sep 23 00:22:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e695be8f-b720-468b-b034-18578a1c379a tempest-CreateVolumesFromSnapshotTest-1553016444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b08ee333-054b-4efa-b746-d5db8baff438.86ad55f3-a40a-4549-9bd5-7b776e25ce8a {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:46 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b330fc-2696-42e0-ac0e-47c7cd584a8c]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-ca1555dc-31f4-468b-8204-085591b67565 req-2c6f0760-a742-4251-90a9-7da21736b99a tempest-VolumesSnapshotsTestJSON-437986313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fa0aa78-9087-4a26-bbe6-8e9255e81ac1 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:46 devstack sudo[98628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b08ee333-054b-4efa-b746-d5db8baff438.86ad55f3-a40a-4549-9bd5-7b776e25ce8a Sep 23 00:22:46 devstack sudo[98628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:46 devstack sudo[98629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fa0aa78-9087-4a26-bbe6-8e9255e81ac1 Sep 23 00:22:46 devstack sudo[98629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:46 devstack sudo[98628]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e695be8f-b720-468b-b034-18578a1c379a tempest-CreateVolumesFromSnapshotTest-1553016444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b08ee333-054b-4efa-b746-d5db8baff438.86ad55f3-a40a-4549-9bd5-7b776e25ce8a" returned: 0 in 0.390s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e695be8f-b720-468b-b034-18578a1c379a tempest-CreateVolumesFromSnapshotTest-1553016444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b08ee333-054b-4efa-b746-d5db8baff438.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:46 devstack sudo[98633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b08ee333-054b-4efa-b746-d5db8baff438.info Sep 23 00:22:46 devstack sudo[98633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:46 devstack sudo[98629]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-ca1555dc-31f4-468b-8204-085591b67565 req-2c6f0760-a742-4251-90a9-7da21736b99a tempest-VolumesSnapshotsTestJSON-437986313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fa0aa78-9087-4a26-bbe6-8e9255e81ac1" returned: 0 in 0.603s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-ca1555dc-31f4-468b-8204-085591b67565 req-2c6f0760-a742-4251-90a9-7da21736b99a tempest-VolumesSnapshotsTestJSON-437986313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fa0aa78-9087-4a26-bbe6-8e9255e81ac1 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:46 devstack sudo[98639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fa0aa78-9087-4a26-bbe6-8e9255e81ac1 Sep 23 00:22:46 devstack sudo[98639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:46 devstack sudo[98633]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e695be8f-b720-468b-b034-18578a1c379a tempest-CreateVolumesFromSnapshotTest-1553016444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b08ee333-054b-4efa-b746-d5db8baff438.info" returned: 0 in 0.411s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:46 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-e695be8f-b720-468b-b034-18578a1c379a tempest-CreateVolumesFromSnapshotTest-1553016444 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b08ee333-054b-4efa-b746-d5db8baff438.info is being set with open permissions: ugo+rw Sep 23 00:22:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e695be8f-b720-468b-b034-18578a1c379a tempest-CreateVolumesFromSnapshotTest-1553016444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b08ee333-054b-4efa-b746-d5db8baff438.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:46 devstack sudo[98643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b08ee333-054b-4efa-b746-d5db8baff438.info Sep 23 00:22:46 devstack sudo[98643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:47 devstack sudo[98639]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-ca1555dc-31f4-468b-8204-085591b67565 req-2c6f0760-a742-4251-90a9-7da21736b99a tempest-VolumesSnapshotsTestJSON-437986313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fa0aa78-9087-4a26-bbe6-8e9255e81ac1" returned: 0 in 0.419s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:47 devstack cinder-volume[86591]: DEBUG cinder.coordination [req-ca1555dc-31f4-468b-8204-085591b67565 req-2c6f0760-a742-4251-90a9-7da21736b99a tempest-VolumesSnapshotsTestJSON-437986313 None] Lock "cinder-quobyte-3fa0aa78-9087-4a26-bbe6-8e9255e81ac1" released by "delete_volume" :: held 1.233s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:47 devstack cinder-volume[86591]: DEBUG cinder.quota [req-ca1555dc-31f4-468b-8204-085591b67565 req-2c6f0760-a742-4251-90a9-7da21736b99a tempest-VolumesSnapshotsTestJSON-437986313 None] Created reservations ['c955dc1a-7a4c-48a5-a0ad-126a2554b884', '10dd143e-c9fc-402e-88da-02ff74e93658', '598dfe07-7d3c-44aa-87e7-d2c47bef4833', '9805c911-4eff-41e0-98d9-cc06b8260873'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:22:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-ca1555dc-31f4-468b-8204-085591b67565 req-2c6f0760-a742-4251-90a9-7da21736b99a tempest-VolumesSnapshotsTestJSON-437986313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-ca1555dc-31f4-468b-8204-085591b67565 req-2c6f0760-a742-4251-90a9-7da21736b99a tempest-VolumesSnapshotsTestJSON-437986313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:47 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [req-ca1555dc-31f4-468b-8204-085591b67565 req-2c6f0760-a742-4251-90a9-7da21736b99a tempest-VolumesSnapshotsTestJSON-437986313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:47 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [req-ca1555dc-31f4-468b-8204-085591b67565 req-2c6f0760-a742-4251-90a9-7da21736b99a tempest-VolumesSnapshotsTestJSON-437986313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-ca1555dc-31f4-468b-8204-085591b67565 req-2c6f0760-a742-4251-90a9-7da21736b99a tempest-VolumesSnapshotsTestJSON-437986313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-ca1555dc-31f4-468b-8204-085591b67565 req-2c6f0760-a742-4251-90a9-7da21736b99a tempest-VolumesSnapshotsTestJSON-437986313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:47 devstack sudo[98690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:22:47 devstack sudo[98690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:47 devstack sudo[98643]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e695be8f-b720-468b-b034-18578a1c379a tempest-CreateVolumesFromSnapshotTest-1553016444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b08ee333-054b-4efa-b746-d5db8baff438.info" returned: 0 in 0.871s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e695be8f-b720-468b-b034-18578a1c379a tempest-CreateVolumesFromSnapshotTest-1553016444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.556s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:47 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-e695be8f-b720-468b-b034-18578a1c379a tempest-CreateVolumesFromSnapshotTest-1553016444 None] Create snapshot completed successfully Sep 23 00:22:48 devstack sudo[98690]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-ca1555dc-31f4-468b-8204-085591b67565 req-2c6f0760-a742-4251-90a9-7da21736b99a tempest-VolumesSnapshotsTestJSON-437986313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.696s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:48 devstack cinder-volume[86591]: DEBUG cinder.manager [req-ca1555dc-31f4-468b-8204-085591b67565 req-2c6f0760-a742-4251-90a9-7da21736b99a tempest-VolumesSnapshotsTestJSON-437986313 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:22:48 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-ca1555dc-31f4-468b-8204-085591b67565 req-2c6f0760-a742-4251-90a9-7da21736b99a tempest-VolumesSnapshotsTestJSON-437986313 None] Deleted volume successfully. Sep 23 00:22:48 devstack cinder-volume[86591]: DEBUG cinder.coordination [req-ca1555dc-31f4-468b-8204-085591b67565 req-2c6f0760-a742-4251-90a9-7da21736b99a tempest-VolumesSnapshotsTestJSON-437986313 None] Lock "cinder-3fa0aa78-9087-4a26-bbe6-8e9255e81ac1-delete_volume" released by "delete_volume" :: held 2.578s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:50 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-55e88331-3bea-4c54-977b-d97ff36accd7 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:22:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-55e88331-3bea-4c54-977b-d97ff36accd7 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Flow 'volume_create_manager' (bddd2a28-77e3-4dae-903b-21a37c53e8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-55e88331-3bea-4c54-977b-d97ff36accd7 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71008799-585f-4f96-b0c8-111ceaf7e295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-55e88331-3bea-4c54-977b-d97ff36accd7 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71008799-585f-4f96-b0c8-111ceaf7e295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-729019100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2304fd9-18f6-4a33-a729-d50100c7da5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a55a62446441349c3ac9eb7bc18e0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:50Z,use_quota=True,user_id='cc6158edd6274cc1983a049412fdf56f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-55e88331-3bea-4c54-977b-d97ff36accd7 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fba9251-5c01-4634-b7cd-3f74069002d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-55e88331-3bea-4c54-977b-d97ff36accd7 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fba9251-5c01-4634-b7cd-3f74069002d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-55e88331-3bea-4c54-977b-d97ff36accd7 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (055ca7fd-39fb-4f76-a347-d2dd728fb36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-55e88331-3bea-4c54-977b-d97ff36accd7 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (055ca7fd-39fb-4f76-a347-d2dd728fb36b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2304fd9-18f6-4a33-a729-d50100c7da5a', 'volume_name': 'volume-a2304fd9-18f6-4a33-a729-d50100c7da5a', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-55e88331-3bea-4c54-977b-d97ff36accd7 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bddfd2c4-a799-4c58-ae5c-c8d251eb79bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-55e88331-3bea-4c54-977b-d97ff36accd7 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bddfd2c4-a799-4c58-ae5c-c8d251eb79bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-55e88331-3bea-4c54-977b-d97ff36accd7 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1717c96c-2620-4e00-ab06-9730de40be55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:50 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-55e88331-3bea-4c54-977b-d97ff36accd7 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Volume a2304fd9-18f6-4a33-a729-d50100c7da5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2304fd9-18f6-4a33-a729-d50100c7da5a', 'volume_size': 1} Sep 23 00:22:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-55e88331-3bea-4c54-977b-d97ff36accd7 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-55e88331-3bea-4c54-977b-d97ff36accd7 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:50 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-55e88331-3bea-4c54-977b-d97ff36accd7 tempest-CreateVolumesFromSnapshotTest-1553016444 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-729019100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2304fd9-18f6-4a33-a729-d50100c7da5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a55a62446441349c3ac9eb7bc18e0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:50Z,use_quota=True,user_id='cc6158edd6274cc1983a049412fdf56f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:22:50 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-55e88331-3bea-4c54-977b-d97ff36accd7 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Creating volume a2304fd9-18f6-4a33-a729-d50100c7da5a {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:22:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-55e88331-3bea-4c54-977b-d97ff36accd7 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-55e88331-3bea-4c54-977b-d97ff36accd7 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:50 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-55e88331-3bea-4c54-977b-d97ff36accd7 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:50 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-55e88331-3bea-4c54-977b-d97ff36accd7 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-55e88331-3bea-4c54-977b-d97ff36accd7 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:50 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-55e88331-3bea-4c54-977b-d97ff36accd7 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:22:50 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-55e88331-3bea-4c54-977b-d97ff36accd7 tempest-CreateVolumesFromSnapshotTest-1553016444 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:22:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-55e88331-3bea-4c54-977b-d97ff36accd7 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a2304fd9-18f6-4a33-a729-d50100c7da5a 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:50 devstack sudo[98720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a2304fd9-18f6-4a33-a729-d50100c7da5a 1073741824 Sep 23 00:22:50 devstack sudo[98720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:51 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-b641ff9a-d782-4ac1-91cf-a19c92d457a2 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:22:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b641ff9a-d782-4ac1-91cf-a19c92d457a2 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Flow 'volume_create_manager' (9901c2b1-3880-4372-985d-d9a3b9dc57fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b641ff9a-d782-4ac1-91cf-a19c92d457a2 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cf6cf9a-1035-4bb9-a40d-bf883d2a90b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b641ff9a-d782-4ac1-91cf-a19c92d457a2 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cf6cf9a-1035-4bb9-a40d-bf883d2a90b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-219222684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5597bf6d-4e89-495c-90de-463d2ec065ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a55a62446441349c3ac9eb7bc18e0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:51Z,use_quota=True,user_id='cc6158edd6274cc1983a049412fdf56f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b641ff9a-d782-4ac1-91cf-a19c92d457a2 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (855819b4-4493-4ee0-b68f-8a57487ffb91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b641ff9a-d782-4ac1-91cf-a19c92d457a2 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (855819b4-4493-4ee0-b68f-8a57487ffb91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b641ff9a-d782-4ac1-91cf-a19c92d457a2 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72e420ae-9743-4ee8-ba0d-55d1748419bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b641ff9a-d782-4ac1-91cf-a19c92d457a2 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72e420ae-9743-4ee8-ba0d-55d1748419bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5597bf6d-4e89-495c-90de-463d2ec065ae', 'volume_name': 'volume-5597bf6d-4e89-495c-90de-463d2ec065ae', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b641ff9a-d782-4ac1-91cf-a19c92d457a2 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e3a8386-adb5-40f6-ae34-16ff2954823e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b641ff9a-d782-4ac1-91cf-a19c92d457a2 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e3a8386-adb5-40f6-ae34-16ff2954823e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b641ff9a-d782-4ac1-91cf-a19c92d457a2 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (689bc4d2-6365-47ba-b125-5ff5cf8692d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:51 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-b641ff9a-d782-4ac1-91cf-a19c92d457a2 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Volume 5597bf6d-4e89-495c-90de-463d2ec065ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5597bf6d-4e89-495c-90de-463d2ec065ae', 'volume_size': 1} Sep 23 00:22:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b641ff9a-d782-4ac1-91cf-a19c92d457a2 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:51 devstack sudo[98720]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-55e88331-3bea-4c54-977b-d97ff36accd7 tempest-CreateVolumesFromSnapshotTest-1553016444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a2304fd9-18f6-4a33-a729-d50100c7da5a 1073741824" returned: 0 in 1.542s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-55e88331-3bea-4c54-977b-d97ff36accd7 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a2304fd9-18f6-4a33-a729-d50100c7da5a {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:52 devstack sudo[98728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a2304fd9-18f6-4a33-a729-d50100c7da5a Sep 23 00:22:52 devstack sudo[98728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:52 devstack sudo[98728]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-55e88331-3bea-4c54-977b-d97ff36accd7 tempest-CreateVolumesFromSnapshotTest-1553016444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a2304fd9-18f6-4a33-a729-d50100c7da5a" returned: 0 in 0.572s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:52 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-55e88331-3bea-4c54-977b-d97ff36accd7 tempest-CreateVolumesFromSnapshotTest-1553016444 None] <== create_volume: return (2248ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:22:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-55e88331-3bea-4c54-977b-d97ff36accd7 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.255s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b641ff9a-d782-4ac1-91cf-a19c92d457a2 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.117s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:52 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b641ff9a-d782-4ac1-91cf-a19c92d457a2 tempest-CreateVolumesFromSnapshotTest-1553016444 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-219222684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5597bf6d-4e89-495c-90de-463d2ec065ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a55a62446441349c3ac9eb7bc18e0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:51Z,use_quota=True,user_id='cc6158edd6274cc1983a049412fdf56f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:22:52 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-b641ff9a-d782-4ac1-91cf-a19c92d457a2 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Creating volume 5597bf6d-4e89-495c-90de-463d2ec065ae {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:22:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b641ff9a-d782-4ac1-91cf-a19c92d457a2 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b641ff9a-d782-4ac1-91cf-a19c92d457a2 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:52 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b641ff9a-d782-4ac1-91cf-a19c92d457a2 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:52 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b641ff9a-d782-4ac1-91cf-a19c92d457a2 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b641ff9a-d782-4ac1-91cf-a19c92d457a2 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:52 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b641ff9a-d782-4ac1-91cf-a19c92d457a2 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:22:52 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-b641ff9a-d782-4ac1-91cf-a19c92d457a2 tempest-CreateVolumesFromSnapshotTest-1553016444 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:22:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b641ff9a-d782-4ac1-91cf-a19c92d457a2 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-5597bf6d-4e89-495c-90de-463d2ec065ae 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-55e88331-3bea-4c54-977b-d97ff36accd7 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1717c96c-2620-4e00-ab06-9730de40be55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2304fd9-18f6-4a33-a729-d50100c7da5a', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-55e88331-3bea-4c54-977b-d97ff36accd7 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97c21a2a-66e9-4b1e-b555-3781c4351043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:52 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-88fbc60d-a057-428f-8b85-83d19c66079a tempest-CreateVolumesFromSnapshotTest-1553016444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:22:52 devstack sudo[98731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-5597bf6d-4e89-495c-90de-463d2ec065ae 1073741824 Sep 23 00:22:52 devstack sudo[98731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-88fbc60d-a057-428f-8b85-83d19c66079a tempest-CreateVolumesFromSnapshotTest-1553016444 None] Flow 'volume_create_manager' (10acfc83-adde-4a62-8178-17dc270ed429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-88fbc60d-a057-428f-8b85-83d19c66079a tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a8efa57-7548-44fe-88d8-8171eea6e35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-88fbc60d-a057-428f-8b85-83d19c66079a tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a8efa57-7548-44fe-88d8-8171eea6e35a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1622966239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1675176-c43b-4535-8e53-8784f60d4e90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a55a62446441349c3ac9eb7bc18e0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:53Z,use_quota=True,user_id='cc6158edd6274cc1983a049412fdf56f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-88fbc60d-a057-428f-8b85-83d19c66079a tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f8f75c2-396c-4f1f-891f-faa0a9798d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-88fbc60d-a057-428f-8b85-83d19c66079a tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f8f75c2-396c-4f1f-891f-faa0a9798d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-88fbc60d-a057-428f-8b85-83d19c66079a tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96f7a9c6-308a-4630-a69b-f4f796284379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-88fbc60d-a057-428f-8b85-83d19c66079a tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96f7a9c6-308a-4630-a69b-f4f796284379) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1675176-c43b-4535-8e53-8784f60d4e90', 'volume_name': 'volume-b1675176-c43b-4535-8e53-8784f60d4e90', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-88fbc60d-a057-428f-8b85-83d19c66079a tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (846d43cf-2a35-4e28-9ed0-541304376271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-88fbc60d-a057-428f-8b85-83d19c66079a tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (846d43cf-2a35-4e28-9ed0-541304376271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-88fbc60d-a057-428f-8b85-83d19c66079a tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82ab1067-a279-4772-aa88-b4a426dd3591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:53 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-88fbc60d-a057-428f-8b85-83d19c66079a tempest-CreateVolumesFromSnapshotTest-1553016444 None] Volume b1675176-c43b-4535-8e53-8784f60d4e90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1675176-c43b-4535-8e53-8784f60d4e90', 'volume_size': 1} Sep 23 00:22:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-88fbc60d-a057-428f-8b85-83d19c66079a tempest-CreateVolumesFromSnapshotTest-1553016444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:53 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-55e88331-3bea-4c54-977b-d97ff36accd7 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Volume volume-a2304fd9-18f6-4a33-a729-d50100c7da5a (a2304fd9-18f6-4a33-a729-d50100c7da5a): created successfully Sep 23 00:22:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-55e88331-3bea-4c54-977b-d97ff36accd7 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97c21a2a-66e9-4b1e-b555-3781c4351043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-55e88331-3bea-4c54-977b-d97ff36accd7 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Flow 'volume_create_manager' (bddd2a28-77e3-4dae-903b-21a37c53e8e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:53 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-55e88331-3bea-4c54-977b-d97ff36accd7 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Created volume successfully. Sep 23 00:22:53 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-d166e9d5-f7cb-4381-80e4-116654143412 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:22:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d166e9d5-f7cb-4381-80e4-116654143412 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Flow 'volume_create_manager' (e4d61604-56d9-4d71-9b04-c4f5e027893a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d166e9d5-f7cb-4381-80e4-116654143412 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca9af296-5576-40fb-bd48-16c145dc3d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d166e9d5-f7cb-4381-80e4-116654143412 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca9af296-5576-40fb-bd48-16c145dc3d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-218118075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7aebab6-20ba-485d-a064-d7c9b84ee60d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a55a62446441349c3ac9eb7bc18e0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:54Z,use_quota=True,user_id='cc6158edd6274cc1983a049412fdf56f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d166e9d5-f7cb-4381-80e4-116654143412 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32d3658e-1e42-468f-80ae-4f4a082955e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d166e9d5-f7cb-4381-80e4-116654143412 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32d3658e-1e42-468f-80ae-4f4a082955e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d166e9d5-f7cb-4381-80e4-116654143412 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b81f319f-c961-401b-95e5-10eb014e40c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d166e9d5-f7cb-4381-80e4-116654143412 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b81f319f-c961-401b-95e5-10eb014e40c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7aebab6-20ba-485d-a064-d7c9b84ee60d', 'volume_name': 'volume-c7aebab6-20ba-485d-a064-d7c9b84ee60d', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:53 devstack sudo[98731]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d166e9d5-f7cb-4381-80e4-116654143412 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec731cc7-8528-4b3c-918f-d9ac70ab6d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d166e9d5-f7cb-4381-80e4-116654143412 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec731cc7-8528-4b3c-918f-d9ac70ab6d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d166e9d5-f7cb-4381-80e4-116654143412 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3235e6bc-033d-4437-bceb-d3e993b02f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:53 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-d166e9d5-f7cb-4381-80e4-116654143412 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Volume c7aebab6-20ba-485d-a064-d7c9b84ee60d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7aebab6-20ba-485d-a064-d7c9b84ee60d', 'volume_size': 1} Sep 23 00:22:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d166e9d5-f7cb-4381-80e4-116654143412 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b641ff9a-d782-4ac1-91cf-a19c92d457a2 tempest-CreateVolumesFromSnapshotTest-1553016444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-5597bf6d-4e89-495c-90de-463d2ec065ae 1073741824" returned: 0 in 1.169s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b641ff9a-d782-4ac1-91cf-a19c92d457a2 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-5597bf6d-4e89-495c-90de-463d2ec065ae {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:54 devstack sudo[98737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-5597bf6d-4e89-495c-90de-463d2ec065ae Sep 23 00:22:54 devstack sudo[98737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:54 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fa2c2b4-e2d4-4a0f-b5de-398a9ba91954 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:22:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4fa2c2b4-e2d4-4a0f-b5de-398a9ba91954 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Flow 'volume_create_manager' (c7f7a27f-6683-496a-bc68-055eb74df4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4fa2c2b4-e2d4-4a0f-b5de-398a9ba91954 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fe99720-e9c6-4a49-95d2-6c736c5578f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4fa2c2b4-e2d4-4a0f-b5de-398a9ba91954 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fe99720-e9c6-4a49-95d2-6c736c5578f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-556474652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e25b63b8-7e38-4ec8-9050-44546de86b6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a55a62446441349c3ac9eb7bc18e0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:54Z,use_quota=True,user_id='cc6158edd6274cc1983a049412fdf56f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:54 devstack sudo[98737]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4fa2c2b4-e2d4-4a0f-b5de-398a9ba91954 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fb47a3c-ff94-49b3-aad6-baaca64e3573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4fa2c2b4-e2d4-4a0f-b5de-398a9ba91954 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fb47a3c-ff94-49b3-aad6-baaca64e3573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4fa2c2b4-e2d4-4a0f-b5de-398a9ba91954 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d2bd065-593a-45bd-8fa1-7918a85fbce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4fa2c2b4-e2d4-4a0f-b5de-398a9ba91954 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d2bd065-593a-45bd-8fa1-7918a85fbce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e25b63b8-7e38-4ec8-9050-44546de86b6b', 'volume_name': 'volume-e25b63b8-7e38-4ec8-9050-44546de86b6b', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4fa2c2b4-e2d4-4a0f-b5de-398a9ba91954 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e24ca22-3144-41ae-ab7d-bb66e657fe39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4fa2c2b4-e2d4-4a0f-b5de-398a9ba91954 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e24ca22-3144-41ae-ab7d-bb66e657fe39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4fa2c2b4-e2d4-4a0f-b5de-398a9ba91954 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c36de42-01a5-44f6-8d42-da7da96e076e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:54 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-4fa2c2b4-e2d4-4a0f-b5de-398a9ba91954 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Volume e25b63b8-7e38-4ec8-9050-44546de86b6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e25b63b8-7e38-4ec8-9050-44546de86b6b', 'volume_size': 1} Sep 23 00:22:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4fa2c2b4-e2d4-4a0f-b5de-398a9ba91954 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b641ff9a-d782-4ac1-91cf-a19c92d457a2 tempest-CreateVolumesFromSnapshotTest-1553016444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-5597bf6d-4e89-495c-90de-463d2ec065ae" returned: 0 in 0.483s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b641ff9a-d782-4ac1-91cf-a19c92d457a2 tempest-CreateVolumesFromSnapshotTest-1553016444 None] <== create_volume: return (1750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:22:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b641ff9a-d782-4ac1-91cf-a19c92d457a2 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.754s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-88fbc60d-a057-428f-8b85-83d19c66079a tempest-CreateVolumesFromSnapshotTest-1553016444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.341s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-88fbc60d-a057-428f-8b85-83d19c66079a tempest-CreateVolumesFromSnapshotTest-1553016444 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1622966239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1675176-c43b-4535-8e53-8784f60d4e90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a55a62446441349c3ac9eb7bc18e0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:53Z,use_quota=True,user_id='cc6158edd6274cc1983a049412fdf56f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:22:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-88fbc60d-a057-428f-8b85-83d19c66079a tempest-CreateVolumesFromSnapshotTest-1553016444 None] Creating volume b1675176-c43b-4535-8e53-8784f60d4e90 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:22:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-88fbc60d-a057-428f-8b85-83d19c66079a tempest-CreateVolumesFromSnapshotTest-1553016444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-88fbc60d-a057-428f-8b85-83d19c66079a tempest-CreateVolumesFromSnapshotTest-1553016444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-88fbc60d-a057-428f-8b85-83d19c66079a tempest-CreateVolumesFromSnapshotTest-1553016444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-88fbc60d-a057-428f-8b85-83d19c66079a tempest-CreateVolumesFromSnapshotTest-1553016444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-88fbc60d-a057-428f-8b85-83d19c66079a tempest-CreateVolumesFromSnapshotTest-1553016444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-88fbc60d-a057-428f-8b85-83d19c66079a tempest-CreateVolumesFromSnapshotTest-1553016444 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:22:54 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-88fbc60d-a057-428f-8b85-83d19c66079a tempest-CreateVolumesFromSnapshotTest-1553016444 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:22:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-88fbc60d-a057-428f-8b85-83d19c66079a tempest-CreateVolumesFromSnapshotTest-1553016444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b1675176-c43b-4535-8e53-8784f60d4e90 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b641ff9a-d782-4ac1-91cf-a19c92d457a2 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (689bc4d2-6365-47ba-b125-5ff5cf8692d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5597bf6d-4e89-495c-90de-463d2ec065ae', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:54 devstack sudo[98740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b1675176-c43b-4535-8e53-8784f60d4e90 1073741824 Sep 23 00:22:54 devstack sudo[98740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b641ff9a-d782-4ac1-91cf-a19c92d457a2 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34ea78e8-2405-4527-be64-cd27de962731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:54 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-b641ff9a-d782-4ac1-91cf-a19c92d457a2 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Volume volume-5597bf6d-4e89-495c-90de-463d2ec065ae (5597bf6d-4e89-495c-90de-463d2ec065ae): created successfully Sep 23 00:22:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b641ff9a-d782-4ac1-91cf-a19c92d457a2 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34ea78e8-2405-4527-be64-cd27de962731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b641ff9a-d782-4ac1-91cf-a19c92d457a2 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Flow 'volume_create_manager' (9901c2b1-3880-4372-985d-d9a3b9dc57fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:54 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-b641ff9a-d782-4ac1-91cf-a19c92d457a2 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Created volume successfully. Sep 23 00:22:55 devstack sudo[98740]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-88fbc60d-a057-428f-8b85-83d19c66079a tempest-CreateVolumesFromSnapshotTest-1553016444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b1675176-c43b-4535-8e53-8784f60d4e90 1073741824" returned: 0 in 0.755s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-88fbc60d-a057-428f-8b85-83d19c66079a tempest-CreateVolumesFromSnapshotTest-1553016444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b1675176-c43b-4535-8e53-8784f60d4e90 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:55 devstack sudo[98746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b1675176-c43b-4535-8e53-8784f60d4e90 Sep 23 00:22:55 devstack sudo[98746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:55 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-18fd7938-9d70-4b48-b89e-0f43d196d0ab tempest-VolumesActionsTest-1479696757 None] Acquiring lock "cinder-0a67aca6-ef90-438d-9197-57b23fb901c4" by "attach_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:55 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-18fd7938-9d70-4b48-b89e-0f43d196d0ab tempest-VolumesActionsTest-1479696757 None] Lock "cinder-0a67aca6-ef90-438d-9197-57b23fb901c4" acquired by "attach_volume" :: waited 0.091s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:55 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-18fd7938-9d70-4b48-b89e-0f43d196d0ab tempest-VolumesActionsTest-1479696757 None] Attaching volume 0a67aca6-ef90-438d-9197-57b23fb901c4 to instance e9406ced-a27a-4754-a01c-bf310f51aff1 at mountpoint /dev/vdb on host None. Sep 23 00:22:55 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-18fd7938-9d70-4b48-b89e-0f43d196d0ab tempest-VolumesActionsTest-1479696757 None] Attach volume completed successfully. Sep 23 00:22:55 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-18fd7938-9d70-4b48-b89e-0f43d196d0ab tempest-VolumesActionsTest-1479696757 None] Lock "cinder-0a67aca6-ef90-438d-9197-57b23fb901c4" released by "attach_volume" :: held 0.316s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:56 devstack sudo[98746]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-88fbc60d-a057-428f-8b85-83d19c66079a tempest-CreateVolumesFromSnapshotTest-1553016444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b1675176-c43b-4535-8e53-8784f60d4e90" returned: 0 in 0.760s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:56 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-88fbc60d-a057-428f-8b85-83d19c66079a tempest-CreateVolumesFromSnapshotTest-1553016444 None] <== create_volume: return (1631ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:22:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-88fbc60d-a057-428f-8b85-83d19c66079a tempest-CreateVolumesFromSnapshotTest-1553016444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.634s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d166e9d5-f7cb-4381-80e4-116654143412 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.223s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:56 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d166e9d5-f7cb-4381-80e4-116654143412 tempest-CreateVolumesFromSnapshotTest-1553016444 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-218118075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7aebab6-20ba-485d-a064-d7c9b84ee60d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a55a62446441349c3ac9eb7bc18e0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:54Z,use_quota=True,user_id='cc6158edd6274cc1983a049412fdf56f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:22:56 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-d166e9d5-f7cb-4381-80e4-116654143412 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Creating volume c7aebab6-20ba-485d-a064-d7c9b84ee60d {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:22:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d166e9d5-f7cb-4381-80e4-116654143412 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d166e9d5-f7cb-4381-80e4-116654143412 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:56 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d166e9d5-f7cb-4381-80e4-116654143412 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:56 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d166e9d5-f7cb-4381-80e4-116654143412 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d166e9d5-f7cb-4381-80e4-116654143412 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:56 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d166e9d5-f7cb-4381-80e4-116654143412 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:22:56 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-d166e9d5-f7cb-4381-80e4-116654143412 tempest-CreateVolumesFromSnapshotTest-1553016444 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:22:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d166e9d5-f7cb-4381-80e4-116654143412 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c7aebab6-20ba-485d-a064-d7c9b84ee60d 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:56 devstack sudo[98749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c7aebab6-20ba-485d-a064-d7c9b84ee60d 1073741824 Sep 23 00:22:56 devstack sudo[98749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-88fbc60d-a057-428f-8b85-83d19c66079a tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82ab1067-a279-4772-aa88-b4a426dd3591) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1675176-c43b-4535-8e53-8784f60d4e90', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-88fbc60d-a057-428f-8b85-83d19c66079a tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (817e2a1b-e741-4f3c-82ed-32177fbc608b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:56 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-88fbc60d-a057-428f-8b85-83d19c66079a tempest-CreateVolumesFromSnapshotTest-1553016444 None] Volume volume-b1675176-c43b-4535-8e53-8784f60d4e90 (b1675176-c43b-4535-8e53-8784f60d4e90): created successfully Sep 23 00:22:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-88fbc60d-a057-428f-8b85-83d19c66079a tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (817e2a1b-e741-4f3c-82ed-32177fbc608b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-88fbc60d-a057-428f-8b85-83d19c66079a tempest-CreateVolumesFromSnapshotTest-1553016444 None] Flow 'volume_create_manager' (10acfc83-adde-4a62-8178-17dc270ed429) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:56 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-88fbc60d-a057-428f-8b85-83d19c66079a tempest-CreateVolumesFromSnapshotTest-1553016444 None] Created volume successfully. Sep 23 00:22:56 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-39412533-bfbc-4a49-8310-66a5f356b425 tempest-VolumesActionsTest-1479696757 None] Acquiring lock "cinder-0a67aca6-ef90-438d-9197-57b23fb901c4-detach_volume" by "detach_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:56 devstack sudo[98749]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:56 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-39412533-bfbc-4a49-8310-66a5f356b425 tempest-VolumesActionsTest-1479696757 None] Lock "cinder-0a67aca6-ef90-438d-9197-57b23fb901c4-detach_volume" acquired by "detach_volume" :: waited 0.034s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:56 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-39412533-bfbc-4a49-8310-66a5f356b425 tempest-VolumesActionsTest-1479696757 None] Detaching volume 0a67aca6-ef90-438d-9197-57b23fb901c4 from instance e9406ced-a27a-4754-a01c-bf310f51aff1. Sep 23 00:22:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d166e9d5-f7cb-4381-80e4-116654143412 tempest-CreateVolumesFromSnapshotTest-1553016444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c7aebab6-20ba-485d-a064-d7c9b84ee60d 1073741824" returned: 0 in 0.886s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:57 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-39412533-bfbc-4a49-8310-66a5f356b425 tempest-VolumesActionsTest-1479696757 None] Detach volume completed successfully. Sep 23 00:22:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d166e9d5-f7cb-4381-80e4-116654143412 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c7aebab6-20ba-485d-a064-d7c9b84ee60d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:57 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-39412533-bfbc-4a49-8310-66a5f356b425 tempest-VolumesActionsTest-1479696757 None] Lock "cinder-0a67aca6-ef90-438d-9197-57b23fb901c4-detach_volume" released by "detach_volume" :: held 0.170s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:57 devstack sudo[98756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c7aebab6-20ba-485d-a064-d7c9b84ee60d Sep 23 00:22:57 devstack sudo[98756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:57 devstack sudo[98756]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d166e9d5-f7cb-4381-80e4-116654143412 tempest-CreateVolumesFromSnapshotTest-1553016444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c7aebab6-20ba-485d-a064-d7c9b84ee60d" returned: 0 in 0.464s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:57 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d166e9d5-f7cb-4381-80e4-116654143412 tempest-CreateVolumesFromSnapshotTest-1553016444 None] <== create_volume: return (1493ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:22:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d166e9d5-f7cb-4381-80e4-116654143412 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.499s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4fa2c2b4-e2d4-4a0f-b5de-398a9ba91954 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.175s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:57 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4fa2c2b4-e2d4-4a0f-b5de-398a9ba91954 tempest-CreateVolumesFromSnapshotTest-1553016444 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-556474652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e25b63b8-7e38-4ec8-9050-44546de86b6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a55a62446441349c3ac9eb7bc18e0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:54Z,use_quota=True,user_id='cc6158edd6274cc1983a049412fdf56f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:22:57 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-4fa2c2b4-e2d4-4a0f-b5de-398a9ba91954 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Creating volume e25b63b8-7e38-4ec8-9050-44546de86b6b {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:22:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4fa2c2b4-e2d4-4a0f-b5de-398a9ba91954 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4fa2c2b4-e2d4-4a0f-b5de-398a9ba91954 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:57 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4fa2c2b4-e2d4-4a0f-b5de-398a9ba91954 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:57 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4fa2c2b4-e2d4-4a0f-b5de-398a9ba91954 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4fa2c2b4-e2d4-4a0f-b5de-398a9ba91954 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:57 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4fa2c2b4-e2d4-4a0f-b5de-398a9ba91954 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:22:57 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-4fa2c2b4-e2d4-4a0f-b5de-398a9ba91954 tempest-CreateVolumesFromSnapshotTest-1553016444 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:22:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4fa2c2b4-e2d4-4a0f-b5de-398a9ba91954 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e25b63b8-7e38-4ec8-9050-44546de86b6b 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:57 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d166e9d5-f7cb-4381-80e4-116654143412 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3235e6bc-033d-4437-bceb-d3e993b02f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7aebab6-20ba-485d-a064-d7c9b84ee60d', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:57 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d166e9d5-f7cb-4381-80e4-116654143412 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0076036e-ef96-4f2f-b783-a2955a9a529c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:57 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-d166e9d5-f7cb-4381-80e4-116654143412 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Volume volume-c7aebab6-20ba-485d-a064-d7c9b84ee60d (c7aebab6-20ba-485d-a064-d7c9b84ee60d): created successfully Sep 23 00:22:57 devstack sudo[98759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e25b63b8-7e38-4ec8-9050-44546de86b6b 1073741824 Sep 23 00:22:57 devstack sudo[98759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:57 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d166e9d5-f7cb-4381-80e4-116654143412 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0076036e-ef96-4f2f-b783-a2955a9a529c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:57 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d166e9d5-f7cb-4381-80e4-116654143412 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Flow 'volume_create_manager' (e4d61604-56d9-4d71-9b04-c4f5e027893a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:57 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-d166e9d5-f7cb-4381-80e4-116654143412 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Created volume successfully. Sep 23 00:22:58 devstack sudo[98759]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4fa2c2b4-e2d4-4a0f-b5de-398a9ba91954 tempest-CreateVolumesFromSnapshotTest-1553016444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e25b63b8-7e38-4ec8-9050-44546de86b6b 1073741824" returned: 0 in 1.163s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4fa2c2b4-e2d4-4a0f-b5de-398a9ba91954 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e25b63b8-7e38-4ec8-9050-44546de86b6b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:58 devstack sudo[98785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e25b63b8-7e38-4ec8-9050-44546de86b6b Sep 23 00:22:58 devstack sudo[98785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:59 devstack sudo[98785]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4fa2c2b4-e2d4-4a0f-b5de-398a9ba91954 tempest-CreateVolumesFromSnapshotTest-1553016444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e25b63b8-7e38-4ec8-9050-44546de86b6b" returned: 0 in 0.491s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4fa2c2b4-e2d4-4a0f-b5de-398a9ba91954 tempest-CreateVolumesFromSnapshotTest-1553016444 None] <== create_volume: return (1754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:22:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4fa2c2b4-e2d4-4a0f-b5de-398a9ba91954 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.761s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4fa2c2b4-e2d4-4a0f-b5de-398a9ba91954 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c36de42-01a5-44f6-8d42-da7da96e076e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e25b63b8-7e38-4ec8-9050-44546de86b6b', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4fa2c2b4-e2d4-4a0f-b5de-398a9ba91954 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f3d3b66-829a-4a98-89eb-a1e506a200df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:59 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-4fa2c2b4-e2d4-4a0f-b5de-398a9ba91954 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Volume volume-e25b63b8-7e38-4ec8-9050-44546de86b6b (e25b63b8-7e38-4ec8-9050-44546de86b6b): created successfully Sep 23 00:22:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4fa2c2b4-e2d4-4a0f-b5de-398a9ba91954 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f3d3b66-829a-4a98-89eb-a1e506a200df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4fa2c2b4-e2d4-4a0f-b5de-398a9ba91954 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Flow 'volume_create_manager' (c7f7a27f-6683-496a-bc68-055eb74df4d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:59 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-4fa2c2b4-e2d4-4a0f-b5de-398a9ba91954 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Created volume successfully. Sep 23 00:23:00 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0cd6dbc7-fdd6-4b72-9aa2-41d93ee4588f tempest-CreateVolumesFromSnapshotTest-1553016444 None] Acquiring lock "cinder-e25b63b8-7e38-4ec8-9050-44546de86b6b-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:00 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0cd6dbc7-fdd6-4b72-9aa2-41d93ee4588f tempest-CreateVolumesFromSnapshotTest-1553016444 None] Lock "cinder-e25b63b8-7e38-4ec8-9050-44546de86b6b-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:00 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0cd6dbc7-fdd6-4b72-9aa2-41d93ee4588f tempest-CreateVolumesFromSnapshotTest-1553016444 None] Acquiring lock "cinder-quobyte-e25b63b8-7e38-4ec8-9050-44546de86b6b" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:00 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0cd6dbc7-fdd6-4b72-9aa2-41d93ee4588f tempest-CreateVolumesFromSnapshotTest-1553016444 None] Lock "cinder-quobyte-e25b63b8-7e38-4ec8-9050-44546de86b6b" acquired by "delete_volume" :: waited 0.021s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:00 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7df1a3-a02c-4254-8a34-400d90288489]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:23:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0cd6dbc7-fdd6-4b72-9aa2-41d93ee4588f tempest-CreateVolumesFromSnapshotTest-1553016444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e25b63b8-7e38-4ec8-9050-44546de86b6b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5c4c0ae5-c256-441d-ba8f-841625a012ad tempest-BackendsCapabilitiesAdminTestsJSON-1071441665 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5221061706543, 'free_capacity_gb': 1775.5221061706543, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86591) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 23 00:23:01 devstack sudo[98791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e25b63b8-7e38-4ec8-9050-44546de86b6b Sep 23 00:23:01 devstack sudo[98791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-86bc9779-f5da-4ec7-884e-f7a7d1242aef tempest-BackendsCapabilitiesAdminTestsJSON-1071441665 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5221061706543, 'free_capacity_gb': 1775.5221061706543, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86591) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 23 00:23:01 devstack sudo[98791]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0cd6dbc7-fdd6-4b72-9aa2-41d93ee4588f tempest-CreateVolumesFromSnapshotTest-1553016444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e25b63b8-7e38-4ec8-9050-44546de86b6b" returned: 0 in 0.705s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0cd6dbc7-fdd6-4b72-9aa2-41d93ee4588f tempest-CreateVolumesFromSnapshotTest-1553016444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e25b63b8-7e38-4ec8-9050-44546de86b6b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:01 devstack sudo[98796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e25b63b8-7e38-4ec8-9050-44546de86b6b Sep 23 00:23:01 devstack sudo[98796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:01 devstack sudo[98796]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0cd6dbc7-fdd6-4b72-9aa2-41d93ee4588f tempest-CreateVolumesFromSnapshotTest-1553016444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e25b63b8-7e38-4ec8-9050-44546de86b6b" returned: 0 in 0.421s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:01 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0cd6dbc7-fdd6-4b72-9aa2-41d93ee4588f tempest-CreateVolumesFromSnapshotTest-1553016444 None] Lock "cinder-quobyte-e25b63b8-7e38-4ec8-9050-44546de86b6b" released by "delete_volume" :: held 1.220s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:02 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-0cd6dbc7-fdd6-4b72-9aa2-41d93ee4588f tempest-CreateVolumesFromSnapshotTest-1553016444 None] Created reservations ['3609187c-2bfc-4f5f-b2f9-3965c5464d18', '84a6e73f-d22b-4f40-abe2-6e3c8c7e231a', 'ca8a5999-dc94-44ab-9df0-d7f7fda4fa9b', '5d66b13c-1409-4229-b829-979eae51fc4a'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:23:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0cd6dbc7-fdd6-4b72-9aa2-41d93ee4588f tempest-CreateVolumesFromSnapshotTest-1553016444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0cd6dbc7-fdd6-4b72-9aa2-41d93ee4588f tempest-CreateVolumesFromSnapshotTest-1553016444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:02 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0cd6dbc7-fdd6-4b72-9aa2-41d93ee4588f tempest-CreateVolumesFromSnapshotTest-1553016444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:23:02 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0cd6dbc7-fdd6-4b72-9aa2-41d93ee4588f tempest-CreateVolumesFromSnapshotTest-1553016444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:23:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0cd6dbc7-fdd6-4b72-9aa2-41d93ee4588f tempest-CreateVolumesFromSnapshotTest-1553016444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0cd6dbc7-fdd6-4b72-9aa2-41d93ee4588f tempest-CreateVolumesFromSnapshotTest-1553016444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:02 devstack sudo[98799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:23:02 devstack sudo[98799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:02 devstack sudo[98799]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0cd6dbc7-fdd6-4b72-9aa2-41d93ee4588f tempest-CreateVolumesFromSnapshotTest-1553016444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.698s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:02 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-0cd6dbc7-fdd6-4b72-9aa2-41d93ee4588f tempest-CreateVolumesFromSnapshotTest-1553016444 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:23:02 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-0cd6dbc7-fdd6-4b72-9aa2-41d93ee4588f tempest-CreateVolumesFromSnapshotTest-1553016444 None] Deleted volume successfully. Sep 23 00:23:03 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0cd6dbc7-fdd6-4b72-9aa2-41d93ee4588f tempest-CreateVolumesFromSnapshotTest-1553016444 None] Lock "cinder-e25b63b8-7e38-4ec8-9050-44546de86b6b-delete_volume" released by "delete_volume" :: held 2.352s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:03 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-09d454f0-de49-4aab-a9ce-bc6f47558b62 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Acquiring lock "cinder-c7aebab6-20ba-485d-a064-d7c9b84ee60d-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:03 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-09d454f0-de49-4aab-a9ce-bc6f47558b62 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Lock "cinder-c7aebab6-20ba-485d-a064-d7c9b84ee60d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:03 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-09d454f0-de49-4aab-a9ce-bc6f47558b62 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Acquiring lock "cinder-quobyte-c7aebab6-20ba-485d-a064-d7c9b84ee60d" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:03 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-09d454f0-de49-4aab-a9ce-bc6f47558b62 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Lock "cinder-quobyte-c7aebab6-20ba-485d-a064-d7c9b84ee60d" acquired by "delete_volume" :: waited 0.027s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:03 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[53518724-d47a-418a-a20e-3cf5d59507b7]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:23:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-09d454f0-de49-4aab-a9ce-bc6f47558b62 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c7aebab6-20ba-485d-a064-d7c9b84ee60d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:03 devstack sudo[98802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c7aebab6-20ba-485d-a064-d7c9b84ee60d Sep 23 00:23:03 devstack sudo[98802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:03 devstack sudo[98802]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-09d454f0-de49-4aab-a9ce-bc6f47558b62 tempest-CreateVolumesFromSnapshotTest-1553016444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c7aebab6-20ba-485d-a064-d7c9b84ee60d" returned: 0 in 0.545s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-09d454f0-de49-4aab-a9ce-bc6f47558b62 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c7aebab6-20ba-485d-a064-d7c9b84ee60d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:03 devstack sudo[98807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c7aebab6-20ba-485d-a064-d7c9b84ee60d Sep 23 00:23:03 devstack sudo[98807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:04 devstack sudo[98807]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-09d454f0-de49-4aab-a9ce-bc6f47558b62 tempest-CreateVolumesFromSnapshotTest-1553016444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c7aebab6-20ba-485d-a064-d7c9b84ee60d" returned: 0 in 0.343s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:04 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-09d454f0-de49-4aab-a9ce-bc6f47558b62 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Lock "cinder-quobyte-c7aebab6-20ba-485d-a064-d7c9b84ee60d" released by "delete_volume" :: held 0.960s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:04 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-09d454f0-de49-4aab-a9ce-bc6f47558b62 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Created reservations ['c79cf605-e11c-4ea9-8ca1-68582b576948', 'f361648f-f446-4369-bdf0-2ae1b1f10741', '5883ec25-98b3-410b-8500-b50c99a9e4be', '0f58a9ca-8096-45e9-a603-f67dd52ef7c9'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:23:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-09d454f0-de49-4aab-a9ce-bc6f47558b62 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-09d454f0-de49-4aab-a9ce-bc6f47558b62 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:04 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-09d454f0-de49-4aab-a9ce-bc6f47558b62 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:23:04 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-09d454f0-de49-4aab-a9ce-bc6f47558b62 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:23:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-09d454f0-de49-4aab-a9ce-bc6f47558b62 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-09d454f0-de49-4aab-a9ce-bc6f47558b62 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:04 devstack sudo[98810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:23:04 devstack sudo[98810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a806f559-7def-4460-97c4-fa51971c46f3 tempest-VolumesActionsTest-1479696757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a806f559-7def-4460-97c4-fa51971c46f3 tempest-VolumesActionsTest-1479696757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.005s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:04 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[19cf29c0-ecd2-4b72-ac54-0bcb54b4729b]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:23:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a806f559-7def-4460-97c4-fa51971c46f3 tempest-VolumesActionsTest-1479696757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-0a67aca6-ef90-438d-9197-57b23fb901c4 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:04 devstack sudo[98810]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-09d454f0-de49-4aab-a9ce-bc6f47558b62 tempest-CreateVolumesFromSnapshotTest-1553016444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.431s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:04 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-09d454f0-de49-4aab-a9ce-bc6f47558b62 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:23:04 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-09d454f0-de49-4aab-a9ce-bc6f47558b62 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Deleted volume successfully. Sep 23 00:23:04 devstack sudo[98812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-0a67aca6-ef90-438d-9197-57b23fb901c4 Sep 23 00:23:04 devstack sudo[98812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:04 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-09d454f0-de49-4aab-a9ce-bc6f47558b62 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Lock "cinder-c7aebab6-20ba-485d-a064-d7c9b84ee60d-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:05 devstack sudo[98812]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a806f559-7def-4460-97c4-fa51971c46f3 tempest-VolumesActionsTest-1479696757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-0a67aca6-ef90-438d-9197-57b23fb901c4" returned: 0 in 0.630s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:05 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b672a97-0372-41b4-b64d-3db1b7d47f5c]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:23:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a806f559-7def-4460-97c4-fa51971c46f3 tempest-VolumesActionsTest-1479696757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-0a67aca6-ef90-438d-9197-57b23fb901c4 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:05 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-24e2ad5b-c72e-4689-a9ef-8c4837f3edb7 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Acquiring lock "cinder-b1675176-c43b-4535-8e53-8784f60d4e90-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:05 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-24e2ad5b-c72e-4689-a9ef-8c4837f3edb7 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Lock "cinder-b1675176-c43b-4535-8e53-8784f60d4e90-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:05 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-24e2ad5b-c72e-4689-a9ef-8c4837f3edb7 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Acquiring lock "cinder-quobyte-b1675176-c43b-4535-8e53-8784f60d4e90" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:05 devstack sudo[98818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-0a67aca6-ef90-438d-9197-57b23fb901c4 Sep 23 00:23:05 devstack sudo[98818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:05 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-24e2ad5b-c72e-4689-a9ef-8c4837f3edb7 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Lock "cinder-quobyte-b1675176-c43b-4535-8e53-8784f60d4e90" acquired by "delete_volume" :: waited 0.023s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:05 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b390cbd-a9ee-40a1-8807-cbab470d5442]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:23:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-24e2ad5b-c72e-4689-a9ef-8c4837f3edb7 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b1675176-c43b-4535-8e53-8784f60d4e90 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:05 devstack sudo[98820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b1675176-c43b-4535-8e53-8784f60d4e90 Sep 23 00:23:05 devstack sudo[98820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:05 devstack sudo[98818]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a806f559-7def-4460-97c4-fa51971c46f3 tempest-VolumesActionsTest-1479696757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-0a67aca6-ef90-438d-9197-57b23fb901c4" returned: 0 in 0.586s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a806f559-7def-4460-97c4-fa51971c46f3 tempest-VolumesActionsTest-1479696757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-0a67aca6-ef90-438d-9197-57b23fb901c4 /opt/stack/data/cinder/conversion/0a67aca6-ef90-438d-9197-57b23fb901c4.temp_image.65e46f93-55f2-4179-b66e-ef5f177fa675ekk7k0_4.img {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:06 devstack sudo[98825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-0a67aca6-ef90-438d-9197-57b23fb901c4 /opt/stack/data/cinder/conversion/0a67aca6-ef90-438d-9197-57b23fb901c4.temp_image.65e46f93-55f2-4179-b66e-ef5f177fa675ekk7k0_4.img Sep 23 00:23:06 devstack sudo[98825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:06 devstack sudo[98820]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-24e2ad5b-c72e-4689-a9ef-8c4837f3edb7 tempest-CreateVolumesFromSnapshotTest-1553016444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b1675176-c43b-4535-8e53-8784f60d4e90" returned: 0 in 0.560s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-24e2ad5b-c72e-4689-a9ef-8c4837f3edb7 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b1675176-c43b-4535-8e53-8784f60d4e90 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:06 devstack sudo[98832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b1675176-c43b-4535-8e53-8784f60d4e90 Sep 23 00:23:06 devstack sudo[98832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:06 devstack sudo[98832]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-24e2ad5b-c72e-4689-a9ef-8c4837f3edb7 tempest-CreateVolumesFromSnapshotTest-1553016444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b1675176-c43b-4535-8e53-8784f60d4e90" returned: 0 in 0.580s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:06 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-24e2ad5b-c72e-4689-a9ef-8c4837f3edb7 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Lock "cinder-quobyte-b1675176-c43b-4535-8e53-8784f60d4e90" released by "delete_volume" :: held 1.233s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:07 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-24e2ad5b-c72e-4689-a9ef-8c4837f3edb7 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Created reservations ['11cd03dc-4544-4c08-9697-408fbf1d5dd1', '03a3d3b7-0b21-47d5-9f92-a4669824dd1f', 'c5091cbc-dfe1-4579-8b56-0fe23c6508f5', '8451de3f-c400-4312-8025-de99a0017070'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:23:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-24e2ad5b-c72e-4689-a9ef-8c4837f3edb7 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-24e2ad5b-c72e-4689-a9ef-8c4837f3edb7 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:07 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-24e2ad5b-c72e-4689-a9ef-8c4837f3edb7 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:23:07 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-24e2ad5b-c72e-4689-a9ef-8c4837f3edb7 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:23:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-24e2ad5b-c72e-4689-a9ef-8c4837f3edb7 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-24e2ad5b-c72e-4689-a9ef-8c4837f3edb7 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:07 devstack sudo[98846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:23:07 devstack sudo[98846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:08 devstack sudo[98846]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:08 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-51427150-7efd-440a-a533-79bfb275fa2b tempest-CreateVolumesFromSnapshotTest-1553016444 None] Acquiring lock "cinder-5597bf6d-4e89-495c-90de-463d2ec065ae-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-24e2ad5b-c72e-4689-a9ef-8c4837f3edb7 tempest-CreateVolumesFromSnapshotTest-1553016444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 1.066s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:08 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-24e2ad5b-c72e-4689-a9ef-8c4837f3edb7 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:23:08 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-24e2ad5b-c72e-4689-a9ef-8c4837f3edb7 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Deleted volume successfully. Sep 23 00:23:08 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-51427150-7efd-440a-a533-79bfb275fa2b tempest-CreateVolumesFromSnapshotTest-1553016444 None] Lock "cinder-5597bf6d-4e89-495c-90de-463d2ec065ae-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:08 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-24e2ad5b-c72e-4689-a9ef-8c4837f3edb7 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Lock "cinder-b1675176-c43b-4535-8e53-8784f60d4e90-delete_volume" released by "delete_volume" :: held 2.919s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:08 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-51427150-7efd-440a-a533-79bfb275fa2b tempest-CreateVolumesFromSnapshotTest-1553016444 None] Acquiring lock "cinder-quobyte-5597bf6d-4e89-495c-90de-463d2ec065ae" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:08 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-51427150-7efd-440a-a533-79bfb275fa2b tempest-CreateVolumesFromSnapshotTest-1553016444 None] Lock "cinder-quobyte-5597bf6d-4e89-495c-90de-463d2ec065ae" acquired by "delete_volume" :: waited 0.049s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:08 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[89183778-25fb-426d-9423-3c1663a59de8]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:23:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-51427150-7efd-440a-a533-79bfb275fa2b tempest-CreateVolumesFromSnapshotTest-1553016444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-5597bf6d-4e89-495c-90de-463d2ec065ae {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:09 devstack sudo[98883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-5597bf6d-4e89-495c-90de-463d2ec065ae Sep 23 00:23:09 devstack sudo[98883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:09 devstack sudo[98883]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-51427150-7efd-440a-a533-79bfb275fa2b tempest-CreateVolumesFromSnapshotTest-1553016444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-5597bf6d-4e89-495c-90de-463d2ec065ae" returned: 0 in 1.132s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-51427150-7efd-440a-a533-79bfb275fa2b tempest-CreateVolumesFromSnapshotTest-1553016444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-5597bf6d-4e89-495c-90de-463d2ec065ae {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:09 devstack sudo[98890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-5597bf6d-4e89-495c-90de-463d2ec065ae Sep 23 00:23:09 devstack sudo[98890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:10 devstack sudo[98890]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-51427150-7efd-440a-a533-79bfb275fa2b tempest-CreateVolumesFromSnapshotTest-1553016444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-5597bf6d-4e89-495c-90de-463d2ec065ae" returned: 0 in 0.609s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:10 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-51427150-7efd-440a-a533-79bfb275fa2b tempest-CreateVolumesFromSnapshotTest-1553016444 None] Lock "cinder-quobyte-5597bf6d-4e89-495c-90de-463d2ec065ae" released by "delete_volume" :: held 1.906s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:10 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-51427150-7efd-440a-a533-79bfb275fa2b tempest-CreateVolumesFromSnapshotTest-1553016444 None] Created reservations ['728c6cbb-f71e-4f3f-93cf-2e81ee0e307b', '8cfff550-6556-4db1-bfca-5026fefd633e', 'be4d7085-83de-4d3b-9e6d-91929d921e34', '8c9954b9-b47e-4f01-a6a7-d03e1a2676ef'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:23:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-51427150-7efd-440a-a533-79bfb275fa2b tempest-CreateVolumesFromSnapshotTest-1553016444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-51427150-7efd-440a-a533-79bfb275fa2b tempest-CreateVolumesFromSnapshotTest-1553016444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:10 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-51427150-7efd-440a-a533-79bfb275fa2b tempest-CreateVolumesFromSnapshotTest-1553016444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:23:10 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-51427150-7efd-440a-a533-79bfb275fa2b tempest-CreateVolumesFromSnapshotTest-1553016444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:23:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-51427150-7efd-440a-a533-79bfb275fa2b tempest-CreateVolumesFromSnapshotTest-1553016444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-51427150-7efd-440a-a533-79bfb275fa2b tempest-CreateVolumesFromSnapshotTest-1553016444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:10 devstack sudo[98900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:23:10 devstack sudo[98900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:11 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f750189c-0924-498e-b3ae-e2f497f39813 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Acquiring lock "cinder-a2304fd9-18f6-4a33-a729-d50100c7da5a-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:11 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f750189c-0924-498e-b3ae-e2f497f39813 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Lock "cinder-a2304fd9-18f6-4a33-a729-d50100c7da5a-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:11 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f750189c-0924-498e-b3ae-e2f497f39813 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Acquiring lock "cinder-quobyte-a2304fd9-18f6-4a33-a729-d50100c7da5a" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:11 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f750189c-0924-498e-b3ae-e2f497f39813 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Lock "cinder-quobyte-a2304fd9-18f6-4a33-a729-d50100c7da5a" acquired by "delete_volume" :: waited 0.053s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:11 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bff2589-c44d-4e53-84ca-cf9d8f37e476]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:23:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f750189c-0924-498e-b3ae-e2f497f39813 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a2304fd9-18f6-4a33-a729-d50100c7da5a {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:11 devstack sudo[98900]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-51427150-7efd-440a-a533-79bfb275fa2b tempest-CreateVolumesFromSnapshotTest-1553016444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.894s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:11 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-51427150-7efd-440a-a533-79bfb275fa2b tempest-CreateVolumesFromSnapshotTest-1553016444 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:23:11 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-51427150-7efd-440a-a533-79bfb275fa2b tempest-CreateVolumesFromSnapshotTest-1553016444 None] Deleted volume successfully. Sep 23 00:23:11 devstack sudo[98902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a2304fd9-18f6-4a33-a729-d50100c7da5a Sep 23 00:23:11 devstack sudo[98902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:11 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-51427150-7efd-440a-a533-79bfb275fa2b tempest-CreateVolumesFromSnapshotTest-1553016444 None] Lock "cinder-5597bf6d-4e89-495c-90de-463d2ec065ae-delete_volume" released by "delete_volume" :: held 3.406s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:12 devstack sudo[98902]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f750189c-0924-498e-b3ae-e2f497f39813 tempest-CreateVolumesFromSnapshotTest-1553016444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a2304fd9-18f6-4a33-a729-d50100c7da5a" returned: 0 in 1.006s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f750189c-0924-498e-b3ae-e2f497f39813 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a2304fd9-18f6-4a33-a729-d50100c7da5a {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:12 devstack sudo[98908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a2304fd9-18f6-4a33-a729-d50100c7da5a Sep 23 00:23:12 devstack sudo[98908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:13 devstack sudo[98908]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f750189c-0924-498e-b3ae-e2f497f39813 tempest-CreateVolumesFromSnapshotTest-1553016444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a2304fd9-18f6-4a33-a729-d50100c7da5a" returned: 0 in 0.644s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:13 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f750189c-0924-498e-b3ae-e2f497f39813 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Lock "cinder-quobyte-a2304fd9-18f6-4a33-a729-d50100c7da5a" released by "delete_volume" :: held 1.815s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:13 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-f750189c-0924-498e-b3ae-e2f497f39813 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Created reservations ['0f45d844-03af-4196-a444-0013ce6a5011', 'c7215005-3a02-4791-9b0e-329f826d5981', 'd7df88fb-060c-479a-a24d-ad617be51b00', '932eecb8-abb1-421b-9e27-d9bc7c8a6b42'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:23:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f750189c-0924-498e-b3ae-e2f497f39813 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f750189c-0924-498e-b3ae-e2f497f39813 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:13 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f750189c-0924-498e-b3ae-e2f497f39813 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:23:13 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f750189c-0924-498e-b3ae-e2f497f39813 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:23:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f750189c-0924-498e-b3ae-e2f497f39813 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f750189c-0924-498e-b3ae-e2f497f39813 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:13 devstack sudo[98911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:23:13 devstack sudo[98911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:13 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-528e6724-11be-496a-92c8-b6a8a520172f tempest-CreateVolumesFromSnapshotTest-1553016444 None] Acquiring lock "cinder-86ad55f3-a40a-4549-9bd5-7b776e25ce8a-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:13 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-528e6724-11be-496a-92c8-b6a8a520172f tempest-CreateVolumesFromSnapshotTest-1553016444 None] Lock "cinder-86ad55f3-a40a-4549-9bd5-7b776e25ce8a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.065s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:13 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-528e6724-11be-496a-92c8-b6a8a520172f tempest-CreateVolumesFromSnapshotTest-1553016444 None] Acquiring lock "cinder-quobyte-b08ee333-054b-4efa-b746-d5db8baff438" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:13 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-528e6724-11be-496a-92c8-b6a8a520172f tempest-CreateVolumesFromSnapshotTest-1553016444 None] Lock "cinder-quobyte-b08ee333-054b-4efa-b746-d5db8baff438" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:13 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-528e6724-11be-496a-92c8-b6a8a520172f tempest-CreateVolumesFromSnapshotTest-1553016444 None] Acquiring lock "cinder-quobyte-86ad55f3-a40a-4549-9bd5-7b776e25ce8a" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:13 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-528e6724-11be-496a-92c8-b6a8a520172f tempest-CreateVolumesFromSnapshotTest-1553016444 None] Lock "cinder-quobyte-86ad55f3-a40a-4549-9bd5-7b776e25ce8a" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:13 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-528e6724-11be-496a-92c8-b6a8a520172f tempest-CreateVolumesFromSnapshotTest-1553016444 None] Deleting offline snapshot 86ad55f3-a40a-4549-9bd5-7b776e25ce8a of volume b08ee333-054b-4efa-b746-d5db8baff438 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:23:13 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-528e6724-11be-496a-92c8-b6a8a520172f tempest-CreateVolumesFromSnapshotTest-1553016444 None] snapshot_file for this snap is: volume-b08ee333-054b-4efa-b746-d5db8baff438.86ad55f3-a40a-4549-9bd5-7b776e25ce8a {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:23:13 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[867261a3-7106-49e9-87e2-a135c08f5b8c]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:23:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-528e6724-11be-496a-92c8-b6a8a520172f tempest-CreateVolumesFromSnapshotTest-1553016444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b08ee333-054b-4efa-b746-d5db8baff438.86ad55f3-a40a-4549-9bd5-7b776e25ce8a {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:14 devstack sudo[98913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b08ee333-054b-4efa-b746-d5db8baff438.86ad55f3-a40a-4549-9bd5-7b776e25ce8a Sep 23 00:23:14 devstack sudo[98913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:14 devstack sudo[98911]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f750189c-0924-498e-b3ae-e2f497f39813 tempest-CreateVolumesFromSnapshotTest-1553016444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.856s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:14 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-f750189c-0924-498e-b3ae-e2f497f39813 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:23:14 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-f750189c-0924-498e-b3ae-e2f497f39813 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Deleted volume successfully. Sep 23 00:23:14 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f750189c-0924-498e-b3ae-e2f497f39813 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Lock "cinder-a2304fd9-18f6-4a33-a729-d50100c7da5a-delete_volume" released by "delete_volume" :: held 3.356s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:15 devstack sudo[98913]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-528e6724-11be-496a-92c8-b6a8a520172f tempest-CreateVolumesFromSnapshotTest-1553016444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b08ee333-054b-4efa-b746-d5db8baff438.86ad55f3-a40a-4549-9bd5-7b776e25ce8a" returned: 0 in 1.269s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:15 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-528e6724-11be-496a-92c8-b6a8a520172f tempest-CreateVolumesFromSnapshotTest-1553016444 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b08ee333-054b-4efa-b746-d5db8baff438(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:23:15 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c2f83f-f762-48cd-9d98-1b832d4babac]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:23:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-528e6724-11be-496a-92c8-b6a8a520172f tempest-CreateVolumesFromSnapshotTest-1553016444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b08ee333-054b-4efa-b746-d5db8baff438 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:15 devstack sudo[98920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b08ee333-054b-4efa-b746-d5db8baff438 Sep 23 00:23:15 devstack sudo[98920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:15 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-52f02d2e-7b12-48a4-ade5-1087a41aae2a tempest-GroupSnapshotsTest-551234149 None] Group tempest-GroupSnapshotsTest-Group-768482827: creating Sep 23 00:23:16 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-52f02d2e-7b12-48a4-ade5-1087a41aae2a tempest-GroupSnapshotsTest-551234149 None] Group tempest-GroupSnapshotsTest-Group-768482827: created successfully Sep 23 00:23:16 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-52f02d2e-7b12-48a4-ade5-1087a41aae2a tempest-GroupSnapshotsTest-551234149 None] Create group completed successfully. Sep 23 00:23:16 devstack sudo[98920]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-528e6724-11be-496a-92c8-b6a8a520172f tempest-CreateVolumesFromSnapshotTest-1553016444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b08ee333-054b-4efa-b746-d5db8baff438" returned: 0 in 0.958s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-528e6724-11be-496a-92c8-b6a8a520172f tempest-CreateVolumesFromSnapshotTest-1553016444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b08ee333-054b-4efa-b746-d5db8baff438.86ad55f3-a40a-4549-9bd5-7b776e25ce8a {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:16 devstack sudo[98926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b08ee333-054b-4efa-b746-d5db8baff438.86ad55f3-a40a-4549-9bd5-7b776e25ce8a Sep 23 00:23:16 devstack sudo[98926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:16 devstack sudo[98825]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a806f559-7def-4460-97c4-fa51971c46f3 tempest-VolumesActionsTest-1479696757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-0a67aca6-ef90-438d-9197-57b23fb901c4 /opt/stack/data/cinder/conversion/0a67aca6-ef90-438d-9197-57b23fb901c4.temp_image.65e46f93-55f2-4179-b66e-ef5f177fa675ekk7k0_4.img" returned: 0 in 10.688s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:16 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:23:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:23:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:23:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:16 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58e83a8-212a-4344-b012-110040c419dd]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:23:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a806f559-7def-4460-97c4-fa51971c46f3 tempest-VolumesActionsTest-1479696757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-0a67aca6-ef90-438d-9197-57b23fb901c4 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:16 devstack sudo[98931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:23:16 devstack sudo[98931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:16 devstack sudo[98932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-0a67aca6-ef90-438d-9197-57b23fb901c4 Sep 23 00:23:16 devstack sudo[98932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:16 devstack sudo[98926]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-528e6724-11be-496a-92c8-b6a8a520172f tempest-CreateVolumesFromSnapshotTest-1553016444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b08ee333-054b-4efa-b746-d5db8baff438.86ad55f3-a40a-4549-9bd5-7b776e25ce8a" returned: 0 in 0.576s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-528e6724-11be-496a-92c8-b6a8a520172f tempest-CreateVolumesFromSnapshotTest-1553016444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b08ee333-054b-4efa-b746-d5db8baff438.86ad55f3-a40a-4549-9bd5-7b776e25ce8a {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:16 devstack sudo[98936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b08ee333-054b-4efa-b746-d5db8baff438.86ad55f3-a40a-4549-9bd5-7b776e25ce8a Sep 23 00:23:16 devstack sudo[98936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:17 devstack sudo[98931]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.387s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:17 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:23:17 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running periodic task VolumeManager._thread_info {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:23:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] thread count: 29 {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:23:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] thread info: [<_MainThread(MainThread, started 135440660459648)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:23:17 devstack sudo[98936]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-528e6724-11be-496a-92c8-b6a8a520172f tempest-CreateVolumesFromSnapshotTest-1553016444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b08ee333-054b-4efa-b746-d5db8baff438.86ad55f3-a40a-4549-9bd5-7b776e25ce8a" returned: 0 in 0.459s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-528e6724-11be-496a-92c8-b6a8a520172f tempest-CreateVolumesFromSnapshotTest-1553016444 None] Lock "cinder-quobyte-86ad55f3-a40a-4549-9bd5-7b776e25ce8a" released by "_delete_snapshot" :: held 3.553s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-528e6724-11be-496a-92c8-b6a8a520172f tempest-CreateVolumesFromSnapshotTest-1553016444 None] Lock "cinder-quobyte-b08ee333-054b-4efa-b746-d5db8baff438" released by "delete_snapshot" :: held 3.608s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:17 devstack sudo[98932]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a806f559-7def-4460-97c4-fa51971c46f3 tempest-VolumesActionsTest-1479696757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-0a67aca6-ef90-438d-9197-57b23fb901c4" returned: 0 in 0.718s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:17 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-a806f559-7def-4460-97c4-fa51971c46f3 tempest-VolumesActionsTest-1479696757 None] Image conversion details: src /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-0a67aca6-ef90-438d-9197-57b23fb901c4, size 1024.00 MB, duration 10.70 sec, destination /opt/stack/data/cinder/conversion/0a67aca6-ef90-438d-9197-57b23fb901c4.temp_image.65e46f93-55f2-4179-b66e-ef5f177fa675ekk7k0_4.img {{(pid=86591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:23:17 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-a806f559-7def-4460-97c4-fa51971c46f3 tempest-VolumesActionsTest-1479696757 None] Converted 1024.00 MB image at 95.73 MB/s Sep 23 00:23:17 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-a806f559-7def-4460-97c4-fa51971c46f3 tempest-VolumesActionsTest-1479696757 None] 65e46f93-55f2-4179-b66e-ef5f177fa675 was raw, no need to convert to raw {{(pid=86591) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 23 00:23:17 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-528e6724-11be-496a-92c8-b6a8a520172f tempest-CreateVolumesFromSnapshotTest-1553016444 None] Created reservations ['b1d1ac39-baf7-4342-a5fa-062680ecc8c5', '96adca5e-6309-4ef7-973a-ac2a0306fd7b', 'f82ad04b-617f-433e-9675-039187b2722b', 'e68288fb-bfc7-4ced-84dd-e5c3e7ed1bf5'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:23:17 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-528e6724-11be-496a-92c8-b6a8a520172f tempest-CreateVolumesFromSnapshotTest-1553016444 None] Delete snapshot completed successfully. Sep 23 00:23:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-528e6724-11be-496a-92c8-b6a8a520172f tempest-CreateVolumesFromSnapshotTest-1553016444 None] Lock "cinder-86ad55f3-a40a-4549-9bd5-7b776e25ce8a-delete_snapshot" released by "delete_snapshot" :: held 3.918s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:17 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-d84ae172-d6f0-4fbc-9f12-203c0d6f50fc tempest-GroupSnapshotsTest-551234149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:23:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d84ae172-d6f0-4fbc-9f12-203c0d6f50fc tempest-GroupSnapshotsTest-551234149 None] Flow 'volume_create_manager' (4579eca6-a980-412e-a192-31337c03db25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:23:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d84ae172-d6f0-4fbc-9f12-203c0d6f50fc tempest-GroupSnapshotsTest-551234149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f407a57-cd17-46fd-ad85-224663173ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d84ae172-d6f0-4fbc-9f12-203c0d6f50fc tempest-GroupSnapshotsTest-551234149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f407a57-cd17-46fd-ad85-224663173ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-171732130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4aa26827-c8ba-4f98-9d15-7d339f87462c,host='devstack@QuobyteHD#QuobyteHD',id=98b36d55-1707-44fe-80c0-966a9f01e037,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30618508f4cf422c8e7adfbbbdc767cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:18Z,use_quota=True,user_id='b87bbe3221254f829469d272c67c983a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(167c5002-66a0-40c7-bb32-70d149e627e7),volume_type_id=167c5002-66a0-40c7-bb32-70d149e627e7)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d84ae172-d6f0-4fbc-9f12-203c0d6f50fc tempest-GroupSnapshotsTest-551234149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0d3a370-cfb8-4755-a462-9bb49d161800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d84ae172-d6f0-4fbc-9f12-203c0d6f50fc tempest-GroupSnapshotsTest-551234149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0d3a370-cfb8-4755-a462-9bb49d161800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d84ae172-d6f0-4fbc-9f12-203c0d6f50fc tempest-GroupSnapshotsTest-551234149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c72aa286-3fe6-4fd2-8836-b7c9b7b20b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d84ae172-d6f0-4fbc-9f12-203c0d6f50fc tempest-GroupSnapshotsTest-551234149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c72aa286-3fe6-4fd2-8836-b7c9b7b20b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98b36d55-1707-44fe-80c0-966a9f01e037', 'volume_name': 'volume-98b36d55-1707-44fe-80c0-966a9f01e037', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d84ae172-d6f0-4fbc-9f12-203c0d6f50fc tempest-GroupSnapshotsTest-551234149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2779effa-50d3-4eff-a979-17b52ccb268e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d84ae172-d6f0-4fbc-9f12-203c0d6f50fc tempest-GroupSnapshotsTest-551234149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2779effa-50d3-4eff-a979-17b52ccb268e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d84ae172-d6f0-4fbc-9f12-203c0d6f50fc tempest-GroupSnapshotsTest-551234149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17b2eabe-2971-4f49-9546-ab8bed50db85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:18 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-d84ae172-d6f0-4fbc-9f12-203c0d6f50fc tempest-GroupSnapshotsTest-551234149 None] Volume 98b36d55-1707-44fe-80c0-966a9f01e037: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98b36d55-1707-44fe-80c0-966a9f01e037', 'volume_size': 1} Sep 23 00:23:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d84ae172-d6f0-4fbc-9f12-203c0d6f50fc tempest-GroupSnapshotsTest-551234149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f8a693d5-68fb-4431-b8ba-c5cdf197e104 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Acquiring lock "cinder-b08ee333-054b-4efa-b746-d5db8baff438-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f8a693d5-68fb-4431-b8ba-c5cdf197e104 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Lock "cinder-b08ee333-054b-4efa-b746-d5db8baff438-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f8a693d5-68fb-4431-b8ba-c5cdf197e104 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Acquiring lock "cinder-quobyte-b08ee333-054b-4efa-b746-d5db8baff438" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f8a693d5-68fb-4431-b8ba-c5cdf197e104 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Lock "cinder-quobyte-b08ee333-054b-4efa-b746-d5db8baff438" acquired by "delete_volume" :: waited 0.025s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:18 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7f5d93-2384-4bf3-bea1-f82c2c5b47f1]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:23:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f8a693d5-68fb-4431-b8ba-c5cdf197e104 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b08ee333-054b-4efa-b746-d5db8baff438 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:18 devstack sudo[98943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b08ee333-054b-4efa-b746-d5db8baff438 Sep 23 00:23:18 devstack sudo[98943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:18 devstack sudo[98943]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f8a693d5-68fb-4431-b8ba-c5cdf197e104 tempest-CreateVolumesFromSnapshotTest-1553016444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b08ee333-054b-4efa-b746-d5db8baff438" returned: 0 in 0.483s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f8a693d5-68fb-4431-b8ba-c5cdf197e104 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b08ee333-054b-4efa-b746-d5db8baff438 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:18 devstack sudo[98948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b08ee333-054b-4efa-b746-d5db8baff438 Sep 23 00:23:18 devstack sudo[98948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:19 devstack sudo[98948]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f8a693d5-68fb-4431-b8ba-c5cdf197e104 tempest-CreateVolumesFromSnapshotTest-1553016444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b08ee333-054b-4efa-b746-d5db8baff438" returned: 0 in 0.401s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f8a693d5-68fb-4431-b8ba-c5cdf197e104 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Lock "cinder-quobyte-b08ee333-054b-4efa-b746-d5db8baff438" released by "delete_volume" :: held 0.990s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:19 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-f8a693d5-68fb-4431-b8ba-c5cdf197e104 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Created reservations ['116d04f3-7565-487a-8164-fae4e18c4e14', '4b02c288-b8fb-4bf8-b14d-b5569f31f902', '32208226-1574-414c-9887-056a4b720f9c', '8dde517d-b9e7-4ee1-a4d2-d087e874fa76'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:23:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f8a693d5-68fb-4431-b8ba-c5cdf197e104 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f8a693d5-68fb-4431-b8ba-c5cdf197e104 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:19 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f8a693d5-68fb-4431-b8ba-c5cdf197e104 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:23:19 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f8a693d5-68fb-4431-b8ba-c5cdf197e104 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:23:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f8a693d5-68fb-4431-b8ba-c5cdf197e104 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f8a693d5-68fb-4431-b8ba-c5cdf197e104 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:19 devstack sudo[98951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:23:19 devstack sudo[98951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:19 devstack sudo[98951]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f8a693d5-68fb-4431-b8ba-c5cdf197e104 tempest-CreateVolumesFromSnapshotTest-1553016444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.495s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:19 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-f8a693d5-68fb-4431-b8ba-c5cdf197e104 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:23:19 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-f8a693d5-68fb-4431-b8ba-c5cdf197e104 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Deleted volume successfully. Sep 23 00:23:20 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f8a693d5-68fb-4431-b8ba-c5cdf197e104 tempest-CreateVolumesFromSnapshotTest-1553016444 None] Lock "cinder-b08ee333-054b-4efa-b746-d5db8baff438-delete_volume" released by "delete_volume" :: held 1.859s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:25 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-4035f63d-53cd-4a76-b4e3-726f31c039fe tempest-CinderUnicodeTest-1693875027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:23:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4035f63d-53cd-4a76-b4e3-726f31c039fe tempest-CinderUnicodeTest-1693875027 None] Flow 'volume_create_manager' (61e9bfec-4acf-465f-840e-c52dc32cbf93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:23:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4035f63d-53cd-4a76-b4e3-726f31c039fe tempest-CinderUnicodeTest-1693875027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec8c2651-9d0e-4ee8-a2be-fad721187bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4035f63d-53cd-4a76-b4e3-726f31c039fe tempest-CinderUnicodeTest-1693875027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec8c2651-9d0e-4ee8-a2be-fad721187bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:23:25Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ced5c28-b2fb-485b-8ac3-e8681e272bfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='676358c2db0d490b8f2e997d8b9b24c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:26Z,use_quota=True,user_id='c92afc816ace4dd58e0a030ddc369114',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4035f63d-53cd-4a76-b4e3-726f31c039fe tempest-CinderUnicodeTest-1693875027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc853117-5eef-4751-bf0c-d5dd2d39050b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4035f63d-53cd-4a76-b4e3-726f31c039fe tempest-CinderUnicodeTest-1693875027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc853117-5eef-4751-bf0c-d5dd2d39050b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4035f63d-53cd-4a76-b4e3-726f31c039fe tempest-CinderUnicodeTest-1693875027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5562285-6fb5-4583-996d-dd1e77c9bc71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4035f63d-53cd-4a76-b4e3-726f31c039fe tempest-CinderUnicodeTest-1693875027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5562285-6fb5-4583-996d-dd1e77c9bc71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ced5c28-b2fb-485b-8ac3-e8681e272bfa', 'volume_name': 'volume-2ced5c28-b2fb-485b-8ac3-e8681e272bfa', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4035f63d-53cd-4a76-b4e3-726f31c039fe tempest-CinderUnicodeTest-1693875027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a72d9e9a-f8d1-4192-9e58-f6abbddf1d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4035f63d-53cd-4a76-b4e3-726f31c039fe tempest-CinderUnicodeTest-1693875027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a72d9e9a-f8d1-4192-9e58-f6abbddf1d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4035f63d-53cd-4a76-b4e3-726f31c039fe tempest-CinderUnicodeTest-1693875027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4480304-8817-4b03-acf0-768df4e0c551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:25 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-4035f63d-53cd-4a76-b4e3-726f31c039fe tempest-CinderUnicodeTest-1693875027 None] Volume 2ced5c28-b2fb-485b-8ac3-e8681e272bfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ced5c28-b2fb-485b-8ac3-e8681e272bfa', 'volume_size': 1} Sep 23 00:23:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4035f63d-53cd-4a76-b4e3-726f31c039fe tempest-CinderUnicodeTest-1693875027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:26 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-822c081a-83c6-4003-8830-9b0d8e0ce367 tempest-TestShelveInstance-858165662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:23:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-822c081a-83c6-4003-8830-9b0d8e0ce367 tempest-TestShelveInstance-858165662 None] Flow 'volume_create_manager' (d10fa1d3-2fee-4f72-a8cd-c4721d1bde5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:23:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-822c081a-83c6-4003-8830-9b0d8e0ce367 tempest-TestShelveInstance-858165662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6b19cd7-e3f7-4232-834c-5be2007d0960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-822c081a-83c6-4003-8830-9b0d8e0ce367 tempest-TestShelveInstance-858165662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6b19cd7-e3f7-4232-834c-5be2007d0960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:23:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-565575592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5742048b-8986-4b18-98b4-10946835dfb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56c1e44b6ff04fd1a9840cce1104b13b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:27Z,use_quota=True,user_id='76e408998f5846e3a6b341d5ef27a4b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-822c081a-83c6-4003-8830-9b0d8e0ce367 tempest-TestShelveInstance-858165662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d9c9234-5009-4b42-886c-bfec9501c96c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-822c081a-83c6-4003-8830-9b0d8e0ce367 tempest-TestShelveInstance-858165662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d9c9234-5009-4b42-886c-bfec9501c96c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-822c081a-83c6-4003-8830-9b0d8e0ce367 tempest-TestShelveInstance-858165662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65ac653b-0edc-45d3-9c86-0c9885487fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:26 devstack cinder-volume[86591]: DEBUG cinder.image.glance [None req-822c081a-83c6-4003-8830-9b0d8e0ce367 tempest-TestShelveInstance-858165662 None] Creating Keystone auth plugin from conf {{(pid=86591) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 00:23:27 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-822c081a-83c6-4003-8830-9b0d8e0ce367 tempest-TestShelveInstance-858165662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65ac653b-0edc-45d3-9c86-0c9885487fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5742048b-8986-4b18-98b4-10946835dfb3', 'volume_name': 'volume-5742048b-8986-4b18-98b4-10946835dfb3', 'volume_size': 1, 'image_id': 'acf635b7-10f9-4fce-8332-3b60fddafd4d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/acf635b7-10f9-4fce-8332-3b60fddafd4d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '91fff89797994a81952b7814d0d951c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'acf635b7-10f9-4fce-8332-3b60fddafd4d', 'created_at': datetime.datetime(2026, 9, 22, 22, 4, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 4, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/acf635b7-10f9-4fce-8332-3b60fddafd4d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:27 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-822c081a-83c6-4003-8830-9b0d8e0ce367 tempest-TestShelveInstance-858165662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab2931d0-0ef1-4ac8-b3c1-025d297114ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:27 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-822c081a-83c6-4003-8830-9b0d8e0ce367 tempest-TestShelveInstance-858165662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab2931d0-0ef1-4ac8-b3c1-025d297114ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:27 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-822c081a-83c6-4003-8830-9b0d8e0ce367 tempest-TestShelveInstance-858165662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81d7fc59-1662-49e2-8477-c0c3a7340880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:27 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-822c081a-83c6-4003-8830-9b0d8e0ce367 tempest-TestShelveInstance-858165662 None] Volume 5742048b-8986-4b18-98b4-10946835dfb3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5742048b-8986-4b18-98b4-10946835dfb3', 'volume_size': 1, 'image_id': 'acf635b7-10f9-4fce-8332-3b60fddafd4d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/acf635b7-10f9-4fce-8332-3b60fddafd4d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '91fff89797994a81952b7814d0d951c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'acf635b7-10f9-4fce-8332-3b60fddafd4d', 'created_at': datetime.datetime(2026, 9, 22, 22, 4, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 4, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/acf635b7-10f9-4fce-8332-3b60fddafd4d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 23 00:23:27 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-822c081a-83c6-4003-8830-9b0d8e0ce367 tempest-TestShelveInstance-858165662 None] Trying to clone 5742048b-8986-4b18-98b4-10946835dfb3 from image acf635b7-10f9-4fce-8332-3b60fddafd4d at location (None, [{'url': 'file:///opt/stack/data/glance/images/acf635b7-10f9-4fce-8332-3b60fddafd4d', 'metadata': {}}]). {{(pid=86591) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 00:23:27 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-822c081a-83c6-4003-8830-9b0d8e0ce367 tempest-TestShelveInstance-858165662 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_mgxz4q_wdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86591) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 00:23:27 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-822c081a-83c6-4003-8830-9b0d8e0ce367 tempest-TestShelveInstance-858165662 None] Image download 20.69 MB at 20.69 MB/s Sep 23 00:23:27 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc8240e-a653-4ef1-be1d-abd9babcaf62]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:23:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-822c081a-83c6-4003-8830-9b0d8e0ce367 tempest-TestShelveInstance-858165662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_mgxz4q_wdevstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:27 devstack sudo[98957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_mgxz4q_wdevstack@QuobyteHD Sep 23 00:23:27 devstack sudo[98957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:28 devstack sudo[98957]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-822c081a-83c6-4003-8830-9b0d8e0ce367 tempest-TestShelveInstance-858165662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_mgxz4q_wdevstack@QuobyteHD" returned: 0 in 0.396s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:28 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-822c081a-83c6-4003-8830-9b0d8e0ce367 tempest-TestShelveInstance-858165662 None] Temporary image acf635b7-10f9-4fce-8332-3b60fddafd4d is fetched for user 76e408998f5846e3a6b341d5ef27a4b0. {{(pid=86591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 00:23:28 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=85,cinder:INSERT=30,cinder:UPDATE=93,cinder:DELETE=6 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:23:28 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=90,cinder:UPDATE=107,cinder:INSERT=19,cinder:DELETE=10 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:23:28 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d604d0-8460-4749-b17a-944c81fe9d5a]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:23:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-822c081a-83c6-4003-8830-9b0d8e0ce367 tempest-TestShelveInstance-858165662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_mgxz4q_wdevstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:28 devstack sudo[98965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_mgxz4q_wdevstack@QuobyteHD Sep 23 00:23:28 devstack sudo[98965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:28 devstack sudo[98965]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-822c081a-83c6-4003-8830-9b0d8e0ce367 tempest-TestShelveInstance-858165662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_mgxz4q_wdevstack@QuobyteHD" returned: 0 in 0.412s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-822c081a-83c6-4003-8830-9b0d8e0ce367 tempest-TestShelveInstance-858165662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:38 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:INSERT=1 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:23:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a806f559-7def-4460-97c4-fa51971c46f3 tempest-VolumesActionsTest-1479696757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 36.924s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a806f559-7def-4460-97c4-fa51971c46f3 tempest-VolumesActionsTest-1479696757 None] Uploaded volume to glance image-id: 65e46f93-55f2-4179-b66e-ef5f177fa675. {{(pid=86591) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 23 00:23:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d84ae172-d6f0-4fbc-9f12-203c0d6f50fc tempest-GroupSnapshotsTest-551234149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 23.601s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d84ae172-d6f0-4fbc-9f12-203c0d6f50fc tempest-GroupSnapshotsTest-551234149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4aa26827-c8ba-4f98-9d15-7d339f87462c,created_at=2026-09-22T22:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-171732130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4aa26827-c8ba-4f98-9d15-7d339f87462c,host='devstack@QuobyteHD#QuobyteHD',id=98b36d55-1707-44fe-80c0-966a9f01e037,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30618508f4cf422c8e7adfbbbdc767cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:18Z,use_quota=True,user_id='b87bbe3221254f829469d272c67c983a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(167c5002-66a0-40c7-bb32-70d149e627e7),volume_type_id=167c5002-66a0-40c7-bb32-70d149e627e7)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:23:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-d84ae172-d6f0-4fbc-9f12-203c0d6f50fc tempest-GroupSnapshotsTest-551234149 None] Creating volume 98b36d55-1707-44fe-80c0-966a9f01e037 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:23:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d84ae172-d6f0-4fbc-9f12-203c0d6f50fc tempest-GroupSnapshotsTest-551234149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d84ae172-d6f0-4fbc-9f12-203c0d6f50fc tempest-GroupSnapshotsTest-551234149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d84ae172-d6f0-4fbc-9f12-203c0d6f50fc tempest-GroupSnapshotsTest-551234149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:23:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d84ae172-d6f0-4fbc-9f12-203c0d6f50fc tempest-GroupSnapshotsTest-551234149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:23:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d84ae172-d6f0-4fbc-9f12-203c0d6f50fc tempest-GroupSnapshotsTest-551234149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d84ae172-d6f0-4fbc-9f12-203c0d6f50fc tempest-GroupSnapshotsTest-551234149 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:23:41 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-d84ae172-d6f0-4fbc-9f12-203c0d6f50fc tempest-GroupSnapshotsTest-551234149 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:23:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d84ae172-d6f0-4fbc-9f12-203c0d6f50fc tempest-GroupSnapshotsTest-551234149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-98b36d55-1707-44fe-80c0-966a9f01e037 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:41 devstack sudo[98971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-98b36d55-1707-44fe-80c0-966a9f01e037 1073741824 Sep 23 00:23:41 devstack sudo[98971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:41 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-a806f559-7def-4460-97c4-fa51971c46f3 tempest-VolumesActionsTest-1479696757 None] Copy volume to image completed successfully. Sep 23 00:23:42 devstack sudo[98971]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d84ae172-d6f0-4fbc-9f12-203c0d6f50fc tempest-GroupSnapshotsTest-551234149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-98b36d55-1707-44fe-80c0-966a9f01e037 1073741824" returned: 0 in 0.536s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d84ae172-d6f0-4fbc-9f12-203c0d6f50fc tempest-GroupSnapshotsTest-551234149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-98b36d55-1707-44fe-80c0-966a9f01e037 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:42 devstack sudo[98976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-98b36d55-1707-44fe-80c0-966a9f01e037 Sep 23 00:23:42 devstack sudo[98976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:42 devstack sudo[98976]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d84ae172-d6f0-4fbc-9f12-203c0d6f50fc tempest-GroupSnapshotsTest-551234149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-98b36d55-1707-44fe-80c0-966a9f01e037" returned: 0 in 0.317s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d84ae172-d6f0-4fbc-9f12-203c0d6f50fc tempest-GroupSnapshotsTest-551234149 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:23:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d84ae172-d6f0-4fbc-9f12-203c0d6f50fc tempest-GroupSnapshotsTest-551234149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4035f63d-53cd-4a76-b4e3-726f31c039fe tempest-CinderUnicodeTest-1693875027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.772s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4035f63d-53cd-4a76-b4e3-726f31c039fe tempest-CinderUnicodeTest-1693875027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:23:25Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ced5c28-b2fb-485b-8ac3-e8681e272bfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='676358c2db0d490b8f2e997d8b9b24c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:26Z,use_quota=True,user_id='c92afc816ace4dd58e0a030ddc369114',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:23:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-4035f63d-53cd-4a76-b4e3-726f31c039fe tempest-CinderUnicodeTest-1693875027 None] Creating volume 2ced5c28-b2fb-485b-8ac3-e8681e272bfa {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:23:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4035f63d-53cd-4a76-b4e3-726f31c039fe tempest-CinderUnicodeTest-1693875027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4035f63d-53cd-4a76-b4e3-726f31c039fe tempest-CinderUnicodeTest-1693875027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4035f63d-53cd-4a76-b4e3-726f31c039fe tempest-CinderUnicodeTest-1693875027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:23:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4035f63d-53cd-4a76-b4e3-726f31c039fe tempest-CinderUnicodeTest-1693875027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:23:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4035f63d-53cd-4a76-b4e3-726f31c039fe tempest-CinderUnicodeTest-1693875027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4035f63d-53cd-4a76-b4e3-726f31c039fe tempest-CinderUnicodeTest-1693875027 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:23:42 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-4035f63d-53cd-4a76-b4e3-726f31c039fe tempest-CinderUnicodeTest-1693875027 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:23:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4035f63d-53cd-4a76-b4e3-726f31c039fe tempest-CinderUnicodeTest-1693875027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2ced5c28-b2fb-485b-8ac3-e8681e272bfa 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d84ae172-d6f0-4fbc-9f12-203c0d6f50fc tempest-GroupSnapshotsTest-551234149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17b2eabe-2971-4f49-9546-ab8bed50db85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98b36d55-1707-44fe-80c0-966a9f01e037', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:42 devstack sudo[98979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2ced5c28-b2fb-485b-8ac3-e8681e272bfa 1073741824 Sep 23 00:23:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d84ae172-d6f0-4fbc-9f12-203c0d6f50fc tempest-GroupSnapshotsTest-551234149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51e42b5f-4d14-4d98-b6b2-bbfe190b0b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:42 devstack sudo[98979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:42 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-d84ae172-d6f0-4fbc-9f12-203c0d6f50fc tempest-GroupSnapshotsTest-551234149 None] Volume volume-98b36d55-1707-44fe-80c0-966a9f01e037 (98b36d55-1707-44fe-80c0-966a9f01e037): created successfully Sep 23 00:23:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d84ae172-d6f0-4fbc-9f12-203c0d6f50fc tempest-GroupSnapshotsTest-551234149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51e42b5f-4d14-4d98-b6b2-bbfe190b0b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d84ae172-d6f0-4fbc-9f12-203c0d6f50fc tempest-GroupSnapshotsTest-551234149 None] Flow 'volume_create_manager' (4579eca6-a980-412e-a192-31337c03db25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:23:42 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-d84ae172-d6f0-4fbc-9f12-203c0d6f50fc tempest-GroupSnapshotsTest-551234149 None] Created volume successfully. Sep 23 00:23:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-998b2a49-3764-4f98-825c-7a9a376d96fe tempest-VolumesActionsTest-1479696757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:43 devstack sudo[98979]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4035f63d-53cd-4a76-b4e3-726f31c039fe tempest-CinderUnicodeTest-1693875027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2ced5c28-b2fb-485b-8ac3-e8681e272bfa 1073741824" returned: 0 in 0.598s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4035f63d-53cd-4a76-b4e3-726f31c039fe tempest-CinderUnicodeTest-1693875027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2ced5c28-b2fb-485b-8ac3-e8681e272bfa {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:43 devstack sudo[98984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2ced5c28-b2fb-485b-8ac3-e8681e272bfa Sep 23 00:23:43 devstack sudo[98984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:43 devstack sudo[98984]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4035f63d-53cd-4a76-b4e3-726f31c039fe tempest-CinderUnicodeTest-1693875027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2ced5c28-b2fb-485b-8ac3-e8681e272bfa" returned: 0 in 0.274s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:43 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4035f63d-53cd-4a76-b4e3-726f31c039fe tempest-CinderUnicodeTest-1693875027 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:23:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4035f63d-53cd-4a76-b4e3-726f31c039fe tempest-CinderUnicodeTest-1693875027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-822c081a-83c6-4003-8830-9b0d8e0ce367 tempest-TestShelveInstance-858165662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.870s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:43 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-822c081a-83c6-4003-8830-9b0d8e0ce367 tempest-TestShelveInstance-858165662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:23:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-565575592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5742048b-8986-4b18-98b4-10946835dfb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56c1e44b6ff04fd1a9840cce1104b13b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:27Z,use_quota=True,user_id='76e408998f5846e3a6b341d5ef27a4b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:23:43 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-822c081a-83c6-4003-8830-9b0d8e0ce367 tempest-TestShelveInstance-858165662 None] Creating volume 5742048b-8986-4b18-98b4-10946835dfb3 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:23:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-822c081a-83c6-4003-8830-9b0d8e0ce367 tempest-TestShelveInstance-858165662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-822c081a-83c6-4003-8830-9b0d8e0ce367 tempest-TestShelveInstance-858165662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:43 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-822c081a-83c6-4003-8830-9b0d8e0ce367 tempest-TestShelveInstance-858165662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:23:43 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-822c081a-83c6-4003-8830-9b0d8e0ce367 tempest-TestShelveInstance-858165662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:23:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-822c081a-83c6-4003-8830-9b0d8e0ce367 tempest-TestShelveInstance-858165662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:43 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-822c081a-83c6-4003-8830-9b0d8e0ce367 tempest-TestShelveInstance-858165662 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:23:43 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-822c081a-83c6-4003-8830-9b0d8e0ce367 tempest-TestShelveInstance-858165662 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:23:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-822c081a-83c6-4003-8830-9b0d8e0ce367 tempest-TestShelveInstance-858165662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-5742048b-8986-4b18-98b4-10946835dfb3 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:43 devstack sudo[98987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-5742048b-8986-4b18-98b4-10946835dfb3 1073741824 Sep 23 00:23:43 devstack sudo[98987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:43 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4035f63d-53cd-4a76-b4e3-726f31c039fe tempest-CinderUnicodeTest-1693875027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4480304-8817-4b03-acf0-768df4e0c551) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ced5c28-b2fb-485b-8ac3-e8681e272bfa', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:43 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4035f63d-53cd-4a76-b4e3-726f31c039fe tempest-CinderUnicodeTest-1693875027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b55df420-b958-4bf4-b7cb-e8b2cb143441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:43 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-4035f63d-53cd-4a76-b4e3-726f31c039fe tempest-CinderUnicodeTest-1693875027 None] Volume volume-2ced5c28-b2fb-485b-8ac3-e8681e272bfa (2ced5c28-b2fb-485b-8ac3-e8681e272bfa): created successfully Sep 23 00:23:43 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4035f63d-53cd-4a76-b4e3-726f31c039fe tempest-CinderUnicodeTest-1693875027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b55df420-b958-4bf4-b7cb-e8b2cb143441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:43 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4035f63d-53cd-4a76-b4e3-726f31c039fe tempest-CinderUnicodeTest-1693875027 None] Flow 'volume_create_manager' (61e9bfec-4acf-465f-840e-c52dc32cbf93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:23:43 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-4035f63d-53cd-4a76-b4e3-726f31c039fe tempest-CinderUnicodeTest-1693875027 None] Created volume successfully. Sep 23 00:23:43 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-0874bed5-ed7e-4069-9f72-7d79d0877639 tempest-GroupSnapshotsTest-551234149 None] GroupSnapshot 436aa7c7-ea9f-472c-ba88-418e2c46b2cd: creating. Sep 23 00:23:43 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0874bed5-ed7e-4069-9f72-7d79d0877639 tempest-GroupSnapshotsTest-551234149 None] Group snapshot 436aa7c7-ea9f-472c-ba88-418e2c46b2cd: creating. {{(pid=86591) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 23 00:23:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0874bed5-ed7e-4069-9f72-7d79d0877639 tempest-GroupSnapshotsTest-551234149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:44 devstack sudo[98987]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-822c081a-83c6-4003-8830-9b0d8e0ce367 tempest-TestShelveInstance-858165662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-5742048b-8986-4b18-98b4-10946835dfb3 1073741824" returned: 0 in 0.636s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-822c081a-83c6-4003-8830-9b0d8e0ce367 tempest-TestShelveInstance-858165662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-5742048b-8986-4b18-98b4-10946835dfb3 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:44 devstack sudo[98993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-5742048b-8986-4b18-98b4-10946835dfb3 Sep 23 00:23:44 devstack sudo[98993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:44 devstack sudo[98993]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-822c081a-83c6-4003-8830-9b0d8e0ce367 tempest-TestShelveInstance-858165662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-5742048b-8986-4b18-98b4-10946835dfb3" returned: 0 in 0.302s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:44 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-822c081a-83c6-4003-8830-9b0d8e0ce367 tempest-TestShelveInstance-858165662 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:23:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-822c081a-83c6-4003-8830-9b0d8e0ce367 tempest-TestShelveInstance-858165662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-998b2a49-3764-4f98-825c-7a9a376d96fe tempest-VolumesActionsTest-1479696757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.538s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:44 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58f94e7-ec80-4f69-a302-998d9fd42a57]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:23:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-998b2a49-3764-4f98-825c-7a9a376d96fe tempest-VolumesActionsTest-1479696757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-0a67aca6-ef90-438d-9197-57b23fb901c4 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:44 devstack sudo[98996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-0a67aca6-ef90-438d-9197-57b23fb901c4 Sep 23 00:23:44 devstack sudo[98996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:44 devstack cinder-volume[86591]: DEBUG cinder.volume.volume_utils [None req-822c081a-83c6-4003-8830-9b0d8e0ce367 tempest-TestShelveInstance-858165662 None] Attempting download of acf635b7-10f9-4fce-8332-3b60fddafd4d ((None, [{'url': 'file:///opt/stack/data/glance/images/acf635b7-10f9-4fce-8332-3b60fddafd4d', 'metadata': {}}])) to volume 5742048b-8986-4b18-98b4-10946835dfb3. {{(pid=86591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 00:23:44 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[509ab193-67b7-47b9-8dab-c3c34cea3e87]: (4, 'raw') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:23:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-822c081a-83c6-4003-8830-9b0d8e0ce367 tempest-TestShelveInstance-858165662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_acf635b7-10f9-4fce-8332-3b60fddafd4d_rtrmmkmw {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:44 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff56f4b7-8886-4268-9d72-7ff141284e89 tempest-CinderUnicodeTest-1693875027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:23:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ff56f4b7-8886-4268-9d72-7ff141284e89 tempest-CinderUnicodeTest-1693875027 None] Flow 'volume_create_manager' (0aa41444-56e3-4bec-a32b-3293c3dc3434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:23:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ff56f4b7-8886-4268-9d72-7ff141284e89 tempest-CinderUnicodeTest-1693875027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f997fb3-fb3c-486d-9c1e-6ff641747585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ff56f4b7-8886-4268-9d72-7ff141284e89 tempest-CinderUnicodeTest-1693875027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f997fb3-fb3c-486d-9c1e-6ff641747585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:23:44Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-430734237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12838a5f-feec-4f48-8d5b-d980c516c1c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='676358c2db0d490b8f2e997d8b9b24c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:45Z,use_quota=True,user_id='c92afc816ace4dd58e0a030ddc369114',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ff56f4b7-8886-4268-9d72-7ff141284e89 tempest-CinderUnicodeTest-1693875027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2c63b4b-9746-4f66-9205-61a2ea0f78e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ff56f4b7-8886-4268-9d72-7ff141284e89 tempest-CinderUnicodeTest-1693875027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2c63b4b-9746-4f66-9205-61a2ea0f78e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ff56f4b7-8886-4268-9d72-7ff141284e89 tempest-CinderUnicodeTest-1693875027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3501ebf-5598-452f-95bf-8b5f914962fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ff56f4b7-8886-4268-9d72-7ff141284e89 tempest-CinderUnicodeTest-1693875027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3501ebf-5598-452f-95bf-8b5f914962fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12838a5f-feec-4f48-8d5b-d980c516c1c4', 'volume_name': 'volume-12838a5f-feec-4f48-8d5b-d980c516c1c4', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ff56f4b7-8886-4268-9d72-7ff141284e89 tempest-CinderUnicodeTest-1693875027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (356b104c-e72c-4193-aee3-68108b9c1634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ff56f4b7-8886-4268-9d72-7ff141284e89 tempest-CinderUnicodeTest-1693875027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (356b104c-e72c-4193-aee3-68108b9c1634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ff56f4b7-8886-4268-9d72-7ff141284e89 tempest-CinderUnicodeTest-1693875027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (574d680e-83ec-458a-bdf4-72bc65772020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:44 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-ff56f4b7-8886-4268-9d72-7ff141284e89 tempest-CinderUnicodeTest-1693875027 None] Volume 12838a5f-feec-4f48-8d5b-d980c516c1c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12838a5f-feec-4f48-8d5b-d980c516c1c4', 'volume_size': 1} Sep 23 00:23:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ff56f4b7-8886-4268-9d72-7ff141284e89 tempest-CinderUnicodeTest-1693875027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:44 devstack sudo[98998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_acf635b7-10f9-4fce-8332-3b60fddafd4d_rtrmmkmw Sep 23 00:23:44 devstack sudo[98998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:44 devstack sudo[98996]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-998b2a49-3764-4f98-825c-7a9a376d96fe tempest-VolumesActionsTest-1479696757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-0a67aca6-ef90-438d-9197-57b23fb901c4" returned: 0 in 0.407s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:44 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec440da-e546-499d-8c2e-f73a83ba6382]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:23:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-998b2a49-3764-4f98-825c-7a9a376d96fe tempest-VolumesActionsTest-1479696757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-0a67aca6-ef90-438d-9197-57b23fb901c4 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:45 devstack sudo[99004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-0a67aca6-ef90-438d-9197-57b23fb901c4 Sep 23 00:23:45 devstack sudo[99004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:45 devstack sudo[98998]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-822c081a-83c6-4003-8830-9b0d8e0ce367 tempest-TestShelveInstance-858165662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_acf635b7-10f9-4fce-8332-3b60fddafd4d_rtrmmkmw" returned: 0 in 0.393s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-822c081a-83c6-4003-8830-9b0d8e0ce367 tempest-TestShelveInstance-858165662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_acf635b7-10f9-4fce-8332-3b60fddafd4d_rtrmmkmw {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:45 devstack sudo[99008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_acf635b7-10f9-4fce-8332-3b60fddafd4d_rtrmmkmw Sep 23 00:23:45 devstack sudo[99008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:45 devstack sudo[99004]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-998b2a49-3764-4f98-825c-7a9a376d96fe tempest-VolumesActionsTest-1479696757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-0a67aca6-ef90-438d-9197-57b23fb901c4" returned: 0 in 0.503s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-998b2a49-3764-4f98-825c-7a9a376d96fe tempest-VolumesActionsTest-1479696757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-0a67aca6-ef90-438d-9197-57b23fb901c4 /opt/stack/data/cinder/conversion/0a67aca6-ef90-438d-9197-57b23fb901c4.temp_image.c095b24f-4370-4c35-b079-dfd1ab039b9dbxcgtcl7.img {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:45 devstack sudo[99013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-0a67aca6-ef90-438d-9197-57b23fb901c4 /opt/stack/data/cinder/conversion/0a67aca6-ef90-438d-9197-57b23fb901c4.temp_image.c095b24f-4370-4c35-b079-dfd1ab039b9dbxcgtcl7.img Sep 23 00:23:45 devstack sudo[99013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:45 devstack sudo[99008]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-822c081a-83c6-4003-8830-9b0d8e0ce367 tempest-TestShelveInstance-858165662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_acf635b7-10f9-4fce-8332-3b60fddafd4d_rtrmmkmw" returned: 1 in 0.426s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-822c081a-83c6-4003-8830-9b0d8e0ce367 tempest-TestShelveInstance-858165662 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_acf635b7-10f9-4fce-8332-3b60fddafd4d_rtrmmkmw' failed. Not Retrying. {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:23:45 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa2b7cc-ed7a-4988-bfeb-95fa96dbe3e1]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:23:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-822c081a-83c6-4003-8830-9b0d8e0ce367 tempest-TestShelveInstance-858165662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_mgxz4q_wdevstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:45 devstack sudo[99017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_mgxz4q_wdevstack@QuobyteHD Sep 23 00:23:45 devstack sudo[99017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:46 devstack sudo[99017]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-822c081a-83c6-4003-8830-9b0d8e0ce367 tempest-TestShelveInstance-858165662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_mgxz4q_wdevstack@QuobyteHD" returned: 0 in 0.423s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:46 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-822c081a-83c6-4003-8830-9b0d8e0ce367 tempest-TestShelveInstance-858165662 None] acf635b7-10f9-4fce-8332-3b60fddafd4d was qcow2, converting to qcow2 {{(pid=86591) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 00:23:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-822c081a-83c6-4003-8830-9b0d8e0ce367 tempest-TestShelveInstance-858165662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_mgxz4q_wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-5742048b-8986-4b18-98b4-10946835dfb3 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:46 devstack sudo[99032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_mgxz4q_wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-5742048b-8986-4b18-98b4-10946835dfb3 Sep 23 00:23:46 devstack sudo[99032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:50 devstack sudo[99032]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-822c081a-83c6-4003-8830-9b0d8e0ce367 tempest-TestShelveInstance-858165662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_mgxz4q_wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-5742048b-8986-4b18-98b4-10946835dfb3" returned: 0 in 4.949s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:50 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-822c081a-83c6-4003-8830-9b0d8e0ce367 tempest-TestShelveInstance-858165662 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_mgxz4q_wdevstack@QuobyteHD, size 112.00 MB, duration 4.95 sec, destination /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-5742048b-8986-4b18-98b4-10946835dfb3 {{(pid=86591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:23:50 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-822c081a-83c6-4003-8830-9b0d8e0ce367 tempest-TestShelveInstance-858165662 None] Converted 112.00 MB image at 22.62 MB/s Sep 23 00:23:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-822c081a-83c6-4003-8830-9b0d8e0ce367 tempest-TestShelveInstance-858165662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-5742048b-8986-4b18-98b4-10946835dfb3 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:51 devstack sudo[99044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-5742048b-8986-4b18-98b4-10946835dfb3 1G Sep 23 00:23:51 devstack sudo[99044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:51 devstack sudo[99044]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-822c081a-83c6-4003-8830-9b0d8e0ce367 tempest-TestShelveInstance-858165662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-5742048b-8986-4b18-98b4-10946835dfb3 1G" returned: 0 in 0.551s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:51 devstack cinder-volume[86591]: DEBUG cinder.volume.volume_utils [None req-822c081a-83c6-4003-8830-9b0d8e0ce367 tempest-TestShelveInstance-858165662 None] Downloaded image acf635b7-10f9-4fce-8332-3b60fddafd4d ((None, [{'url': 'file:///opt/stack/data/glance/images/acf635b7-10f9-4fce-8332-3b60fddafd4d', 'metadata': {}}])) to volume 5742048b-8986-4b18-98b4-10946835dfb3 successfully. {{(pid=86591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 00:23:51 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-822c081a-83c6-4003-8830-9b0d8e0ce367 tempest-TestShelveInstance-858165662 None] Temporary image acf635b7-10f9-4fce-8332-3b60fddafd4d for user 76e408998f5846e3a6b341d5ef27a4b0 is deleted. {{(pid=86591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 00:23:51 devstack cinder-volume[86591]: DEBUG cinder.volume.volume_utils [None req-822c081a-83c6-4003-8830-9b0d8e0ce367 tempest-TestShelveInstance-858165662 None] Marking volume 5742048b-8986-4b18-98b4-10946835dfb3 as bootable. {{(pid=86591) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 00:23:51 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-822c081a-83c6-4003-8830-9b0d8e0ce367 tempest-TestShelveInstance-858165662 None] Copying metadata from image acf635b7-10f9-4fce-8332-3b60fddafd4d to 5742048b-8986-4b18-98b4-10946835dfb3. {{(pid=86591) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 00:23:51 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-822c081a-83c6-4003-8830-9b0d8e0ce367 tempest-TestShelveInstance-858165662 None] Creating volume glance metadata for volume 5742048b-8986-4b18-98b4-10946835dfb3 backed by image acf635b7-10f9-4fce-8332-3b60fddafd4d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'acf635b7-10f9-4fce-8332-3b60fddafd4d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86591) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 00:23:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-822c081a-83c6-4003-8830-9b0d8e0ce367 tempest-TestShelveInstance-858165662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81d7fc59-1662-49e2-8477-c0c3a7340880) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5742048b-8986-4b18-98b4-10946835dfb3', 'volume_size': 1, 'image_id': 'acf635b7-10f9-4fce-8332-3b60fddafd4d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/acf635b7-10f9-4fce-8332-3b60fddafd4d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '91fff89797994a81952b7814d0d951c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'acf635b7-10f9-4fce-8332-3b60fddafd4d', 'created_at': datetime.datetime(2026, 9, 22, 22, 4, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 4, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/acf635b7-10f9-4fce-8332-3b60fddafd4d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-822c081a-83c6-4003-8830-9b0d8e0ce367 tempest-TestShelveInstance-858165662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcba7118-58b2-4c2e-96ae-3b2b2ce82fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:51 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-822c081a-83c6-4003-8830-9b0d8e0ce367 tempest-TestShelveInstance-858165662 None] Volume volume-5742048b-8986-4b18-98b4-10946835dfb3 (5742048b-8986-4b18-98b4-10946835dfb3): created successfully Sep 23 00:23:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-822c081a-83c6-4003-8830-9b0d8e0ce367 tempest-TestShelveInstance-858165662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcba7118-58b2-4c2e-96ae-3b2b2ce82fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-822c081a-83c6-4003-8830-9b0d8e0ce367 tempest-TestShelveInstance-858165662 None] Flow 'volume_create_manager' (d10fa1d3-2fee-4f72-a8cd-c4721d1bde5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:23:51 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-822c081a-83c6-4003-8830-9b0d8e0ce367 tempest-TestShelveInstance-858165662 None] Created volume successfully. Sep 23 00:23:52 devstack sudo[99013]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-998b2a49-3764-4f98-825c-7a9a376d96fe tempest-VolumesActionsTest-1479696757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-0a67aca6-ef90-438d-9197-57b23fb901c4 /opt/stack/data/cinder/conversion/0a67aca6-ef90-438d-9197-57b23fb901c4.temp_image.c095b24f-4370-4c35-b079-dfd1ab039b9dbxcgtcl7.img" returned: 0 in 6.804s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:52 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[396b3a13-deee-4250-9ea0-03c9360b7a44]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:23:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-998b2a49-3764-4f98-825c-7a9a376d96fe tempest-VolumesActionsTest-1479696757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-0a67aca6-ef90-438d-9197-57b23fb901c4 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:52 devstack sudo[99049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-0a67aca6-ef90-438d-9197-57b23fb901c4 Sep 23 00:23:52 devstack sudo[99049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:52 devstack sudo[99049]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-998b2a49-3764-4f98-825c-7a9a376d96fe tempest-VolumesActionsTest-1479696757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-0a67aca6-ef90-438d-9197-57b23fb901c4" returned: 0 in 0.618s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:52 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-998b2a49-3764-4f98-825c-7a9a376d96fe tempest-VolumesActionsTest-1479696757 None] Image conversion details: src /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-0a67aca6-ef90-438d-9197-57b23fb901c4, size 1024.00 MB, duration 6.81 sec, destination /opt/stack/data/cinder/conversion/0a67aca6-ef90-438d-9197-57b23fb901c4.temp_image.c095b24f-4370-4c35-b079-dfd1ab039b9dbxcgtcl7.img {{(pid=86591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:23:52 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-998b2a49-3764-4f98-825c-7a9a376d96fe tempest-VolumesActionsTest-1479696757 None] Converted 1024.00 MB image at 150.43 MB/s Sep 23 00:23:52 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-998b2a49-3764-4f98-825c-7a9a376d96fe tempest-VolumesActionsTest-1479696757 None] c095b24f-4370-4c35-b079-dfd1ab039b9d was raw, converting to qcow2 {{(pid=86591) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 23 00:23:52 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[db85f569-407e-42f1-872e-43aae4c2d4fe]: (4, 'raw') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:23:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-998b2a49-3764-4f98-825c-7a9a376d96fe tempest-VolumesActionsTest-1479696757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/0a67aca6-ef90-438d-9197-57b23fb901c4.temp_image.c095b24f-4370-4c35-b079-dfd1ab039b9dbxcgtcl7.img {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:53 devstack sudo[99055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/0a67aca6-ef90-438d-9197-57b23fb901c4.temp_image.c095b24f-4370-4c35-b079-dfd1ab039b9dbxcgtcl7.img Sep 23 00:23:53 devstack sudo[99055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:53 devstack sudo[99055]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-998b2a49-3764-4f98-825c-7a9a376d96fe tempest-VolumesActionsTest-1479696757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/0a67aca6-ef90-438d-9197-57b23fb901c4.temp_image.c095b24f-4370-4c35-b079-dfd1ab039b9dbxcgtcl7.img" returned: 0 in 0.378s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-998b2a49-3764-4f98-825c-7a9a376d96fe tempest-VolumesActionsTest-1479696757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0a67aca6-ef90-438d-9197-57b23fb901c4.temp_image.c095b24f-4370-4c35-b079-dfd1ab039b9dbxcgtcl7.img {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:53 devstack sudo[99059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0a67aca6-ef90-438d-9197-57b23fb901c4.temp_image.c095b24f-4370-4c35-b079-dfd1ab039b9dbxcgtcl7.img Sep 23 00:23:53 devstack sudo[99059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:53 devstack sudo[99059]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-998b2a49-3764-4f98-825c-7a9a376d96fe tempest-VolumesActionsTest-1479696757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0a67aca6-ef90-438d-9197-57b23fb901c4.temp_image.c095b24f-4370-4c35-b079-dfd1ab039b9dbxcgtcl7.img" returned: 1 in 0.428s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-998b2a49-3764-4f98-825c-7a9a376d96fe tempest-VolumesActionsTest-1479696757 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0a67aca6-ef90-438d-9197-57b23fb901c4.temp_image.c095b24f-4370-4c35-b079-dfd1ab039b9dbxcgtcl7.img' failed. Not Retrying. {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:23:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-998b2a49-3764-4f98-825c-7a9a376d96fe tempest-VolumesActionsTest-1479696757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/0a67aca6-ef90-438d-9197-57b23fb901c4.temp_image.c095b24f-4370-4c35-b079-dfd1ab039b9dbxcgtcl7.img /opt/stack/data/cinder/conversion/vol_upload_ouwk6p_2 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:53 devstack sudo[99067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/0a67aca6-ef90-438d-9197-57b23fb901c4.temp_image.c095b24f-4370-4c35-b079-dfd1ab039b9dbxcgtcl7.img /opt/stack/data/cinder/conversion/vol_upload_ouwk6p_2 Sep 23 00:23:53 devstack sudo[99067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:54 devstack sudo[99067]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-998b2a49-3764-4f98-825c-7a9a376d96fe tempest-VolumesActionsTest-1479696757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/0a67aca6-ef90-438d-9197-57b23fb901c4.temp_image.c095b24f-4370-4c35-b079-dfd1ab039b9dbxcgtcl7.img /opt/stack/data/cinder/conversion/vol_upload_ouwk6p_2" returned: 0 in 0.358s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:54 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-998b2a49-3764-4f98-825c-7a9a376d96fe tempest-VolumesActionsTest-1479696757 None] Image conversion details: src /opt/stack/data/cinder/conversion/0a67aca6-ef90-438d-9197-57b23fb901c4.temp_image.c095b24f-4370-4c35-b079-dfd1ab039b9dbxcgtcl7.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_ouwk6p_2 {{(pid=86591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:23:54 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-998b2a49-3764-4f98-825c-7a9a376d96fe tempest-VolumesActionsTest-1479696757 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 23 00:23:54 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[1332686a-d649-4311-96e8-2e1738f6bf7d]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:23:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-998b2a49-3764-4f98-825c-7a9a376d96fe tempest-VolumesActionsTest-1479696757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ouwk6p_2 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:54 devstack sudo[99072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ouwk6p_2 Sep 23 00:23:54 devstack sudo[99072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:54 devstack sudo[99072]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-998b2a49-3764-4f98-825c-7a9a376d96fe tempest-VolumesActionsTest-1479696757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ouwk6p_2" returned: 0 in 0.456s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-f5571ebe-2a45-4cfb-857a-89da8b35d02c req-84275fdc-2cb2-4aee-bdba-551cc4acac2f tempest-TestShelveInstance-858165662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-998b2a49-3764-4f98-825c-7a9a376d96fe tempest-VolumesActionsTest-1479696757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.143s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-998b2a49-3764-4f98-825c-7a9a376d96fe tempest-VolumesActionsTest-1479696757 None] Uploaded volume to glance image-id: c095b24f-4370-4c35-b079-dfd1ab039b9d. {{(pid=86591) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 23 00:23:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0874bed5-ed7e-4069-9f72-7d79d0877639 tempest-GroupSnapshotsTest-551234149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 12.682s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:56 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-0874bed5-ed7e-4069-9f72-7d79d0877639 tempest-GroupSnapshotsTest-551234149 None] Creating offline snapshot d51e24f1-7f59-4a75-8350-fe0099a2f46e of volume 98b36d55-1707-44fe-80c0-966a9f01e037 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:23:56 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-998b2a49-3764-4f98-825c-7a9a376d96fe tempest-VolumesActionsTest-1479696757 None] Copy volume to image completed successfully. Sep 23 00:23:56 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[f993ca31-13b6-41cc-b3d7-9672e0d1d5d3]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:23:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0874bed5-ed7e-4069-9f72-7d79d0877639 tempest-GroupSnapshotsTest-551234149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-98b36d55-1707-44fe-80c0-966a9f01e037 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:56 devstack sudo[99086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-98b36d55-1707-44fe-80c0-966a9f01e037 Sep 23 00:23:56 devstack sudo[99086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:57 devstack sudo[99086]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0874bed5-ed7e-4069-9f72-7d79d0877639 tempest-GroupSnapshotsTest-551234149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-98b36d55-1707-44fe-80c0-966a9f01e037" returned: 0 in 0.522s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0874bed5-ed7e-4069-9f72-7d79d0877639 tempest-GroupSnapshotsTest-551234149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-98b36d55-1707-44fe-80c0-966a9f01e037,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-98b36d55-1707-44fe-80c0-966a9f01e037.d51e24f1-7f59-4a75-8350-fe0099a2f46e 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:57 devstack sudo[99093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-98b36d55-1707-44fe-80c0-966a9f01e037,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-98b36d55-1707-44fe-80c0-966a9f01e037.d51e24f1-7f59-4a75-8350-fe0099a2f46e 1G Sep 23 00:23:57 devstack sudo[99093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:57 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4b0ccb4d-7c1c-4e9a-9f43-0afacb57280c tempest-VolumesActionsTest-1479696757 None] Acquiring lock "cinder-0a67aca6-ef90-438d-9197-57b23fb901c4-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:57 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4b0ccb4d-7c1c-4e9a-9f43-0afacb57280c tempest-VolumesActionsTest-1479696757 None] Lock "cinder-0a67aca6-ef90-438d-9197-57b23fb901c4-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:57 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4b0ccb4d-7c1c-4e9a-9f43-0afacb57280c tempest-VolumesActionsTest-1479696757 None] Acquiring lock "cinder-quobyte-0a67aca6-ef90-438d-9197-57b23fb901c4" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:57 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4b0ccb4d-7c1c-4e9a-9f43-0afacb57280c tempest-VolumesActionsTest-1479696757 None] Lock "cinder-quobyte-0a67aca6-ef90-438d-9197-57b23fb901c4" acquired by "delete_volume" :: waited 0.027s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:57 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[db655e16-d9ca-443f-83b4-32d8aafe9287]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:23:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4b0ccb4d-7c1c-4e9a-9f43-0afacb57280c tempest-VolumesActionsTest-1479696757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-0a67aca6-ef90-438d-9197-57b23fb901c4 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:57 devstack sudo[99093]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0874bed5-ed7e-4069-9f72-7d79d0877639 tempest-GroupSnapshotsTest-551234149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-98b36d55-1707-44fe-80c0-966a9f01e037,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-98b36d55-1707-44fe-80c0-966a9f01e037.d51e24f1-7f59-4a75-8350-fe0099a2f46e 1G" returned: 0 in 0.676s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0874bed5-ed7e-4069-9f72-7d79d0877639 tempest-GroupSnapshotsTest-551234149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98b36d55-1707-44fe-80c0-966a9f01e037 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-98b36d55-1707-44fe-80c0-966a9f01e037.d51e24f1-7f59-4a75-8350-fe0099a2f46e {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:57 devstack sudo[99103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98b36d55-1707-44fe-80c0-966a9f01e037 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-98b36d55-1707-44fe-80c0-966a9f01e037.d51e24f1-7f59-4a75-8350-fe0099a2f46e Sep 23 00:23:57 devstack sudo[99103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:57 devstack sudo[99100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-0a67aca6-ef90-438d-9197-57b23fb901c4 Sep 23 00:23:57 devstack sudo[99100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:58 devstack sudo[99100]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4b0ccb4d-7c1c-4e9a-9f43-0afacb57280c tempest-VolumesActionsTest-1479696757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-0a67aca6-ef90-438d-9197-57b23fb901c4" returned: 0 in 0.435s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4b0ccb4d-7c1c-4e9a-9f43-0afacb57280c tempest-VolumesActionsTest-1479696757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-0a67aca6-ef90-438d-9197-57b23fb901c4 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:58 devstack sudo[99114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-0a67aca6-ef90-438d-9197-57b23fb901c4 Sep 23 00:23:58 devstack sudo[99114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:58 devstack sudo[99103]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0874bed5-ed7e-4069-9f72-7d79d0877639 tempest-GroupSnapshotsTest-551234149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98b36d55-1707-44fe-80c0-966a9f01e037 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-98b36d55-1707-44fe-80c0-966a9f01e037.d51e24f1-7f59-4a75-8350-fe0099a2f46e" returned: 0 in 0.382s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:58 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-0874bed5-ed7e-4069-9f72-7d79d0877639 tempest-GroupSnapshotsTest-551234149 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-98b36d55-1707-44fe-80c0-966a9f01e037.d51e24f1-7f59-4a75-8350-fe0099a2f46e is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:23:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0874bed5-ed7e-4069-9f72-7d79d0877639 tempest-GroupSnapshotsTest-551234149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-98b36d55-1707-44fe-80c0-966a9f01e037.d51e24f1-7f59-4a75-8350-fe0099a2f46e {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:58 devstack sudo[99116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-98b36d55-1707-44fe-80c0-966a9f01e037.d51e24f1-7f59-4a75-8350-fe0099a2f46e Sep 23 00:23:58 devstack sudo[99116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:58 devstack sudo[99114]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4b0ccb4d-7c1c-4e9a-9f43-0afacb57280c tempest-VolumesActionsTest-1479696757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-0a67aca6-ef90-438d-9197-57b23fb901c4" returned: 0 in 0.314s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:58 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4b0ccb4d-7c1c-4e9a-9f43-0afacb57280c tempest-VolumesActionsTest-1479696757 None] Lock "cinder-quobyte-0a67aca6-ef90-438d-9197-57b23fb901c4" released by "delete_volume" :: held 0.809s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:58 devstack sudo[99116]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0874bed5-ed7e-4069-9f72-7d79d0877639 tempest-GroupSnapshotsTest-551234149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-98b36d55-1707-44fe-80c0-966a9f01e037.d51e24f1-7f59-4a75-8350-fe0099a2f46e" returned: 0 in 0.322s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0874bed5-ed7e-4069-9f72-7d79d0877639 tempest-GroupSnapshotsTest-551234149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-98b36d55-1707-44fe-80c0-966a9f01e037.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:58 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-4b0ccb4d-7c1c-4e9a-9f43-0afacb57280c tempest-VolumesActionsTest-1479696757 None] Created reservations ['351e815e-2b0b-4997-8777-f2b8f419604f', '4b47f8e1-63dd-44db-99eb-0828d51d08b5', 'a9104ba8-c3f1-49e2-b0e6-d88d394e1ba5', '062e940c-7b0a-4ff6-bd4a-fe55e02e682e'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:23:58 devstack sudo[99120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-98b36d55-1707-44fe-80c0-966a9f01e037.info Sep 23 00:23:58 devstack sudo[99120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4b0ccb4d-7c1c-4e9a-9f43-0afacb57280c tempest-VolumesActionsTest-1479696757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4b0ccb4d-7c1c-4e9a-9f43-0afacb57280c tempest-VolumesActionsTest-1479696757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:58 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4b0ccb4d-7c1c-4e9a-9f43-0afacb57280c tempest-VolumesActionsTest-1479696757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:23:58 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4b0ccb4d-7c1c-4e9a-9f43-0afacb57280c tempest-VolumesActionsTest-1479696757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:23:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4b0ccb4d-7c1c-4e9a-9f43-0afacb57280c tempest-VolumesActionsTest-1479696757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4b0ccb4d-7c1c-4e9a-9f43-0afacb57280c tempest-VolumesActionsTest-1479696757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:58 devstack sudo[99122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:23:58 devstack sudo[99122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:59 devstack sudo[99120]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0874bed5-ed7e-4069-9f72-7d79d0877639 tempest-GroupSnapshotsTest-551234149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-98b36d55-1707-44fe-80c0-966a9f01e037.info" returned: 0 in 0.418s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:59 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-0874bed5-ed7e-4069-9f72-7d79d0877639 tempest-GroupSnapshotsTest-551234149 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-98b36d55-1707-44fe-80c0-966a9f01e037.info is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:23:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0874bed5-ed7e-4069-9f72-7d79d0877639 tempest-GroupSnapshotsTest-551234149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-98b36d55-1707-44fe-80c0-966a9f01e037.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:59 devstack sudo[99122]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4b0ccb4d-7c1c-4e9a-9f43-0afacb57280c tempest-VolumesActionsTest-1479696757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.288s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:59 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-4b0ccb4d-7c1c-4e9a-9f43-0afacb57280c tempest-VolumesActionsTest-1479696757 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:23:59 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-4b0ccb4d-7c1c-4e9a-9f43-0afacb57280c tempest-VolumesActionsTest-1479696757 None] Deleted volume successfully. Sep 23 00:23:59 devstack sudo[99126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-98b36d55-1707-44fe-80c0-966a9f01e037.info Sep 23 00:23:59 devstack sudo[99126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:59 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4b0ccb4d-7c1c-4e9a-9f43-0afacb57280c tempest-VolumesActionsTest-1479696757 None] Lock "cinder-0a67aca6-ef90-438d-9197-57b23fb901c4-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:59 devstack sudo[99126]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0874bed5-ed7e-4069-9f72-7d79d0877639 tempest-GroupSnapshotsTest-551234149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-98b36d55-1707-44fe-80c0-966a9f01e037.info" returned: 0 in 0.295s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0874bed5-ed7e-4069-9f72-7d79d0877639 tempest-GroupSnapshotsTest-551234149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.763s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ff56f4b7-8886-4268-9d72-7ff141284e89 tempest-CinderUnicodeTest-1693875027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.541s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ff56f4b7-8886-4268-9d72-7ff141284e89 tempest-CinderUnicodeTest-1693875027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:23:44Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-430734237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12838a5f-feec-4f48-8d5b-d980c516c1c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='676358c2db0d490b8f2e997d8b9b24c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:45Z,use_quota=True,user_id='c92afc816ace4dd58e0a030ddc369114',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:23:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-ff56f4b7-8886-4268-9d72-7ff141284e89 tempest-CinderUnicodeTest-1693875027 None] Creating volume 12838a5f-feec-4f48-8d5b-d980c516c1c4 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:23:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ff56f4b7-8886-4268-9d72-7ff141284e89 tempest-CinderUnicodeTest-1693875027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ff56f4b7-8886-4268-9d72-7ff141284e89 tempest-CinderUnicodeTest-1693875027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ff56f4b7-8886-4268-9d72-7ff141284e89 tempest-CinderUnicodeTest-1693875027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:23:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ff56f4b7-8886-4268-9d72-7ff141284e89 tempest-CinderUnicodeTest-1693875027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:23:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ff56f4b7-8886-4268-9d72-7ff141284e89 tempest-CinderUnicodeTest-1693875027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ff56f4b7-8886-4268-9d72-7ff141284e89 tempest-CinderUnicodeTest-1693875027 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:23:59 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-ff56f4b7-8886-4268-9d72-7ff141284e89 tempest-CinderUnicodeTest-1693875027 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:23:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ff56f4b7-8886-4268-9d72-7ff141284e89 tempest-CinderUnicodeTest-1693875027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-12838a5f-feec-4f48-8d5b-d980c516c1c4 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:59 devstack sudo[99129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-12838a5f-feec-4f48-8d5b-d980c516c1c4 1073741824 Sep 23 00:23:59 devstack sudo[99129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:59 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-0874bed5-ed7e-4069-9f72-7d79d0877639 tempest-GroupSnapshotsTest-551234149 None] group_snapshot 436aa7c7-ea9f-472c-ba88-418e2c46b2cd: created successfully Sep 23 00:24:00 devstack sudo[99129]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ff56f4b7-8886-4268-9d72-7ff141284e89 tempest-CinderUnicodeTest-1693875027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-12838a5f-feec-4f48-8d5b-d980c516c1c4 1073741824" returned: 0 in 0.701s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ff56f4b7-8886-4268-9d72-7ff141284e89 tempest-CinderUnicodeTest-1693875027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-12838a5f-feec-4f48-8d5b-d980c516c1c4 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:00 devstack sudo[99134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-12838a5f-feec-4f48-8d5b-d980c516c1c4 Sep 23 00:24:00 devstack sudo[99134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:00 devstack sudo[99134]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ff56f4b7-8886-4268-9d72-7ff141284e89 tempest-CinderUnicodeTest-1693875027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-12838a5f-feec-4f48-8d5b-d980c516c1c4" returned: 0 in 0.459s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:00 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ff56f4b7-8886-4268-9d72-7ff141284e89 tempest-CinderUnicodeTest-1693875027 None] <== create_volume: return (1232ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:24:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ff56f4b7-8886-4268-9d72-7ff141284e89 tempest-CinderUnicodeTest-1693875027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.236s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-f5571ebe-2a45-4cfb-857a-89da8b35d02c req-84275fdc-2cb2-4aee-bdba-551cc4acac2f tempest-TestShelveInstance-858165662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.355s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-f5571ebe-2a45-4cfb-857a-89da8b35d02c req-84275fdc-2cb2-4aee-bdba-551cc4acac2f tempest-TestShelveInstance-858165662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ff56f4b7-8886-4268-9d72-7ff141284e89 tempest-CinderUnicodeTest-1693875027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (574d680e-83ec-458a-bdf4-72bc65772020) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12838a5f-feec-4f48-8d5b-d980c516c1c4', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ff56f4b7-8886-4268-9d72-7ff141284e89 tempest-CinderUnicodeTest-1693875027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a11dfb9d-a503-4953-9201-b4e86da52c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:00 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-ff56f4b7-8886-4268-9d72-7ff141284e89 tempest-CinderUnicodeTest-1693875027 None] Volume volume-12838a5f-feec-4f48-8d5b-d980c516c1c4 (12838a5f-feec-4f48-8d5b-d980c516c1c4): created successfully Sep 23 00:24:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ff56f4b7-8886-4268-9d72-7ff141284e89 tempest-CinderUnicodeTest-1693875027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a11dfb9d-a503-4953-9201-b4e86da52c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ff56f4b7-8886-4268-9d72-7ff141284e89 tempest-CinderUnicodeTest-1693875027 None] Flow 'volume_create_manager' (0aa41444-56e3-4bec-a32b-3293c3dc3434) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:24:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-f5571ebe-2a45-4cfb-857a-89da8b35d02c req-84275fdc-2cb2-4aee-bdba-551cc4acac2f tempest-TestShelveInstance-858165662 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974', 'name': 'volume-5742048b-8986-4b18-98b4-10946835dfb3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '89f6ce4a-45e6-4749-a30a-76d613a5d5a9', 'enforce_multipath': True} {{(pid=86591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:24:00 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-ff56f4b7-8886-4268-9d72-7ff141284e89 tempest-CinderUnicodeTest-1693875027 None] Created volume successfully. Sep 23 00:24:00 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-f5571ebe-2a45-4cfb-857a-89da8b35d02c req-84275fdc-2cb2-4aee-bdba-551cc4acac2f tempest-TestShelveInstance-858165662 None] attachment_update completed successfully. Sep 23 00:24:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-91ce62e1-2cb4-4667-858e-6421deda976f tempest-GroupSnapshotsTest-551234149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-91ce62e1-2cb4-4667-858e-6421deda976f tempest-GroupSnapshotsTest-551234149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:01 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-91ce62e1-2cb4-4667-858e-6421deda976f tempest-GroupSnapshotsTest-551234149 None] Acquiring lock "cinder-quobyte-d51e24f1-7f59-4a75-8350-fe0099a2f46e-72408e40-03a4-4681-9f9a-479c1943231b" by "_create_volume_from_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:01 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-91ce62e1-2cb4-4667-858e-6421deda976f tempest-GroupSnapshotsTest-551234149 None] Lock "cinder-quobyte-d51e24f1-7f59-4a75-8350-fe0099a2f46e-72408e40-03a4-4681-9f9a-479c1943231b" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-91ce62e1-2cb4-4667-858e-6421deda976f tempest-GroupSnapshotsTest-551234149 None] Creating volume 72408e40-03a4-4681-9f9a-479c1943231b from snapshot d51e24f1-7f59-4a75-8350-fe0099a2f46e {{(pid=86591) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 00:24:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-91ce62e1-2cb4-4667-858e-6421deda976f tempest-GroupSnapshotsTest-551234149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-91ce62e1-2cb4-4667-858e-6421deda976f tempest-GroupSnapshotsTest-551234149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-91ce62e1-2cb4-4667-858e-6421deda976f tempest-GroupSnapshotsTest-551234149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-91ce62e1-2cb4-4667-858e-6421deda976f tempest-GroupSnapshotsTest-551234149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-91ce62e1-2cb4-4667-858e-6421deda976f tempest-GroupSnapshotsTest-551234149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-91ce62e1-2cb4-4667-858e-6421deda976f tempest-GroupSnapshotsTest-551234149 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:24:01 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-91ce62e1-2cb4-4667-858e-6421deda976f tempest-GroupSnapshotsTest-551234149 None] Acquiring lock "cinder-quobyte-72408e40-03a4-4681-9f9a-479c1943231b" by "_copy_volume_from_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:01 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-91ce62e1-2cb4-4667-858e-6421deda976f tempest-GroupSnapshotsTest-551234149 None] Lock "cinder-quobyte-72408e40-03a4-4681-9f9a-479c1943231b" acquired by "_copy_volume_from_snapshot" :: waited 0.052s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-91ce62e1-2cb4-4667-858e-6421deda976f tempest-GroupSnapshotsTest-551234149 None] snapshot: d51e24f1-7f59-4a75-8350-fe0099a2f46e, volume: 72408e40-03a4-4681-9f9a-479c1943231b, {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:24:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-91ce62e1-2cb4-4667-858e-6421deda976f tempest-GroupSnapshotsTest-551234149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-91ce62e1-2cb4-4667-858e-6421deda976f tempest-GroupSnapshotsTest-551234149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-91ce62e1-2cb4-4667-858e-6421deda976f tempest-GroupSnapshotsTest-551234149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-91ce62e1-2cb4-4667-858e-6421deda976f tempest-GroupSnapshotsTest-551234149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-91ce62e1-2cb4-4667-858e-6421deda976f tempest-GroupSnapshotsTest-551234149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:01 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[956aa053-9aad-4439-856a-699edaba8c29]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-91ce62e1-2cb4-4667-858e-6421deda976f tempest-GroupSnapshotsTest-551234149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-98b36d55-1707-44fe-80c0-966a9f01e037.d51e24f1-7f59-4a75-8350-fe0099a2f46e {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:01 devstack sudo[99138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-98b36d55-1707-44fe-80c0-966a9f01e037.d51e24f1-7f59-4a75-8350-fe0099a2f46e Sep 23 00:24:01 devstack sudo[99138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-bc819d24-441e-4fc3-bd9e-659977df39b0 tempest-CinderUnicodeTest-1693875027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-91ce62e1-2cb4-4667-858e-6421deda976f tempest-GroupSnapshotsTest-551234149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-98b36d55-1707-44fe-80c0-966a9f01e037.d51e24f1-7f59-4a75-8350-fe0099a2f46e" returned: 0 in 0.777s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:02 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-91ce62e1-2cb4-4667-858e-6421deda976f tempest-GroupSnapshotsTest-551234149 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98b36d55-1707-44fe-80c0-966a9f01e037(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:24:02 devstack sudo[99138]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:02 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f88e5eb-5e4f-4447-86e7-3bb31100419f]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-91ce62e1-2cb4-4667-858e-6421deda976f tempest-GroupSnapshotsTest-551234149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-98b36d55-1707-44fe-80c0-966a9f01e037 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:02 devstack sudo[99241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-98b36d55-1707-44fe-80c0-966a9f01e037 Sep 23 00:24:02 devstack sudo[99241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:03 devstack sudo[99241]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-91ce62e1-2cb4-4667-858e-6421deda976f tempest-GroupSnapshotsTest-551234149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-98b36d55-1707-44fe-80c0-966a9f01e037" returned: 0 in 0.961s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:03 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-91ce62e1-2cb4-4667-858e-6421deda976f tempest-GroupSnapshotsTest-551234149 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-98b36d55-1707-44fe-80c0-966a9f01e037 {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:24:03 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-91ce62e1-2cb4-4667-858e-6421deda976f tempest-GroupSnapshotsTest-551234149 None] Creating direct copy from snapshot {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:24:03 devstack cinder-volume[86591]: DEBUG cinder.utils [None req-91ce62e1-2cb4-4667-858e-6421deda976f tempest-GroupSnapshotsTest-551234149 None] Path /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-72408e40-03a4-4681-9f9a-479c1943231b not found in is_blk_device check {{(pid=86591) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:24:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-91ce62e1-2cb4-4667-858e-6421deda976f tempest-GroupSnapshotsTest-551234149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-98b36d55-1707-44fe-80c0-966a9f01e037 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-72408e40-03a4-4681-9f9a-479c1943231b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:03 devstack sudo[99609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-98b36d55-1707-44fe-80c0-966a9f01e037 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-72408e40-03a4-4681-9f9a-479c1943231b Sep 23 00:24:03 devstack sudo[99609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:11 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:UPDATE=26,cinder:INSERT=12,cinder:SELECT=33 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:24:11 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=36,cinder:UPDATE=24,cinder:DELETE=5,cinder:INSERT=9 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:24:15 devstack sudo[99609]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-91ce62e1-2cb4-4667-858e-6421deda976f tempest-GroupSnapshotsTest-551234149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-98b36d55-1707-44fe-80c0-966a9f01e037 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-72408e40-03a4-4681-9f9a-479c1943231b" returned: 0 in 12.277s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:15 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-91ce62e1-2cb4-4667-858e-6421deda976f tempest-GroupSnapshotsTest-551234149 None] Image conversion details: src /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-98b36d55-1707-44fe-80c0-966a9f01e037, size 1024.00 MB, duration 12.28 sec, destination /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-72408e40-03a4-4681-9f9a-479c1943231b {{(pid=86591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:24:15 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-91ce62e1-2cb4-4667-858e-6421deda976f tempest-GroupSnapshotsTest-551234149 None] Converted 1024.00 MB image at 83.40 MB/s Sep 23 00:24:15 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-91ce62e1-2cb4-4667-858e-6421deda976f tempest-GroupSnapshotsTest-551234149 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-72408e40-03a4-4681-9f9a-479c1943231b is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:24:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-91ce62e1-2cb4-4667-858e-6421deda976f tempest-GroupSnapshotsTest-551234149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-72408e40-03a4-4681-9f9a-479c1943231b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:15 devstack sudo[99686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-72408e40-03a4-4681-9f9a-479c1943231b Sep 23 00:24:15 devstack sudo[99686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:15 devstack sudo[99686]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-91ce62e1-2cb4-4667-858e-6421deda976f tempest-GroupSnapshotsTest-551234149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-72408e40-03a4-4681-9f9a-479c1943231b" returned: 0 in 0.341s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-91ce62e1-2cb4-4667-858e-6421deda976f tempest-GroupSnapshotsTest-551234149 None] Lock "cinder-quobyte-72408e40-03a4-4681-9f9a-479c1943231b" released by "_copy_volume_from_snapshot" :: held 14.575s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-91ce62e1-2cb4-4667-858e-6421deda976f tempest-GroupSnapshotsTest-551234149 None] Lock "cinder-quobyte-d51e24f1-7f59-4a75-8350-fe0099a2f46e-72408e40-03a4-4681-9f9a-479c1943231b" released by "_create_volume_from_snapshot" :: held 14.729s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-91ce62e1-2cb4-4667-858e-6421deda976f tempest-GroupSnapshotsTest-551234149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.754s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-bc819d24-441e-4fc3-bd9e-659977df39b0 tempest-CinderUnicodeTest-1693875027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 14.093s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:15 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-bc819d24-441e-4fc3-bd9e-659977df39b0 tempest-CinderUnicodeTest-1693875027 None] Creating offline snapshot b5d26c81-4e7d-4f63-a2fd-8e59e5040c15 of volume 12838a5f-feec-4f48-8d5b-d980c516c1c4 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:24:15 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8779f9-1eac-4331-8df4-7aaa6f6268bf]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bc819d24-441e-4fc3-bd9e-659977df39b0 tempest-CinderUnicodeTest-1693875027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-12838a5f-feec-4f48-8d5b-d980c516c1c4 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:16 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-91ce62e1-2cb4-4667-858e-6421deda976f tempest-GroupSnapshotsTest-551234149 None] Create group from source-snapshot-436aa7c7-ea9f-472c-ba88-418e2c46b2cd completed successfully. Sep 23 00:24:16 devstack sudo[99690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-12838a5f-feec-4f48-8d5b-d980c516c1c4 Sep 23 00:24:16 devstack sudo[99690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:16 devstack sudo[99690]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bc819d24-441e-4fc3-bd9e-659977df39b0 tempest-CinderUnicodeTest-1693875027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-12838a5f-feec-4f48-8d5b-d980c516c1c4" returned: 0 in 0.561s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bc819d24-441e-4fc3-bd9e-659977df39b0 tempest-CinderUnicodeTest-1693875027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-12838a5f-feec-4f48-8d5b-d980c516c1c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-12838a5f-feec-4f48-8d5b-d980c516c1c4.b5d26c81-4e7d-4f63-a2fd-8e59e5040c15 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:16 devstack sudo[99696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-12838a5f-feec-4f48-8d5b-d980c516c1c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-12838a5f-feec-4f48-8d5b-d980c516c1c4.b5d26c81-4e7d-4f63-a2fd-8e59e5040c15 1G Sep 23 00:24:16 devstack sudo[99696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:16 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:24:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:16 devstack sudo[99698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:24:16 devstack sudo[99698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:17 devstack sudo[99698]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.397s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:17 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:24:17 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running periodic task VolumeManager._thread_info {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:24:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] thread count: 29 {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:24:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] thread info: [<_MainThread(MainThread, started 135440660459648)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:24:17 devstack sudo[99696]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bc819d24-441e-4fc3-bd9e-659977df39b0 tempest-CinderUnicodeTest-1693875027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-12838a5f-feec-4f48-8d5b-d980c516c1c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-12838a5f-feec-4f48-8d5b-d980c516c1c4.b5d26c81-4e7d-4f63-a2fd-8e59e5040c15 1G" returned: 0 in 0.674s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bc819d24-441e-4fc3-bd9e-659977df39b0 tempest-CinderUnicodeTest-1693875027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12838a5f-feec-4f48-8d5b-d980c516c1c4 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-12838a5f-feec-4f48-8d5b-d980c516c1c4.b5d26c81-4e7d-4f63-a2fd-8e59e5040c15 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:17 devstack sudo[99706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12838a5f-feec-4f48-8d5b-d980c516c1c4 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-12838a5f-feec-4f48-8d5b-d980c516c1c4.b5d26c81-4e7d-4f63-a2fd-8e59e5040c15 Sep 23 00:24:17 devstack sudo[99706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a68da7eb-a719-4d85-bde3-99fa79798aaf tempest-GroupSnapshotsTest-551234149 None] Acquiring lock "cinder-quobyte-72408e40-03a4-4681-9f9a-479c1943231b" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a68da7eb-a719-4d85-bde3-99fa79798aaf tempest-GroupSnapshotsTest-551234149 None] Lock "cinder-quobyte-72408e40-03a4-4681-9f9a-479c1943231b" acquired by "delete_volume" :: waited 0.049s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:17 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[574ce74b-0af9-4150-a34c-41a71b71946e]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a68da7eb-a719-4d85-bde3-99fa79798aaf tempest-GroupSnapshotsTest-551234149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-72408e40-03a4-4681-9f9a-479c1943231b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:17 devstack sudo[99706]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bc819d24-441e-4fc3-bd9e-659977df39b0 tempest-CinderUnicodeTest-1693875027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12838a5f-feec-4f48-8d5b-d980c516c1c4 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-12838a5f-feec-4f48-8d5b-d980c516c1c4.b5d26c81-4e7d-4f63-a2fd-8e59e5040c15" returned: 0 in 0.659s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:17 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-bc819d24-441e-4fc3-bd9e-659977df39b0 tempest-CinderUnicodeTest-1693875027 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-12838a5f-feec-4f48-8d5b-d980c516c1c4.b5d26c81-4e7d-4f63-a2fd-8e59e5040c15 is being set with open permissions: ugo+rw Sep 23 00:24:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bc819d24-441e-4fc3-bd9e-659977df39b0 tempest-CinderUnicodeTest-1693875027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-12838a5f-feec-4f48-8d5b-d980c516c1c4.b5d26c81-4e7d-4f63-a2fd-8e59e5040c15 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:17 devstack sudo[99712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-12838a5f-feec-4f48-8d5b-d980c516c1c4.b5d26c81-4e7d-4f63-a2fd-8e59e5040c15 Sep 23 00:24:17 devstack sudo[99712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:18 devstack sudo[99711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-72408e40-03a4-4681-9f9a-479c1943231b Sep 23 00:24:18 devstack sudo[99711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:18 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bcd7e6f-8ac5-46fa-b682-db1578e675cb tempest-VolumesNegativeTest-1499264868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:24:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6bcd7e6f-8ac5-46fa-b682-db1578e675cb tempest-VolumesNegativeTest-1499264868 None] Flow 'volume_create_manager' (e8c5d7e5-3ae4-4db6-bd25-7e6f7a91c5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:24:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6bcd7e6f-8ac5-46fa-b682-db1578e675cb tempest-VolumesNegativeTest-1499264868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b0b5dab-6d4b-485a-a061-0e1c9bdea3ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6bcd7e6f-8ac5-46fa-b682-db1578e675cb tempest-VolumesNegativeTest-1499264868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b0b5dab-6d4b-485a-a061-0e1c9bdea3ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:24:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-628279150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5d043b7-304c-428d-84ee-49850de6c84a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f7c9108805247cb914077a9f0190447',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:18Z,use_quota=True,user_id='37f554f35ae84723b9faa38ab7937a57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6bcd7e6f-8ac5-46fa-b682-db1578e675cb tempest-VolumesNegativeTest-1499264868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f074a93c-73e5-432e-8b29-f220403c646e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6bcd7e6f-8ac5-46fa-b682-db1578e675cb tempest-VolumesNegativeTest-1499264868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f074a93c-73e5-432e-8b29-f220403c646e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6bcd7e6f-8ac5-46fa-b682-db1578e675cb tempest-VolumesNegativeTest-1499264868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ec8b8e5-0639-404d-8c24-f275054e1b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6bcd7e6f-8ac5-46fa-b682-db1578e675cb tempest-VolumesNegativeTest-1499264868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ec8b8e5-0639-404d-8c24-f275054e1b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5d043b7-304c-428d-84ee-49850de6c84a', 'volume_name': 'volume-e5d043b7-304c-428d-84ee-49850de6c84a', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6bcd7e6f-8ac5-46fa-b682-db1578e675cb tempest-VolumesNegativeTest-1499264868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56cb907c-87c3-4c6e-a7e0-cb4edd71de6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6bcd7e6f-8ac5-46fa-b682-db1578e675cb tempest-VolumesNegativeTest-1499264868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56cb907c-87c3-4c6e-a7e0-cb4edd71de6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6bcd7e6f-8ac5-46fa-b682-db1578e675cb tempest-VolumesNegativeTest-1499264868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4c09837-c9e5-4f54-90b5-4df60e0a43d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:18 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-6bcd7e6f-8ac5-46fa-b682-db1578e675cb tempest-VolumesNegativeTest-1499264868 None] Volume e5d043b7-304c-428d-84ee-49850de6c84a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5d043b7-304c-428d-84ee-49850de6c84a', 'volume_size': 1} Sep 23 00:24:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6bcd7e6f-8ac5-46fa-b682-db1578e675cb tempest-VolumesNegativeTest-1499264868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:18 devstack sudo[99712]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bc819d24-441e-4fc3-bd9e-659977df39b0 tempest-CinderUnicodeTest-1693875027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-12838a5f-feec-4f48-8d5b-d980c516c1c4.b5d26c81-4e7d-4f63-a2fd-8e59e5040c15" returned: 0 in 0.349s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bc819d24-441e-4fc3-bd9e-659977df39b0 tempest-CinderUnicodeTest-1693875027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-12838a5f-feec-4f48-8d5b-d980c516c1c4.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:18 devstack sudo[99716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-12838a5f-feec-4f48-8d5b-d980c516c1c4.info Sep 23 00:24:18 devstack sudo[99716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:18 devstack sudo[99711]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a68da7eb-a719-4d85-bde3-99fa79798aaf tempest-GroupSnapshotsTest-551234149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-72408e40-03a4-4681-9f9a-479c1943231b" returned: 0 in 0.534s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a68da7eb-a719-4d85-bde3-99fa79798aaf tempest-GroupSnapshotsTest-551234149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-72408e40-03a4-4681-9f9a-479c1943231b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:18 devstack sudo[99721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-72408e40-03a4-4681-9f9a-479c1943231b Sep 23 00:24:18 devstack sudo[99721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:18 devstack sudo[99716]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bc819d24-441e-4fc3-bd9e-659977df39b0 tempest-CinderUnicodeTest-1693875027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-12838a5f-feec-4f48-8d5b-d980c516c1c4.info" returned: 0 in 0.288s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:18 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-bc819d24-441e-4fc3-bd9e-659977df39b0 tempest-CinderUnicodeTest-1693875027 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-12838a5f-feec-4f48-8d5b-d980c516c1c4.info is being set with open permissions: ugo+rw Sep 23 00:24:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bc819d24-441e-4fc3-bd9e-659977df39b0 tempest-CinderUnicodeTest-1693875027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-12838a5f-feec-4f48-8d5b-d980c516c1c4.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:18 devstack sudo[99724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-12838a5f-feec-4f48-8d5b-d980c516c1c4.info Sep 23 00:24:18 devstack sudo[99724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:18 devstack sudo[99721]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a68da7eb-a719-4d85-bde3-99fa79798aaf tempest-GroupSnapshotsTest-551234149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-72408e40-03a4-4681-9f9a-479c1943231b" returned: 0 in 0.269s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a68da7eb-a719-4d85-bde3-99fa79798aaf tempest-GroupSnapshotsTest-551234149 None] Lock "cinder-quobyte-72408e40-03a4-4681-9f9a-479c1943231b" released by "delete_volume" :: held 0.869s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:18 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-a68da7eb-a719-4d85-bde3-99fa79798aaf tempest-GroupSnapshotsTest-551234149 None] Created reservations ['dbac6dff-27eb-4e91-8b73-98b1d206b545'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:24:18 devstack cinder-volume[86591]: WARNING cinder.quota [None req-a68da7eb-a719-4d85-bde3-99fa79798aaf tempest-GroupSnapshotsTest-551234149 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1081974933 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1081974933, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:24:18 devstack cinder-volume[86591]: WARNING cinder.quota [None req-a68da7eb-a719-4d85-bde3-99fa79798aaf tempest-GroupSnapshotsTest-551234149 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1081974933 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1081974933, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:24:18 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-a68da7eb-a719-4d85-bde3-99fa79798aaf tempest-GroupSnapshotsTest-551234149 None] Created reservations ['7cbd02be-005b-4951-95f6-88f23363c172', '9b12a104-365b-4fb8-878c-83dbe7390703', '519a9c48-e6b1-474a-8f6d-6df9980b0152', 'b42c95d7-147e-4757-b2bc-202e5e60027d'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:24:18 devstack sudo[99724]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bc819d24-441e-4fc3-bd9e-659977df39b0 tempest-CinderUnicodeTest-1693875027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-12838a5f-feec-4f48-8d5b-d980c516c1c4.info" returned: 0 in 0.300s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-bc819d24-441e-4fc3-bd9e-659977df39b0 tempest-CinderUnicodeTest-1693875027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.994s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6bcd7e6f-8ac5-46fa-b682-db1578e675cb tempest-VolumesNegativeTest-1499264868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.663s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:18 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6bcd7e6f-8ac5-46fa-b682-db1578e675cb tempest-VolumesNegativeTest-1499264868 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:24:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-628279150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5d043b7-304c-428d-84ee-49850de6c84a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f7c9108805247cb914077a9f0190447',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:18Z,use_quota=True,user_id='37f554f35ae84723b9faa38ab7937a57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:24:18 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-6bcd7e6f-8ac5-46fa-b682-db1578e675cb tempest-VolumesNegativeTest-1499264868 None] Creating volume e5d043b7-304c-428d-84ee-49850de6c84a {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:24:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6bcd7e6f-8ac5-46fa-b682-db1578e675cb tempest-VolumesNegativeTest-1499264868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6bcd7e6f-8ac5-46fa-b682-db1578e675cb tempest-VolumesNegativeTest-1499264868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:18 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6bcd7e6f-8ac5-46fa-b682-db1578e675cb tempest-VolumesNegativeTest-1499264868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:18 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6bcd7e6f-8ac5-46fa-b682-db1578e675cb tempest-VolumesNegativeTest-1499264868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6bcd7e6f-8ac5-46fa-b682-db1578e675cb tempest-VolumesNegativeTest-1499264868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:18 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6bcd7e6f-8ac5-46fa-b682-db1578e675cb tempest-VolumesNegativeTest-1499264868 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:24:18 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-6bcd7e6f-8ac5-46fa-b682-db1578e675cb tempest-VolumesNegativeTest-1499264868 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:24:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6bcd7e6f-8ac5-46fa-b682-db1578e675cb tempest-VolumesNegativeTest-1499264868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e5d043b7-304c-428d-84ee-49850de6c84a 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:18 devstack sudo[99728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e5d043b7-304c-428d-84ee-49850de6c84a 1073741824 Sep 23 00:24:18 devstack sudo[99728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:18 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-bc819d24-441e-4fc3-bd9e-659977df39b0 tempest-CinderUnicodeTest-1693875027 None] Create snapshot completed successfully Sep 23 00:24:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a68da7eb-a719-4d85-bde3-99fa79798aaf tempest-GroupSnapshotsTest-551234149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a68da7eb-a719-4d85-bde3-99fa79798aaf tempest-GroupSnapshotsTest-551234149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:19 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a68da7eb-a719-4d85-bde3-99fa79798aaf tempest-GroupSnapshotsTest-551234149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:19 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a68da7eb-a719-4d85-bde3-99fa79798aaf tempest-GroupSnapshotsTest-551234149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a68da7eb-a719-4d85-bde3-99fa79798aaf tempest-GroupSnapshotsTest-551234149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a68da7eb-a719-4d85-bde3-99fa79798aaf tempest-GroupSnapshotsTest-551234149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:19 devstack sudo[99730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:24:19 devstack sudo[99730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:19 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-22531ee6-f1d5-4e0c-9960-67c4de0d46d5 tempest-GroupSnapshotsTest-551234149 None] group_snapshot 436aa7c7-ea9f-472c-ba88-418e2c46b2cd: deleting Sep 23 00:24:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-22531ee6-f1d5-4e0c-9960-67c4de0d46d5 tempest-GroupSnapshotsTest-551234149 None] group_snapshot 436aa7c7-ea9f-472c-ba88-418e2c46b2cd: deleting {{(pid=86591) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 23 00:24:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-22531ee6-f1d5-4e0c-9960-67c4de0d46d5 tempest-GroupSnapshotsTest-551234149 None] Acquiring lock "cinder-quobyte-98b36d55-1707-44fe-80c0-966a9f01e037" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-22531ee6-f1d5-4e0c-9960-67c4de0d46d5 tempest-GroupSnapshotsTest-551234149 None] Lock "cinder-quobyte-98b36d55-1707-44fe-80c0-966a9f01e037" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-22531ee6-f1d5-4e0c-9960-67c4de0d46d5 tempest-GroupSnapshotsTest-551234149 None] Acquiring lock "cinder-quobyte-d51e24f1-7f59-4a75-8350-fe0099a2f46e" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-22531ee6-f1d5-4e0c-9960-67c4de0d46d5 tempest-GroupSnapshotsTest-551234149 None] Lock "cinder-quobyte-d51e24f1-7f59-4a75-8350-fe0099a2f46e" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:19 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-22531ee6-f1d5-4e0c-9960-67c4de0d46d5 tempest-GroupSnapshotsTest-551234149 None] Deleting offline snapshot d51e24f1-7f59-4a75-8350-fe0099a2f46e of volume 98b36d55-1707-44fe-80c0-966a9f01e037 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:24:19 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-22531ee6-f1d5-4e0c-9960-67c4de0d46d5 tempest-GroupSnapshotsTest-551234149 None] snapshot_file for this snap is: volume-98b36d55-1707-44fe-80c0-966a9f01e037.d51e24f1-7f59-4a75-8350-fe0099a2f46e {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:24:19 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8132b38-d3b6-4ac2-a9c8-81bc1663cba8]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-22531ee6-f1d5-4e0c-9960-67c4de0d46d5 tempest-GroupSnapshotsTest-551234149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-98b36d55-1707-44fe-80c0-966a9f01e037.d51e24f1-7f59-4a75-8350-fe0099a2f46e {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8448c7e8-17e1-4c14-ba20-725b7b33d5d0 tempest-CinderUnicodeTest-1693875027 None] Acquiring lock "cinder-b5d26c81-4e7d-4f63-a2fd-8e59e5040c15-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8448c7e8-17e1-4c14-ba20-725b7b33d5d0 tempest-CinderUnicodeTest-1693875027 None] Lock "cinder-b5d26c81-4e7d-4f63-a2fd-8e59e5040c15-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8448c7e8-17e1-4c14-ba20-725b7b33d5d0 tempest-CinderUnicodeTest-1693875027 None] Acquiring lock "cinder-quobyte-12838a5f-feec-4f48-8d5b-d980c516c1c4" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:19 devstack sudo[99728]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6bcd7e6f-8ac5-46fa-b682-db1578e675cb tempest-VolumesNegativeTest-1499264868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e5d043b7-304c-428d-84ee-49850de6c84a 1073741824" returned: 0 in 0.702s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8448c7e8-17e1-4c14-ba20-725b7b33d5d0 tempest-CinderUnicodeTest-1693875027 None] Lock "cinder-quobyte-12838a5f-feec-4f48-8d5b-d980c516c1c4" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8448c7e8-17e1-4c14-ba20-725b7b33d5d0 tempest-CinderUnicodeTest-1693875027 None] Acquiring lock "cinder-quobyte-b5d26c81-4e7d-4f63-a2fd-8e59e5040c15" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:19 devstack sudo[99730]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a68da7eb-a719-4d85-bde3-99fa79798aaf tempest-GroupSnapshotsTest-551234149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.583s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:19 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-a68da7eb-a719-4d85-bde3-99fa79798aaf tempest-GroupSnapshotsTest-551234149 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:24:19 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-a68da7eb-a719-4d85-bde3-99fa79798aaf tempest-GroupSnapshotsTest-551234149 None] Delete group completed successfully. Sep 23 00:24:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8448c7e8-17e1-4c14-ba20-725b7b33d5d0 tempest-CinderUnicodeTest-1693875027 None] Lock "cinder-quobyte-b5d26c81-4e7d-4f63-a2fd-8e59e5040c15" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:19 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-8448c7e8-17e1-4c14-ba20-725b7b33d5d0 tempest-CinderUnicodeTest-1693875027 None] Deleting offline snapshot b5d26c81-4e7d-4f63-a2fd-8e59e5040c15 of volume 12838a5f-feec-4f48-8d5b-d980c516c1c4 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:24:19 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-8448c7e8-17e1-4c14-ba20-725b7b33d5d0 tempest-CinderUnicodeTest-1693875027 None] snapshot_file for this snap is: volume-12838a5f-feec-4f48-8d5b-d980c516c1c4.b5d26c81-4e7d-4f63-a2fd-8e59e5040c15 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:24:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6bcd7e6f-8ac5-46fa-b682-db1578e675cb tempest-VolumesNegativeTest-1499264868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e5d043b7-304c-428d-84ee-49850de6c84a {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:19 devstack sudo[99736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-98b36d55-1707-44fe-80c0-966a9f01e037.d51e24f1-7f59-4a75-8350-fe0099a2f46e Sep 23 00:24:19 devstack sudo[99736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:19 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ffa9b5-118b-4367-8fad-a634eff10f82]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8448c7e8-17e1-4c14-ba20-725b7b33d5d0 tempest-CinderUnicodeTest-1693875027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-12838a5f-feec-4f48-8d5b-d980c516c1c4.b5d26c81-4e7d-4f63-a2fd-8e59e5040c15 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:19 devstack sudo[99738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e5d043b7-304c-428d-84ee-49850de6c84a Sep 23 00:24:19 devstack sudo[99738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:19 devstack sudo[99740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-12838a5f-feec-4f48-8d5b-d980c516c1c4.b5d26c81-4e7d-4f63-a2fd-8e59e5040c15 Sep 23 00:24:19 devstack sudo[99740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:20 devstack sudo[99736]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-22531ee6-f1d5-4e0c-9960-67c4de0d46d5 tempest-GroupSnapshotsTest-551234149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-98b36d55-1707-44fe-80c0-966a9f01e037.d51e24f1-7f59-4a75-8350-fe0099a2f46e" returned: 0 in 0.630s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:20 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-22531ee6-f1d5-4e0c-9960-67c4de0d46d5 tempest-GroupSnapshotsTest-551234149 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98b36d55-1707-44fe-80c0-966a9f01e037(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:24:20 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38aab2d-9653-4f46-8c17-2768c2a0ef01]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-22531ee6-f1d5-4e0c-9960-67c4de0d46d5 tempest-GroupSnapshotsTest-551234149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-98b36d55-1707-44fe-80c0-966a9f01e037 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:20 devstack sudo[99738]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6bcd7e6f-8ac5-46fa-b682-db1578e675cb tempest-VolumesNegativeTest-1499264868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e5d043b7-304c-428d-84ee-49850de6c84a" returned: 0 in 0.499s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:20 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6bcd7e6f-8ac5-46fa-b682-db1578e675cb tempest-VolumesNegativeTest-1499264868 None] <== create_volume: return (1315ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:24:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6bcd7e6f-8ac5-46fa-b682-db1578e675cb tempest-VolumesNegativeTest-1499264868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.319s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6bcd7e6f-8ac5-46fa-b682-db1578e675cb tempest-VolumesNegativeTest-1499264868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4c09837-c9e5-4f54-90b5-4df60e0a43d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5d043b7-304c-428d-84ee-49850de6c84a', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:20 devstack sudo[99740]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6bcd7e6f-8ac5-46fa-b682-db1578e675cb tempest-VolumesNegativeTest-1499264868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7d71109-5c89-48f7-86a0-1816ceb5aeae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8448c7e8-17e1-4c14-ba20-725b7b33d5d0 tempest-CinderUnicodeTest-1693875027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-12838a5f-feec-4f48-8d5b-d980c516c1c4.b5d26c81-4e7d-4f63-a2fd-8e59e5040c15" returned: 0 in 0.516s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:20 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-8448c7e8-17e1-4c14-ba20-725b7b33d5d0 tempest-CinderUnicodeTest-1693875027 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12838a5f-feec-4f48-8d5b-d980c516c1c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:24:20 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-6bcd7e6f-8ac5-46fa-b682-db1578e675cb tempest-VolumesNegativeTest-1499264868 None] Volume volume-e5d043b7-304c-428d-84ee-49850de6c84a (e5d043b7-304c-428d-84ee-49850de6c84a): created successfully Sep 23 00:24:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6bcd7e6f-8ac5-46fa-b682-db1578e675cb tempest-VolumesNegativeTest-1499264868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7d71109-5c89-48f7-86a0-1816ceb5aeae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6bcd7e6f-8ac5-46fa-b682-db1578e675cb tempest-VolumesNegativeTest-1499264868 None] Flow 'volume_create_manager' (e8c5d7e5-3ae4-4db6-bd25-7e6f7a91c5b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:24:20 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6520415-be48-42b1-8cf7-952ba0ffc3a3]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8448c7e8-17e1-4c14-ba20-725b7b33d5d0 tempest-CinderUnicodeTest-1693875027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-12838a5f-feec-4f48-8d5b-d980c516c1c4 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:20 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-6bcd7e6f-8ac5-46fa-b682-db1578e675cb tempest-VolumesNegativeTest-1499264868 None] Created volume successfully. Sep 23 00:24:20 devstack sudo[99751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-98b36d55-1707-44fe-80c0-966a9f01e037 Sep 23 00:24:20 devstack sudo[99751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:20 devstack sudo[99752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-12838a5f-feec-4f48-8d5b-d980c516c1c4 Sep 23 00:24:20 devstack sudo[99752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:20 devstack sudo[99752]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8448c7e8-17e1-4c14-ba20-725b7b33d5d0 tempest-CinderUnicodeTest-1693875027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-12838a5f-feec-4f48-8d5b-d980c516c1c4" returned: 0 in 0.456s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8448c7e8-17e1-4c14-ba20-725b7b33d5d0 tempest-CinderUnicodeTest-1693875027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-12838a5f-feec-4f48-8d5b-d980c516c1c4.b5d26c81-4e7d-4f63-a2fd-8e59e5040c15 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:20 devstack sudo[99760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-12838a5f-feec-4f48-8d5b-d980c516c1c4.b5d26c81-4e7d-4f63-a2fd-8e59e5040c15 Sep 23 00:24:20 devstack sudo[99760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:20 devstack sudo[99751]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-22531ee6-f1d5-4e0c-9960-67c4de0d46d5 tempest-GroupSnapshotsTest-551234149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-98b36d55-1707-44fe-80c0-966a9f01e037" returned: 0 in 0.720s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-22531ee6-f1d5-4e0c-9960-67c4de0d46d5 tempest-GroupSnapshotsTest-551234149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-98b36d55-1707-44fe-80c0-966a9f01e037.d51e24f1-7f59-4a75-8350-fe0099a2f46e {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:20 devstack sudo[99763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-98b36d55-1707-44fe-80c0-966a9f01e037.d51e24f1-7f59-4a75-8350-fe0099a2f46e Sep 23 00:24:20 devstack sudo[99763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:21 devstack sudo[99760]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8448c7e8-17e1-4c14-ba20-725b7b33d5d0 tempest-CinderUnicodeTest-1693875027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-12838a5f-feec-4f48-8d5b-d980c516c1c4.b5d26c81-4e7d-4f63-a2fd-8e59e5040c15" returned: 0 in 0.473s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8448c7e8-17e1-4c14-ba20-725b7b33d5d0 tempest-CinderUnicodeTest-1693875027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-12838a5f-feec-4f48-8d5b-d980c516c1c4.b5d26c81-4e7d-4f63-a2fd-8e59e5040c15 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:21 devstack sudo[99771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-12838a5f-feec-4f48-8d5b-d980c516c1c4.b5d26c81-4e7d-4f63-a2fd-8e59e5040c15 Sep 23 00:24:21 devstack sudo[99771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:21 devstack sudo[99763]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-22531ee6-f1d5-4e0c-9960-67c4de0d46d5 tempest-GroupSnapshotsTest-551234149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-98b36d55-1707-44fe-80c0-966a9f01e037.d51e24f1-7f59-4a75-8350-fe0099a2f46e" returned: 0 in 0.492s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-22531ee6-f1d5-4e0c-9960-67c4de0d46d5 tempest-GroupSnapshotsTest-551234149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-98b36d55-1707-44fe-80c0-966a9f01e037.d51e24f1-7f59-4a75-8350-fe0099a2f46e {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:21 devstack sudo[99773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-98b36d55-1707-44fe-80c0-966a9f01e037.d51e24f1-7f59-4a75-8350-fe0099a2f46e Sep 23 00:24:21 devstack sudo[99773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:21 devstack sudo[99771]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8448c7e8-17e1-4c14-ba20-725b7b33d5d0 tempest-CinderUnicodeTest-1693875027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-12838a5f-feec-4f48-8d5b-d980c516c1c4.b5d26c81-4e7d-4f63-a2fd-8e59e5040c15" returned: 0 in 0.364s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:21 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8448c7e8-17e1-4c14-ba20-725b7b33d5d0 tempest-CinderUnicodeTest-1693875027 None] Lock "cinder-quobyte-b5d26c81-4e7d-4f63-a2fd-8e59e5040c15" released by "_delete_snapshot" :: held 1.997s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:21 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8448c7e8-17e1-4c14-ba20-725b7b33d5d0 tempest-CinderUnicodeTest-1693875027 None] Lock "cinder-quobyte-12838a5f-feec-4f48-8d5b-d980c516c1c4" released by "delete_snapshot" :: held 2.051s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:21 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-8448c7e8-17e1-4c14-ba20-725b7b33d5d0 tempest-CinderUnicodeTest-1693875027 None] Created reservations ['e8f621b9-e5a0-41fc-b021-8b4d65e39509', '4988ced0-c4d6-4796-9b92-3c3fb704dc96', 'c6d90261-78d6-417a-a005-2dbe4d9ba58d', '879839b9-b456-4ad9-9cee-2b06e222673f'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:24:21 devstack sudo[99773]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-22531ee6-f1d5-4e0c-9960-67c4de0d46d5 tempest-GroupSnapshotsTest-551234149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-98b36d55-1707-44fe-80c0-966a9f01e037.d51e24f1-7f59-4a75-8350-fe0099a2f46e" returned: 0 in 0.451s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:21 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-8448c7e8-17e1-4c14-ba20-725b7b33d5d0 tempest-CinderUnicodeTest-1693875027 None] Delete snapshot completed successfully. Sep 23 00:24:21 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-22531ee6-f1d5-4e0c-9960-67c4de0d46d5 tempest-GroupSnapshotsTest-551234149 None] Lock "cinder-quobyte-d51e24f1-7f59-4a75-8350-fe0099a2f46e" released by "_delete_snapshot" :: held 2.488s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:21 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8448c7e8-17e1-4c14-ba20-725b7b33d5d0 tempest-CinderUnicodeTest-1693875027 None] Lock "cinder-b5d26c81-4e7d-4f63-a2fd-8e59e5040c15-delete_snapshot" released by "delete_snapshot" :: held 2.320s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:21 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-22531ee6-f1d5-4e0c-9960-67c4de0d46d5 tempest-GroupSnapshotsTest-551234149 None] Lock "cinder-quobyte-98b36d55-1707-44fe-80c0-966a9f01e037" released by "delete_snapshot" :: held 2.547s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:21 devstack cinder-volume[86591]: WARNING cinder.quota [None req-22531ee6-f1d5-4e0c-9960-67c4de0d46d5 tempest-GroupSnapshotsTest-551234149 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1081974933 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1081974933, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:24:22 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-22531ee6-f1d5-4e0c-9960-67c4de0d46d5 tempest-GroupSnapshotsTest-551234149 None] Created reservations ['dfeb9d41-39d9-4b27-88b0-b0bc9d011b63', 'c61242f9-d613-4bf6-ad83-82c76c480a55', 'c2f43e9f-3c82-46be-99fa-34386d3353a0', 'c40b08ae-a80a-471b-a537-5beb604d0b0e'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:24:22 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-22531ee6-f1d5-4e0c-9960-67c4de0d46d5 tempest-GroupSnapshotsTest-551234149 None] group_snapshot 436aa7c7-ea9f-472c-ba88-418e2c46b2cd: deleted successfully Sep 23 00:24:22 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a55ba007-15fb-4f18-baff-bc97f82b0a0c tempest-CinderUnicodeTest-1693875027 None] Acquiring lock "cinder-12838a5f-feec-4f48-8d5b-d980c516c1c4-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:22 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a55ba007-15fb-4f18-baff-bc97f82b0a0c tempest-CinderUnicodeTest-1693875027 None] Lock "cinder-12838a5f-feec-4f48-8d5b-d980c516c1c4-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:22 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a55ba007-15fb-4f18-baff-bc97f82b0a0c tempest-CinderUnicodeTest-1693875027 None] Acquiring lock "cinder-quobyte-12838a5f-feec-4f48-8d5b-d980c516c1c4" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:22 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a55ba007-15fb-4f18-baff-bc97f82b0a0c tempest-CinderUnicodeTest-1693875027 None] Lock "cinder-quobyte-12838a5f-feec-4f48-8d5b-d980c516c1c4" acquired by "delete_volume" :: waited 0.032s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:23 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[47772e56-2638-483d-97cc-ec4e334faf0d]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a55ba007-15fb-4f18-baff-bc97f82b0a0c tempest-CinderUnicodeTest-1693875027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-12838a5f-feec-4f48-8d5b-d980c516c1c4 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:23 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e347b06b-4b91-4a1a-a77e-de28eab62772 tempest-GroupSnapshotsTest-551234149 None] Acquiring lock "cinder-quobyte-98b36d55-1707-44fe-80c0-966a9f01e037" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:23 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e347b06b-4b91-4a1a-a77e-de28eab62772 tempest-GroupSnapshotsTest-551234149 None] Lock "cinder-quobyte-98b36d55-1707-44fe-80c0-966a9f01e037" acquired by "delete_volume" :: waited 0.038s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:23 devstack sudo[99804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-12838a5f-feec-4f48-8d5b-d980c516c1c4 Sep 23 00:24:23 devstack sudo[99804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:23 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda1e0e8-8e29-4f1e-b027-f768e9b2e7e4]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e347b06b-4b91-4a1a-a77e-de28eab62772 tempest-GroupSnapshotsTest-551234149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-98b36d55-1707-44fe-80c0-966a9f01e037 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:23 devstack sudo[99806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-98b36d55-1707-44fe-80c0-966a9f01e037 Sep 23 00:24:23 devstack sudo[99806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:23 devstack sudo[99804]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a55ba007-15fb-4f18-baff-bc97f82b0a0c tempest-CinderUnicodeTest-1693875027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-12838a5f-feec-4f48-8d5b-d980c516c1c4" returned: 0 in 0.684s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a55ba007-15fb-4f18-baff-bc97f82b0a0c tempest-CinderUnicodeTest-1693875027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-12838a5f-feec-4f48-8d5b-d980c516c1c4 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:23 devstack sudo[99812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-12838a5f-feec-4f48-8d5b-d980c516c1c4 Sep 23 00:24:23 devstack sudo[99812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:24 devstack sudo[99806]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e347b06b-4b91-4a1a-a77e-de28eab62772 tempest-GroupSnapshotsTest-551234149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-98b36d55-1707-44fe-80c0-966a9f01e037" returned: 0 in 0.768s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e347b06b-4b91-4a1a-a77e-de28eab62772 tempest-GroupSnapshotsTest-551234149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-98b36d55-1707-44fe-80c0-966a9f01e037 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:24 devstack sudo[99817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-98b36d55-1707-44fe-80c0-966a9f01e037 Sep 23 00:24:24 devstack sudo[99817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:24 devstack sudo[99812]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a55ba007-15fb-4f18-baff-bc97f82b0a0c tempest-CinderUnicodeTest-1693875027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-12838a5f-feec-4f48-8d5b-d980c516c1c4" returned: 0 in 0.675s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:24 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a55ba007-15fb-4f18-baff-bc97f82b0a0c tempest-CinderUnicodeTest-1693875027 None] Lock "cinder-quobyte-12838a5f-feec-4f48-8d5b-d980c516c1c4" released by "delete_volume" :: held 1.489s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:24 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-a55ba007-15fb-4f18-baff-bc97f82b0a0c tempest-CinderUnicodeTest-1693875027 None] Created reservations ['a496d362-c736-4f2b-b841-c19d8e612a38', '476465e7-181b-472c-91d2-47652ab1b825', '56ccf96f-6bc4-461e-9179-90a68a0aa043', 'ce03d505-e104-46b3-847a-47f06a37ecf9'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:24:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a55ba007-15fb-4f18-baff-bc97f82b0a0c tempest-CinderUnicodeTest-1693875027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a55ba007-15fb-4f18-baff-bc97f82b0a0c tempest-CinderUnicodeTest-1693875027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:24 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a55ba007-15fb-4f18-baff-bc97f82b0a0c tempest-CinderUnicodeTest-1693875027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:24 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a55ba007-15fb-4f18-baff-bc97f82b0a0c tempest-CinderUnicodeTest-1693875027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a55ba007-15fb-4f18-baff-bc97f82b0a0c tempest-CinderUnicodeTest-1693875027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a55ba007-15fb-4f18-baff-bc97f82b0a0c tempest-CinderUnicodeTest-1693875027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:24 devstack sudo[99826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:24:24 devstack sudo[99826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:25 devstack sudo[99817]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e347b06b-4b91-4a1a-a77e-de28eab62772 tempest-GroupSnapshotsTest-551234149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-98b36d55-1707-44fe-80c0-966a9f01e037" returned: 0 in 0.863s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:25 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e347b06b-4b91-4a1a-a77e-de28eab62772 tempest-GroupSnapshotsTest-551234149 None] Lock "cinder-quobyte-98b36d55-1707-44fe-80c0-966a9f01e037" released by "delete_volume" :: held 1.816s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:25 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-e347b06b-4b91-4a1a-a77e-de28eab62772 tempest-GroupSnapshotsTest-551234149 None] Created reservations ['87338058-e3bd-4c4b-8b60-cb3b78d17c1f'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:24:25 devstack cinder-volume[86591]: WARNING cinder.db.api [None req-e347b06b-4b91-4a1a-a77e-de28eab62772 tempest-GroupSnapshotsTest-551234149 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1081974933'] Sep 23 00:24:25 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-e347b06b-4b91-4a1a-a77e-de28eab62772 tempest-GroupSnapshotsTest-551234149 None] Created reservations ['c810d942-90aa-4afc-bd33-871d449eb358', 'a4f8ebeb-8fc9-44f9-882b-adc1402976f0', '9e562585-ab1e-4987-90f7-ad4b8abff3a8', '417ed3a0-4914-4414-a12c-00229e810c5b'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:24:25 devstack sudo[99826]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a55ba007-15fb-4f18-baff-bc97f82b0a0c tempest-CinderUnicodeTest-1693875027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.504s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:25 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-a55ba007-15fb-4f18-baff-bc97f82b0a0c tempest-CinderUnicodeTest-1693875027 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:24:25 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-a55ba007-15fb-4f18-baff-bc97f82b0a0c tempest-CinderUnicodeTest-1693875027 None] Deleted volume successfully. Sep 23 00:24:25 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a55ba007-15fb-4f18-baff-bc97f82b0a0c tempest-CinderUnicodeTest-1693875027 None] Lock "cinder-12838a5f-feec-4f48-8d5b-d980c516c1c4-delete_volume" released by "delete_volume" :: held 2.541s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:25 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d01ad5bc-184e-48c1-9507-1146fae76d91 tempest-CinderUnicodeTest-1693875027 None] Acquiring lock "cinder-2ced5c28-b2fb-485b-8ac3-e8681e272bfa-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:25 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d01ad5bc-184e-48c1-9507-1146fae76d91 tempest-CinderUnicodeTest-1693875027 None] Lock "cinder-2ced5c28-b2fb-485b-8ac3-e8681e272bfa-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e347b06b-4b91-4a1a-a77e-de28eab62772 tempest-GroupSnapshotsTest-551234149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e347b06b-4b91-4a1a-a77e-de28eab62772 tempest-GroupSnapshotsTest-551234149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:25 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e347b06b-4b91-4a1a-a77e-de28eab62772 tempest-GroupSnapshotsTest-551234149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:25 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e347b06b-4b91-4a1a-a77e-de28eab62772 tempest-GroupSnapshotsTest-551234149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e347b06b-4b91-4a1a-a77e-de28eab62772 tempest-GroupSnapshotsTest-551234149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e347b06b-4b91-4a1a-a77e-de28eab62772 tempest-GroupSnapshotsTest-551234149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:25 devstack sudo[99841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:24:25 devstack sudo[99841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:25 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d01ad5bc-184e-48c1-9507-1146fae76d91 tempest-CinderUnicodeTest-1693875027 None] Acquiring lock "cinder-quobyte-2ced5c28-b2fb-485b-8ac3-e8681e272bfa" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:25 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d01ad5bc-184e-48c1-9507-1146fae76d91 tempest-CinderUnicodeTest-1693875027 None] Lock "cinder-quobyte-2ced5c28-b2fb-485b-8ac3-e8681e272bfa" acquired by "delete_volume" :: waited 0.056s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:25 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[053f0a2a-4f76-42aa-9710-1c865e117795]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d01ad5bc-184e-48c1-9507-1146fae76d91 tempest-CinderUnicodeTest-1693875027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2ced5c28-b2fb-485b-8ac3-e8681e272bfa {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:25 devstack sudo[99846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2ced5c28-b2fb-485b-8ac3-e8681e272bfa Sep 23 00:24:25 devstack sudo[99846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:26 devstack sudo[99841]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e347b06b-4b91-4a1a-a77e-de28eab62772 tempest-GroupSnapshotsTest-551234149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.660s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:26 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-e347b06b-4b91-4a1a-a77e-de28eab62772 tempest-GroupSnapshotsTest-551234149 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:24:26 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-e347b06b-4b91-4a1a-a77e-de28eab62772 tempest-GroupSnapshotsTest-551234149 None] Delete group completed successfully. Sep 23 00:24:26 devstack sudo[99846]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d01ad5bc-184e-48c1-9507-1146fae76d91 tempest-CinderUnicodeTest-1693875027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2ced5c28-b2fb-485b-8ac3-e8681e272bfa" returned: 0 in 0.710s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d01ad5bc-184e-48c1-9507-1146fae76d91 tempest-CinderUnicodeTest-1693875027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2ced5c28-b2fb-485b-8ac3-e8681e272bfa {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:26 devstack sudo[99852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2ced5c28-b2fb-485b-8ac3-e8681e272bfa Sep 23 00:24:26 devstack sudo[99852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:26 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-4f8d46f6-234a-4ea2-b434-7d6591acc3d3 tempest-GroupSnapshotsTest-551234149 None] Group tempest-GroupSnapshotsTest-Group-1353621997: creating Sep 23 00:24:26 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-4f8d46f6-234a-4ea2-b434-7d6591acc3d3 tempest-GroupSnapshotsTest-551234149 None] Group tempest-GroupSnapshotsTest-Group-1353621997: created successfully Sep 23 00:24:26 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-4f8d46f6-234a-4ea2-b434-7d6591acc3d3 tempest-GroupSnapshotsTest-551234149 None] Create group completed successfully. Sep 23 00:24:27 devstack sudo[99852]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d01ad5bc-184e-48c1-9507-1146fae76d91 tempest-CinderUnicodeTest-1693875027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2ced5c28-b2fb-485b-8ac3-e8681e272bfa" returned: 0 in 0.534s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:27 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d01ad5bc-184e-48c1-9507-1146fae76d91 tempest-CinderUnicodeTest-1693875027 None] Lock "cinder-quobyte-2ced5c28-b2fb-485b-8ac3-e8681e272bfa" released by "delete_volume" :: held 1.316s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:27 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-d01ad5bc-184e-48c1-9507-1146fae76d91 tempest-CinderUnicodeTest-1693875027 None] Created reservations ['3494c8d4-260a-4d50-bea6-5bd792ccf7ea', '3f5573be-e8cb-44c7-abf7-e9f20bf68205', '0078f04f-0fca-4f73-bdaf-3b673b8a6981', '5ba77a42-dd09-4b89-ab11-b616271b2385'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:24:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d01ad5bc-184e-48c1-9507-1146fae76d91 tempest-CinderUnicodeTest-1693875027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d01ad5bc-184e-48c1-9507-1146fae76d91 tempest-CinderUnicodeTest-1693875027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:27 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d01ad5bc-184e-48c1-9507-1146fae76d91 tempest-CinderUnicodeTest-1693875027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:27 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d01ad5bc-184e-48c1-9507-1146fae76d91 tempest-CinderUnicodeTest-1693875027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d01ad5bc-184e-48c1-9507-1146fae76d91 tempest-CinderUnicodeTest-1693875027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d01ad5bc-184e-48c1-9507-1146fae76d91 tempest-CinderUnicodeTest-1693875027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:27 devstack sudo[99856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:24:27 devstack sudo[99856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:27 devstack sudo[99856]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d01ad5bc-184e-48c1-9507-1146fae76d91 tempest-CinderUnicodeTest-1693875027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.387s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:27 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-d01ad5bc-184e-48c1-9507-1146fae76d91 tempest-CinderUnicodeTest-1693875027 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:24:27 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-d01ad5bc-184e-48c1-9507-1146fae76d91 tempest-CinderUnicodeTest-1693875027 None] Deleted volume successfully. Sep 23 00:24:27 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d01ad5bc-184e-48c1-9507-1146fae76d91 tempest-CinderUnicodeTest-1693875027 None] Lock "cinder-2ced5c28-b2fb-485b-8ac3-e8681e272bfa-delete_volume" released by "delete_volume" :: held 2.130s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:28 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-17d9faea-b6e1-4ee3-bd32-1c5b7efe3430 tempest-GroupSnapshotsTest-551234149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:24:28 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-17d9faea-b6e1-4ee3-bd32-1c5b7efe3430 tempest-GroupSnapshotsTest-551234149 None] Flow 'volume_create_manager' (01c3cb6e-2872-45c1-b7ef-13a91cd84b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:24:28 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-17d9faea-b6e1-4ee3-bd32-1c5b7efe3430 tempest-GroupSnapshotsTest-551234149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03b1ee3e-6f86-4523-ab9a-7649034c5586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:28 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-17d9faea-b6e1-4ee3-bd32-1c5b7efe3430 tempest-GroupSnapshotsTest-551234149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03b1ee3e-6f86-4523-ab9a-7649034c5586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:24:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-720084469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c2a75d5e-2a8c-4312-93b5-dc0db9e18b59,host='devstack@QuobyteHD#QuobyteHD',id=434b0146-59d8-4883-8b4b-742aceebf230,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30618508f4cf422c8e7adfbbbdc767cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:29Z,use_quota=True,user_id='b87bbe3221254f829469d272c67c983a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f60c10a8-0bfe-46a4-8bcb-ffa783ce2608),volume_type_id=f60c10a8-0bfe-46a4-8bcb-ffa783ce2608)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:28 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-17d9faea-b6e1-4ee3-bd32-1c5b7efe3430 tempest-GroupSnapshotsTest-551234149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67b4fc72-7c68-41bf-a0bb-950f02ad59bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:28 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-17d9faea-b6e1-4ee3-bd32-1c5b7efe3430 tempest-GroupSnapshotsTest-551234149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67b4fc72-7c68-41bf-a0bb-950f02ad59bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:28 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-17d9faea-b6e1-4ee3-bd32-1c5b7efe3430 tempest-GroupSnapshotsTest-551234149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66d195e9-146e-4008-b808-a33de9c13651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:28 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-17d9faea-b6e1-4ee3-bd32-1c5b7efe3430 tempest-GroupSnapshotsTest-551234149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66d195e9-146e-4008-b808-a33de9c13651) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '434b0146-59d8-4883-8b4b-742aceebf230', 'volume_name': 'volume-434b0146-59d8-4883-8b4b-742aceebf230', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:28 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-17d9faea-b6e1-4ee3-bd32-1c5b7efe3430 tempest-GroupSnapshotsTest-551234149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bac3d834-2cb9-4264-9930-c906763c308a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:28 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-17d9faea-b6e1-4ee3-bd32-1c5b7efe3430 tempest-GroupSnapshotsTest-551234149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bac3d834-2cb9-4264-9930-c906763c308a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:28 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-17d9faea-b6e1-4ee3-bd32-1c5b7efe3430 tempest-GroupSnapshotsTest-551234149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5e4ddc8-c0ed-4e10-bbe3-b4ee72855590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:28 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-17d9faea-b6e1-4ee3-bd32-1c5b7efe3430 tempest-GroupSnapshotsTest-551234149 None] Volume 434b0146-59d8-4883-8b4b-742aceebf230: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-434b0146-59d8-4883-8b4b-742aceebf230', 'volume_size': 1} Sep 23 00:24:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-17d9faea-b6e1-4ee3-bd32-1c5b7efe3430 tempest-GroupSnapshotsTest-551234149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-17d9faea-b6e1-4ee3-bd32-1c5b7efe3430 tempest-GroupSnapshotsTest-551234149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:28 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-17d9faea-b6e1-4ee3-bd32-1c5b7efe3430 tempest-GroupSnapshotsTest-551234149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c2a75d5e-2a8c-4312-93b5-dc0db9e18b59,created_at=2026-09-22T22:24:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-720084469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c2a75d5e-2a8c-4312-93b5-dc0db9e18b59,host='devstack@QuobyteHD#QuobyteHD',id=434b0146-59d8-4883-8b4b-742aceebf230,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30618508f4cf422c8e7adfbbbdc767cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:29Z,use_quota=True,user_id='b87bbe3221254f829469d272c67c983a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f60c10a8-0bfe-46a4-8bcb-ffa783ce2608),volume_type_id=f60c10a8-0bfe-46a4-8bcb-ffa783ce2608)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:24:28 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-17d9faea-b6e1-4ee3-bd32-1c5b7efe3430 tempest-GroupSnapshotsTest-551234149 None] Creating volume 434b0146-59d8-4883-8b4b-742aceebf230 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:24:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-17d9faea-b6e1-4ee3-bd32-1c5b7efe3430 tempest-GroupSnapshotsTest-551234149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-17d9faea-b6e1-4ee3-bd32-1c5b7efe3430 tempest-GroupSnapshotsTest-551234149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:28 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-17d9faea-b6e1-4ee3-bd32-1c5b7efe3430 tempest-GroupSnapshotsTest-551234149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:28 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-17d9faea-b6e1-4ee3-bd32-1c5b7efe3430 tempest-GroupSnapshotsTest-551234149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-17d9faea-b6e1-4ee3-bd32-1c5b7efe3430 tempest-GroupSnapshotsTest-551234149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:28 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-17d9faea-b6e1-4ee3-bd32-1c5b7efe3430 tempest-GroupSnapshotsTest-551234149 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:24:28 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-17d9faea-b6e1-4ee3-bd32-1c5b7efe3430 tempest-GroupSnapshotsTest-551234149 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:24:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-17d9faea-b6e1-4ee3-bd32-1c5b7efe3430 tempest-GroupSnapshotsTest-551234149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-434b0146-59d8-4883-8b4b-742aceebf230 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:29 devstack sudo[99875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-434b0146-59d8-4883-8b4b-742aceebf230 1073741824 Sep 23 00:24:29 devstack sudo[99875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:29 devstack sudo[99875]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-17d9faea-b6e1-4ee3-bd32-1c5b7efe3430 tempest-GroupSnapshotsTest-551234149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-434b0146-59d8-4883-8b4b-742aceebf230 1073741824" returned: 0 in 0.657s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-17d9faea-b6e1-4ee3-bd32-1c5b7efe3430 tempest-GroupSnapshotsTest-551234149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-434b0146-59d8-4883-8b4b-742aceebf230 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:29 devstack sudo[99881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-434b0146-59d8-4883-8b4b-742aceebf230 Sep 23 00:24:29 devstack sudo[99881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:30 devstack sudo[99881]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-17d9faea-b6e1-4ee3-bd32-1c5b7efe3430 tempest-GroupSnapshotsTest-551234149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-434b0146-59d8-4883-8b4b-742aceebf230" returned: 0 in 0.547s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:30 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-17d9faea-b6e1-4ee3-bd32-1c5b7efe3430 tempest-GroupSnapshotsTest-551234149 None] <== create_volume: return (1273ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:24:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-17d9faea-b6e1-4ee3-bd32-1c5b7efe3430 tempest-GroupSnapshotsTest-551234149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.280s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:30 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-17d9faea-b6e1-4ee3-bd32-1c5b7efe3430 tempest-GroupSnapshotsTest-551234149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5e4ddc8-c0ed-4e10-bbe3-b4ee72855590) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-434b0146-59d8-4883-8b4b-742aceebf230', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:30 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-17d9faea-b6e1-4ee3-bd32-1c5b7efe3430 tempest-GroupSnapshotsTest-551234149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (564f9948-4a47-4256-8d75-271bc47ae264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:30 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-17d9faea-b6e1-4ee3-bd32-1c5b7efe3430 tempest-GroupSnapshotsTest-551234149 None] Volume volume-434b0146-59d8-4883-8b4b-742aceebf230 (434b0146-59d8-4883-8b4b-742aceebf230): created successfully Sep 23 00:24:30 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-17d9faea-b6e1-4ee3-bd32-1c5b7efe3430 tempest-GroupSnapshotsTest-551234149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (564f9948-4a47-4256-8d75-271bc47ae264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:30 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-17d9faea-b6e1-4ee3-bd32-1c5b7efe3430 tempest-GroupSnapshotsTest-551234149 None] Flow 'volume_create_manager' (01c3cb6e-2872-45c1-b7ef-13a91cd84b02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:24:30 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-17d9faea-b6e1-4ee3-bd32-1c5b7efe3430 tempest-GroupSnapshotsTest-551234149 None] Created volume successfully. Sep 23 00:24:33 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b1dc909-7f00-4e4d-8bed-848892b22f42 tempest-GroupSnapshotsTest-551234149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:24:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1b1dc909-7f00-4e4d-8bed-848892b22f42 tempest-GroupSnapshotsTest-551234149 None] Flow 'volume_create_manager' (e2423bce-77e0-43db-aeb2-6217559713ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:24:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1b1dc909-7f00-4e4d-8bed-848892b22f42 tempest-GroupSnapshotsTest-551234149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9399da7b-4292-4a53-b86d-886065de1ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1b1dc909-7f00-4e4d-8bed-848892b22f42 tempest-GroupSnapshotsTest-551234149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9399da7b-4292-4a53-b86d-886065de1ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:24:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1773879638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c2a75d5e-2a8c-4312-93b5-dc0db9e18b59,host='devstack@QuobyteHD#QuobyteHD',id=8d88a84b-bd81-4198-b719-45d87470ecee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30618508f4cf422c8e7adfbbbdc767cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:33Z,use_quota=True,user_id='b87bbe3221254f829469d272c67c983a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f60c10a8-0bfe-46a4-8bcb-ffa783ce2608),volume_type_id=f60c10a8-0bfe-46a4-8bcb-ffa783ce2608)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1b1dc909-7f00-4e4d-8bed-848892b22f42 tempest-GroupSnapshotsTest-551234149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbdde7ef-99ac-45ec-b5ca-ebe70231a125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1b1dc909-7f00-4e4d-8bed-848892b22f42 tempest-GroupSnapshotsTest-551234149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbdde7ef-99ac-45ec-b5ca-ebe70231a125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1b1dc909-7f00-4e4d-8bed-848892b22f42 tempest-GroupSnapshotsTest-551234149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68aeac47-6164-49e1-b388-e00b638989ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1b1dc909-7f00-4e4d-8bed-848892b22f42 tempest-GroupSnapshotsTest-551234149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68aeac47-6164-49e1-b388-e00b638989ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d88a84b-bd81-4198-b719-45d87470ecee', 'volume_name': 'volume-8d88a84b-bd81-4198-b719-45d87470ecee', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1b1dc909-7f00-4e4d-8bed-848892b22f42 tempest-GroupSnapshotsTest-551234149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (206ba5aa-b2da-4bf6-add4-1ee760149350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1b1dc909-7f00-4e4d-8bed-848892b22f42 tempest-GroupSnapshotsTest-551234149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (206ba5aa-b2da-4bf6-add4-1ee760149350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1b1dc909-7f00-4e4d-8bed-848892b22f42 tempest-GroupSnapshotsTest-551234149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e892a81-46ea-400a-8749-64bb0c92642a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:33 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-1b1dc909-7f00-4e4d-8bed-848892b22f42 tempest-GroupSnapshotsTest-551234149 None] Volume 8d88a84b-bd81-4198-b719-45d87470ecee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d88a84b-bd81-4198-b719-45d87470ecee', 'volume_size': 1} Sep 23 00:24:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1b1dc909-7f00-4e4d-8bed-848892b22f42 tempest-GroupSnapshotsTest-551234149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1b1dc909-7f00-4e4d-8bed-848892b22f42 tempest-GroupSnapshotsTest-551234149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:33 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1b1dc909-7f00-4e4d-8bed-848892b22f42 tempest-GroupSnapshotsTest-551234149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c2a75d5e-2a8c-4312-93b5-dc0db9e18b59,created_at=2026-09-22T22:24:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1773879638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c2a75d5e-2a8c-4312-93b5-dc0db9e18b59,host='devstack@QuobyteHD#QuobyteHD',id=8d88a84b-bd81-4198-b719-45d87470ecee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30618508f4cf422c8e7adfbbbdc767cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:33Z,use_quota=True,user_id='b87bbe3221254f829469d272c67c983a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f60c10a8-0bfe-46a4-8bcb-ffa783ce2608),volume_type_id=f60c10a8-0bfe-46a4-8bcb-ffa783ce2608)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:24:33 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-1b1dc909-7f00-4e4d-8bed-848892b22f42 tempest-GroupSnapshotsTest-551234149 None] Creating volume 8d88a84b-bd81-4198-b719-45d87470ecee {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:24:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1b1dc909-7f00-4e4d-8bed-848892b22f42 tempest-GroupSnapshotsTest-551234149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1b1dc909-7f00-4e4d-8bed-848892b22f42 tempest-GroupSnapshotsTest-551234149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:33 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1b1dc909-7f00-4e4d-8bed-848892b22f42 tempest-GroupSnapshotsTest-551234149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:33 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1b1dc909-7f00-4e4d-8bed-848892b22f42 tempest-GroupSnapshotsTest-551234149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1b1dc909-7f00-4e4d-8bed-848892b22f42 tempest-GroupSnapshotsTest-551234149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:33 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1b1dc909-7f00-4e4d-8bed-848892b22f42 tempest-GroupSnapshotsTest-551234149 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:24:33 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-1b1dc909-7f00-4e4d-8bed-848892b22f42 tempest-GroupSnapshotsTest-551234149 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:24:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1b1dc909-7f00-4e4d-8bed-848892b22f42 tempest-GroupSnapshotsTest-551234149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8d88a84b-bd81-4198-b719-45d87470ecee 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:33 devstack sudo[99952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8d88a84b-bd81-4198-b719-45d87470ecee 1073741824 Sep 23 00:24:33 devstack sudo[99952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:34 devstack sudo[99952]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1b1dc909-7f00-4e4d-8bed-848892b22f42 tempest-GroupSnapshotsTest-551234149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8d88a84b-bd81-4198-b719-45d87470ecee 1073741824" returned: 0 in 0.799s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1b1dc909-7f00-4e4d-8bed-848892b22f42 tempest-GroupSnapshotsTest-551234149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8d88a84b-bd81-4198-b719-45d87470ecee {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:34 devstack sudo[99958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8d88a84b-bd81-4198-b719-45d87470ecee Sep 23 00:24:34 devstack sudo[99958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:34 devstack sudo[99958]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1b1dc909-7f00-4e4d-8bed-848892b22f42 tempest-GroupSnapshotsTest-551234149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8d88a84b-bd81-4198-b719-45d87470ecee" returned: 0 in 0.406s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:34 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1b1dc909-7f00-4e4d-8bed-848892b22f42 tempest-GroupSnapshotsTest-551234149 None] <== create_volume: return (1262ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:24:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1b1dc909-7f00-4e4d-8bed-848892b22f42 tempest-GroupSnapshotsTest-551234149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.266s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1b1dc909-7f00-4e4d-8bed-848892b22f42 tempest-GroupSnapshotsTest-551234149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e892a81-46ea-400a-8749-64bb0c92642a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d88a84b-bd81-4198-b719-45d87470ecee', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1b1dc909-7f00-4e4d-8bed-848892b22f42 tempest-GroupSnapshotsTest-551234149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (442397f4-0d80-4916-bf8b-8ca167ea69cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:34 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-1b1dc909-7f00-4e4d-8bed-848892b22f42 tempest-GroupSnapshotsTest-551234149 None] Volume volume-8d88a84b-bd81-4198-b719-45d87470ecee (8d88a84b-bd81-4198-b719-45d87470ecee): created successfully Sep 23 00:24:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1b1dc909-7f00-4e4d-8bed-848892b22f42 tempest-GroupSnapshotsTest-551234149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (442397f4-0d80-4916-bf8b-8ca167ea69cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1b1dc909-7f00-4e4d-8bed-848892b22f42 tempest-GroupSnapshotsTest-551234149 None] Flow 'volume_create_manager' (e2423bce-77e0-43db-aeb2-6217559713ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:24:34 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-1b1dc909-7f00-4e4d-8bed-848892b22f42 tempest-GroupSnapshotsTest-551234149 None] Created volume successfully. Sep 23 00:24:36 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-418e65a6-c3bd-43bd-bcf7-33068f230ac5 tempest-GroupSnapshotsTest-551234149 None] Update group completed successfully. Sep 23 00:24:37 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-b791f6b2-3093-4647-9868-08a198db223d tempest-GroupSnapshotsTest-551234149 None] Update group completed successfully. Sep 23 00:24:38 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-a5832bcf-e1f0-494a-9eec-bd54e64cde70 tempest-GroupSnapshotsTest-551234149 None] Update group completed successfully. Sep 23 00:24:40 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-2b7d49d3-96a9-4981-8dce-52bfde71e6ce tempest-GroupSnapshotsTest-551234149 None] Update group completed successfully. Sep 23 00:24:42 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-db3a4184-4cfb-4eb4-8f21-0ddcbb4af111 tempest-GroupSnapshotsTest-551234149 None] GroupSnapshot 3471567a-74c6-44b1-bbd6-a668b3e8d1bf: creating. Sep 23 00:24:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-db3a4184-4cfb-4eb4-8f21-0ddcbb4af111 tempest-GroupSnapshotsTest-551234149 None] Group snapshot 3471567a-74c6-44b1-bbd6-a668b3e8d1bf: creating. {{(pid=86591) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 23 00:24:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-db3a4184-4cfb-4eb4-8f21-0ddcbb4af111 tempest-GroupSnapshotsTest-551234149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-db3a4184-4cfb-4eb4-8f21-0ddcbb4af111 tempest-GroupSnapshotsTest-551234149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-db3a4184-4cfb-4eb4-8f21-0ddcbb4af111 tempest-GroupSnapshotsTest-551234149 None] Creating offline snapshot 14419553-e16a-472d-b489-8dd53b3a51b5 of volume 434b0146-59d8-4883-8b4b-742aceebf230 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:24:42 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d6140f-f49f-4e64-ae81-f05c0fe6b3b7]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-db3a4184-4cfb-4eb4-8f21-0ddcbb4af111 tempest-GroupSnapshotsTest-551234149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-434b0146-59d8-4883-8b4b-742aceebf230 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:42 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-7422dda6-2d16-4fab-bc86-3f269710cf1e req-4eff9b91-6a15-42e8-86c0-c771c088b82e tempest-TestShelveInstance-858165662 None] Terminate volume connection completed successfully. Sep 23 00:24:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-7422dda6-2d16-4fab-bc86-3f269710cf1e req-4eff9b91-6a15-42e8-86c0-c771c088b82e tempest-TestShelveInstance-858165662 None] Deleting attachment 89f6ce4a-45e6-4749-a30a-76d613a5d5a9. {{(pid=86591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:24:42 devstack sudo[100015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-434b0146-59d8-4883-8b4b-742aceebf230 Sep 23 00:24:42 devstack sudo[100015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:43 devstack sudo[100015]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-db3a4184-4cfb-4eb4-8f21-0ddcbb4af111 tempest-GroupSnapshotsTest-551234149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-434b0146-59d8-4883-8b4b-742aceebf230" returned: 0 in 0.695s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-db3a4184-4cfb-4eb4-8f21-0ddcbb4af111 tempest-GroupSnapshotsTest-551234149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-434b0146-59d8-4883-8b4b-742aceebf230,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-434b0146-59d8-4883-8b4b-742aceebf230.14419553-e16a-472d-b489-8dd53b3a51b5 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:43 devstack sudo[100021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-434b0146-59d8-4883-8b4b-742aceebf230,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-434b0146-59d8-4883-8b4b-742aceebf230.14419553-e16a-472d-b489-8dd53b3a51b5 1G Sep 23 00:24:43 devstack sudo[100021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:44 devstack sudo[100021]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-db3a4184-4cfb-4eb4-8f21-0ddcbb4af111 tempest-GroupSnapshotsTest-551234149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-434b0146-59d8-4883-8b4b-742aceebf230,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-434b0146-59d8-4883-8b4b-742aceebf230.14419553-e16a-472d-b489-8dd53b3a51b5 1G" returned: 0 in 0.885s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-db3a4184-4cfb-4eb4-8f21-0ddcbb4af111 tempest-GroupSnapshotsTest-551234149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-434b0146-59d8-4883-8b4b-742aceebf230 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-434b0146-59d8-4883-8b4b-742aceebf230.14419553-e16a-472d-b489-8dd53b3a51b5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:44 devstack sudo[100027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-434b0146-59d8-4883-8b4b-742aceebf230 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-434b0146-59d8-4883-8b4b-742aceebf230.14419553-e16a-472d-b489-8dd53b3a51b5 Sep 23 00:24:44 devstack sudo[100027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:44 devstack sudo[100027]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-db3a4184-4cfb-4eb4-8f21-0ddcbb4af111 tempest-GroupSnapshotsTest-551234149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-434b0146-59d8-4883-8b4b-742aceebf230 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-434b0146-59d8-4883-8b4b-742aceebf230.14419553-e16a-472d-b489-8dd53b3a51b5" returned: 0 in 0.576s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:44 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-db3a4184-4cfb-4eb4-8f21-0ddcbb4af111 tempest-GroupSnapshotsTest-551234149 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-434b0146-59d8-4883-8b4b-742aceebf230.14419553-e16a-472d-b489-8dd53b3a51b5 is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:24:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-db3a4184-4cfb-4eb4-8f21-0ddcbb4af111 tempest-GroupSnapshotsTest-551234149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-434b0146-59d8-4883-8b4b-742aceebf230.14419553-e16a-472d-b489-8dd53b3a51b5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:44 devstack sudo[100033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-434b0146-59d8-4883-8b4b-742aceebf230.14419553-e16a-472d-b489-8dd53b3a51b5 Sep 23 00:24:44 devstack sudo[100033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:44 devstack sudo[100033]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-db3a4184-4cfb-4eb4-8f21-0ddcbb4af111 tempest-GroupSnapshotsTest-551234149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-434b0146-59d8-4883-8b4b-742aceebf230.14419553-e16a-472d-b489-8dd53b3a51b5" returned: 0 in 0.356s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-db3a4184-4cfb-4eb4-8f21-0ddcbb4af111 tempest-GroupSnapshotsTest-551234149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-434b0146-59d8-4883-8b4b-742aceebf230.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:45 devstack sudo[100036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-434b0146-59d8-4883-8b4b-742aceebf230.info Sep 23 00:24:45 devstack sudo[100036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:45 devstack sudo[100036]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-db3a4184-4cfb-4eb4-8f21-0ddcbb4af111 tempest-GroupSnapshotsTest-551234149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-434b0146-59d8-4883-8b4b-742aceebf230.info" returned: 0 in 0.395s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:45 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-db3a4184-4cfb-4eb4-8f21-0ddcbb4af111 tempest-GroupSnapshotsTest-551234149 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-434b0146-59d8-4883-8b4b-742aceebf230.info is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:24:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-db3a4184-4cfb-4eb4-8f21-0ddcbb4af111 tempest-GroupSnapshotsTest-551234149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-434b0146-59d8-4883-8b4b-742aceebf230.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:45 devstack sudo[100039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-434b0146-59d8-4883-8b4b-742aceebf230.info Sep 23 00:24:45 devstack sudo[100039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:45 devstack sudo[100039]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-db3a4184-4cfb-4eb4-8f21-0ddcbb4af111 tempest-GroupSnapshotsTest-551234149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-434b0146-59d8-4883-8b4b-742aceebf230.info" returned: 0 in 0.422s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-db3a4184-4cfb-4eb4-8f21-0ddcbb4af111 tempest-GroupSnapshotsTest-551234149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.507s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-db3a4184-4cfb-4eb4-8f21-0ddcbb4af111 tempest-GroupSnapshotsTest-551234149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-db3a4184-4cfb-4eb4-8f21-0ddcbb4af111 tempest-GroupSnapshotsTest-551234149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:45 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-db3a4184-4cfb-4eb4-8f21-0ddcbb4af111 tempest-GroupSnapshotsTest-551234149 None] Creating offline snapshot 988df983-a287-47da-ac9a-a0d74eb6100c of volume 8d88a84b-bd81-4198-b719-45d87470ecee {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:24:45 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[34edb964-b1ba-44f9-9a00-aeeee002cf5d]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-db3a4184-4cfb-4eb4-8f21-0ddcbb4af111 tempest-GroupSnapshotsTest-551234149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8d88a84b-bd81-4198-b719-45d87470ecee {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:46 devstack sudo[100043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8d88a84b-bd81-4198-b719-45d87470ecee Sep 23 00:24:46 devstack sudo[100043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:46 devstack sudo[100043]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-db3a4184-4cfb-4eb4-8f21-0ddcbb4af111 tempest-GroupSnapshotsTest-551234149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8d88a84b-bd81-4198-b719-45d87470ecee" returned: 0 in 0.638s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-db3a4184-4cfb-4eb4-8f21-0ddcbb4af111 tempest-GroupSnapshotsTest-551234149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8d88a84b-bd81-4198-b719-45d87470ecee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8d88a84b-bd81-4198-b719-45d87470ecee.988df983-a287-47da-ac9a-a0d74eb6100c 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:46 devstack sudo[100050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8d88a84b-bd81-4198-b719-45d87470ecee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8d88a84b-bd81-4198-b719-45d87470ecee.988df983-a287-47da-ac9a-a0d74eb6100c 1G Sep 23 00:24:46 devstack sudo[100050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:47 devstack sudo[100050]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-db3a4184-4cfb-4eb4-8f21-0ddcbb4af111 tempest-GroupSnapshotsTest-551234149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8d88a84b-bd81-4198-b719-45d87470ecee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8d88a84b-bd81-4198-b719-45d87470ecee.988df983-a287-47da-ac9a-a0d74eb6100c 1G" returned: 0 in 0.713s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-db3a4184-4cfb-4eb4-8f21-0ddcbb4af111 tempest-GroupSnapshotsTest-551234149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d88a84b-bd81-4198-b719-45d87470ecee -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8d88a84b-bd81-4198-b719-45d87470ecee.988df983-a287-47da-ac9a-a0d74eb6100c {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:47 devstack sudo[100057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d88a84b-bd81-4198-b719-45d87470ecee -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8d88a84b-bd81-4198-b719-45d87470ecee.988df983-a287-47da-ac9a-a0d74eb6100c Sep 23 00:24:47 devstack sudo[100057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:47 devstack sudo[100057]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-db3a4184-4cfb-4eb4-8f21-0ddcbb4af111 tempest-GroupSnapshotsTest-551234149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d88a84b-bd81-4198-b719-45d87470ecee -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8d88a84b-bd81-4198-b719-45d87470ecee.988df983-a287-47da-ac9a-a0d74eb6100c" returned: 0 in 0.592s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:47 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-db3a4184-4cfb-4eb4-8f21-0ddcbb4af111 tempest-GroupSnapshotsTest-551234149 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8d88a84b-bd81-4198-b719-45d87470ecee.988df983-a287-47da-ac9a-a0d74eb6100c is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:24:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-db3a4184-4cfb-4eb4-8f21-0ddcbb4af111 tempest-GroupSnapshotsTest-551234149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8d88a84b-bd81-4198-b719-45d87470ecee.988df983-a287-47da-ac9a-a0d74eb6100c {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:47 devstack sudo[100069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8d88a84b-bd81-4198-b719-45d87470ecee.988df983-a287-47da-ac9a-a0d74eb6100c Sep 23 00:24:47 devstack sudo[100069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-0fc37564-9018-4136-99eb-12d932aad9ea req-fe16ac32-77b4-455c-96fa-a66e9bb1b849 tempest-TestShelveInstance-858165662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:48 devstack sudo[100069]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-db3a4184-4cfb-4eb4-8f21-0ddcbb4af111 tempest-GroupSnapshotsTest-551234149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8d88a84b-bd81-4198-b719-45d87470ecee.988df983-a287-47da-ac9a-a0d74eb6100c" returned: 0 in 0.391s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-db3a4184-4cfb-4eb4-8f21-0ddcbb4af111 tempest-GroupSnapshotsTest-551234149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8d88a84b-bd81-4198-b719-45d87470ecee.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:48 devstack sudo[100074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8d88a84b-bd81-4198-b719-45d87470ecee.info Sep 23 00:24:48 devstack sudo[100074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:48 devstack sudo[100074]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-db3a4184-4cfb-4eb4-8f21-0ddcbb4af111 tempest-GroupSnapshotsTest-551234149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8d88a84b-bd81-4198-b719-45d87470ecee.info" returned: 0 in 0.345s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:48 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-db3a4184-4cfb-4eb4-8f21-0ddcbb4af111 tempest-GroupSnapshotsTest-551234149 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8d88a84b-bd81-4198-b719-45d87470ecee.info is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:24:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-db3a4184-4cfb-4eb4-8f21-0ddcbb4af111 tempest-GroupSnapshotsTest-551234149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8d88a84b-bd81-4198-b719-45d87470ecee.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:48 devstack sudo[100077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8d88a84b-bd81-4198-b719-45d87470ecee.info Sep 23 00:24:48 devstack sudo[100077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:48 devstack sudo[100077]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-db3a4184-4cfb-4eb4-8f21-0ddcbb4af111 tempest-GroupSnapshotsTest-551234149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8d88a84b-bd81-4198-b719-45d87470ecee.info" returned: 0 in 0.334s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-db3a4184-4cfb-4eb4-8f21-0ddcbb4af111 tempest-GroupSnapshotsTest-551234149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.172s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-0fc37564-9018-4136-99eb-12d932aad9ea req-fe16ac32-77b4-455c-96fa-a66e9bb1b849 tempest-TestShelveInstance-858165662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.862s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-0fc37564-9018-4136-99eb-12d932aad9ea req-fe16ac32-77b4-455c-96fa-a66e9bb1b849 tempest-TestShelveInstance-858165662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-0fc37564-9018-4136-99eb-12d932aad9ea req-fe16ac32-77b4-455c-96fa-a66e9bb1b849 tempest-TestShelveInstance-858165662 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974', 'name': 'volume-5742048b-8986-4b18-98b4-10946835dfb3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'be4147cf-f4bd-4358-9d75-322402772c8f', 'enforce_multipath': True} {{(pid=86591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:24:49 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-0fc37564-9018-4136-99eb-12d932aad9ea req-fe16ac32-77b4-455c-96fa-a66e9bb1b849 tempest-TestShelveInstance-858165662 None] attachment_update completed successfully. Sep 23 00:24:49 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-db3a4184-4cfb-4eb4-8f21-0ddcbb4af111 tempest-GroupSnapshotsTest-551234149 None] group_snapshot 3471567a-74c6-44b1-bbd6-a668b3e8d1bf: created successfully Sep 23 00:24:50 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-84a4ac47-7e33-4f97-bbba-07be6b94c9ec tempest-VolumesNegativeTest-1499264868 None] Acquiring lock "cinder-e5d043b7-304c-428d-84ee-49850de6c84a-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:50 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-84a4ac47-7e33-4f97-bbba-07be6b94c9ec tempest-VolumesNegativeTest-1499264868 None] Lock "cinder-e5d043b7-304c-428d-84ee-49850de6c84a-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:50 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-6e3e12a7-cc11-4488-b644-e0e441f2abff tempest-GroupSnapshotsTest-551234149 None] group_snapshot 3471567a-74c6-44b1-bbd6-a668b3e8d1bf: deleting Sep 23 00:24:50 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-84a4ac47-7e33-4f97-bbba-07be6b94c9ec tempest-VolumesNegativeTest-1499264868 None] Acquiring lock "cinder-quobyte-e5d043b7-304c-428d-84ee-49850de6c84a" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6e3e12a7-cc11-4488-b644-e0e441f2abff tempest-GroupSnapshotsTest-551234149 None] group_snapshot 3471567a-74c6-44b1-bbd6-a668b3e8d1bf: deleting {{(pid=86591) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 23 00:24:50 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-84a4ac47-7e33-4f97-bbba-07be6b94c9ec tempest-VolumesNegativeTest-1499264868 None] Lock "cinder-quobyte-e5d043b7-304c-428d-84ee-49850de6c84a" acquired by "delete_volume" :: waited 0.043s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:50 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6e3e12a7-cc11-4488-b644-e0e441f2abff tempest-GroupSnapshotsTest-551234149 None] Acquiring lock "cinder-quobyte-434b0146-59d8-4883-8b4b-742aceebf230" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:50 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6e3e12a7-cc11-4488-b644-e0e441f2abff tempest-GroupSnapshotsTest-551234149 None] Lock "cinder-quobyte-434b0146-59d8-4883-8b4b-742aceebf230" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:50 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6e3e12a7-cc11-4488-b644-e0e441f2abff tempest-GroupSnapshotsTest-551234149 None] Acquiring lock "cinder-quobyte-14419553-e16a-472d-b489-8dd53b3a51b5" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:50 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[93063519-bf4b-458a-b6e7-ca73bf5eea76]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-84a4ac47-7e33-4f97-bbba-07be6b94c9ec tempest-VolumesNegativeTest-1499264868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e5d043b7-304c-428d-84ee-49850de6c84a {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:50 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6e3e12a7-cc11-4488-b644-e0e441f2abff tempest-GroupSnapshotsTest-551234149 None] Lock "cinder-quobyte-14419553-e16a-472d-b489-8dd53b3a51b5" acquired by "_delete_snapshot" :: waited 0.065s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:50 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-6e3e12a7-cc11-4488-b644-e0e441f2abff tempest-GroupSnapshotsTest-551234149 None] Deleting offline snapshot 14419553-e16a-472d-b489-8dd53b3a51b5 of volume 434b0146-59d8-4883-8b4b-742aceebf230 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:24:50 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-6e3e12a7-cc11-4488-b644-e0e441f2abff tempest-GroupSnapshotsTest-551234149 None] snapshot_file for this snap is: volume-434b0146-59d8-4883-8b4b-742aceebf230.14419553-e16a-472d-b489-8dd53b3a51b5 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:24:50 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[896fe6d3-f858-457b-b11b-11ff1174b779]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6e3e12a7-cc11-4488-b644-e0e441f2abff tempest-GroupSnapshotsTest-551234149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-434b0146-59d8-4883-8b4b-742aceebf230.14419553-e16a-472d-b489-8dd53b3a51b5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:50 devstack sudo[100080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e5d043b7-304c-428d-84ee-49850de6c84a Sep 23 00:24:50 devstack sudo[100080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:50 devstack sudo[100081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-434b0146-59d8-4883-8b4b-742aceebf230.14419553-e16a-472d-b489-8dd53b3a51b5 Sep 23 00:24:50 devstack sudo[100081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:50 devstack sudo[100080]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-84a4ac47-7e33-4f97-bbba-07be6b94c9ec tempest-VolumesNegativeTest-1499264868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e5d043b7-304c-428d-84ee-49850de6c84a" returned: 0 in 0.663s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-84a4ac47-7e33-4f97-bbba-07be6b94c9ec tempest-VolumesNegativeTest-1499264868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e5d043b7-304c-428d-84ee-49850de6c84a {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:51 devstack sudo[100081]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6e3e12a7-cc11-4488-b644-e0e441f2abff tempest-GroupSnapshotsTest-551234149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-434b0146-59d8-4883-8b4b-742aceebf230.14419553-e16a-472d-b489-8dd53b3a51b5" returned: 0 in 0.572s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:51 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-6e3e12a7-cc11-4488-b644-e0e441f2abff tempest-GroupSnapshotsTest-551234149 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-434b0146-59d8-4883-8b4b-742aceebf230(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:24:51 devstack sudo[100091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e5d043b7-304c-428d-84ee-49850de6c84a Sep 23 00:24:51 devstack sudo[100091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:51 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e6700f-b412-40d7-9564-59bd8c917639]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6e3e12a7-cc11-4488-b644-e0e441f2abff tempest-GroupSnapshotsTest-551234149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-434b0146-59d8-4883-8b4b-742aceebf230 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:51 devstack sudo[100093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-434b0146-59d8-4883-8b4b-742aceebf230 Sep 23 00:24:51 devstack sudo[100093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:51 devstack sudo[100091]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-84a4ac47-7e33-4f97-bbba-07be6b94c9ec tempest-VolumesNegativeTest-1499264868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e5d043b7-304c-428d-84ee-49850de6c84a" returned: 0 in 0.455s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:51 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-84a4ac47-7e33-4f97-bbba-07be6b94c9ec tempest-VolumesNegativeTest-1499264868 None] Lock "cinder-quobyte-e5d043b7-304c-428d-84ee-49850de6c84a" released by "delete_volume" :: held 1.256s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:51 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-84a4ac47-7e33-4f97-bbba-07be6b94c9ec tempest-VolumesNegativeTest-1499264868 None] Created reservations ['17479ac7-2fe5-45d0-9277-7443ff8b61c4', '5a2f7af4-310c-4f6d-856e-928ff30dbfd4', 'f48dc412-1f67-4d9a-b302-d70a9e442f81', '98911c15-b1b5-4ba8-bcda-c368abc908cb'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:24:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-84a4ac47-7e33-4f97-bbba-07be6b94c9ec tempest-VolumesNegativeTest-1499264868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-84a4ac47-7e33-4f97-bbba-07be6b94c9ec tempest-VolumesNegativeTest-1499264868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:51 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-84a4ac47-7e33-4f97-bbba-07be6b94c9ec tempest-VolumesNegativeTest-1499264868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:51 devstack sudo[100093]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:51 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-84a4ac47-7e33-4f97-bbba-07be6b94c9ec tempest-VolumesNegativeTest-1499264868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-84a4ac47-7e33-4f97-bbba-07be6b94c9ec tempest-VolumesNegativeTest-1499264868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-84a4ac47-7e33-4f97-bbba-07be6b94c9ec tempest-VolumesNegativeTest-1499264868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6e3e12a7-cc11-4488-b644-e0e441f2abff tempest-GroupSnapshotsTest-551234149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-434b0146-59d8-4883-8b4b-742aceebf230" returned: 0 in 0.725s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6e3e12a7-cc11-4488-b644-e0e441f2abff tempest-GroupSnapshotsTest-551234149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-434b0146-59d8-4883-8b4b-742aceebf230.14419553-e16a-472d-b489-8dd53b3a51b5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:51 devstack sudo[100100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:24:51 devstack sudo[100100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:51 devstack sudo[100101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-434b0146-59d8-4883-8b4b-742aceebf230.14419553-e16a-472d-b489-8dd53b3a51b5 Sep 23 00:24:51 devstack sudo[100101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:52 devstack sudo[100100]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-84a4ac47-7e33-4f97-bbba-07be6b94c9ec tempest-VolumesNegativeTest-1499264868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.429s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:52 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-84a4ac47-7e33-4f97-bbba-07be6b94c9ec tempest-VolumesNegativeTest-1499264868 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:24:52 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-84a4ac47-7e33-4f97-bbba-07be6b94c9ec tempest-VolumesNegativeTest-1499264868 None] Deleted volume successfully. Sep 23 00:24:52 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-84a4ac47-7e33-4f97-bbba-07be6b94c9ec tempest-VolumesNegativeTest-1499264868 None] Lock "cinder-e5d043b7-304c-428d-84ee-49850de6c84a-delete_volume" released by "delete_volume" :: held 2.168s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:52 devstack sudo[100101]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6e3e12a7-cc11-4488-b644-e0e441f2abff tempest-GroupSnapshotsTest-551234149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-434b0146-59d8-4883-8b4b-742aceebf230.14419553-e16a-472d-b489-8dd53b3a51b5" returned: 0 in 0.693s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6e3e12a7-cc11-4488-b644-e0e441f2abff tempest-GroupSnapshotsTest-551234149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-434b0146-59d8-4883-8b4b-742aceebf230.14419553-e16a-472d-b489-8dd53b3a51b5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:52 devstack sudo[100109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-434b0146-59d8-4883-8b4b-742aceebf230.14419553-e16a-472d-b489-8dd53b3a51b5 Sep 23 00:24:52 devstack sudo[100109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:52 devstack sudo[100109]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6e3e12a7-cc11-4488-b644-e0e441f2abff tempest-GroupSnapshotsTest-551234149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-434b0146-59d8-4883-8b4b-742aceebf230.14419553-e16a-472d-b489-8dd53b3a51b5" returned: 0 in 0.444s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:53 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6e3e12a7-cc11-4488-b644-e0e441f2abff tempest-GroupSnapshotsTest-551234149 None] Lock "cinder-quobyte-14419553-e16a-472d-b489-8dd53b3a51b5" released by "_delete_snapshot" :: held 2.623s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:53 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6e3e12a7-cc11-4488-b644-e0e441f2abff tempest-GroupSnapshotsTest-551234149 None] Lock "cinder-quobyte-434b0146-59d8-4883-8b4b-742aceebf230" released by "delete_snapshot" :: held 2.702s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:53 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6e3e12a7-cc11-4488-b644-e0e441f2abff tempest-GroupSnapshotsTest-551234149 None] Acquiring lock "cinder-quobyte-8d88a84b-bd81-4198-b719-45d87470ecee" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:53 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6e3e12a7-cc11-4488-b644-e0e441f2abff tempest-GroupSnapshotsTest-551234149 None] Lock "cinder-quobyte-8d88a84b-bd81-4198-b719-45d87470ecee" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:53 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6e3e12a7-cc11-4488-b644-e0e441f2abff tempest-GroupSnapshotsTest-551234149 None] Acquiring lock "cinder-quobyte-988df983-a287-47da-ac9a-a0d74eb6100c" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:53 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6e3e12a7-cc11-4488-b644-e0e441f2abff tempest-GroupSnapshotsTest-551234149 None] Lock "cinder-quobyte-988df983-a287-47da-ac9a-a0d74eb6100c" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:53 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-6e3e12a7-cc11-4488-b644-e0e441f2abff tempest-GroupSnapshotsTest-551234149 None] Deleting offline snapshot 988df983-a287-47da-ac9a-a0d74eb6100c of volume 8d88a84b-bd81-4198-b719-45d87470ecee {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:24:53 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-6e3e12a7-cc11-4488-b644-e0e441f2abff tempest-GroupSnapshotsTest-551234149 None] snapshot_file for this snap is: volume-8d88a84b-bd81-4198-b719-45d87470ecee.988df983-a287-47da-ac9a-a0d74eb6100c {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:24:53 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a939db07-bb1d-4385-b83d-1991d4353720]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6e3e12a7-cc11-4488-b644-e0e441f2abff tempest-GroupSnapshotsTest-551234149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8d88a84b-bd81-4198-b719-45d87470ecee.988df983-a287-47da-ac9a-a0d74eb6100c {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:53 devstack sudo[100112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8d88a84b-bd81-4198-b719-45d87470ecee.988df983-a287-47da-ac9a-a0d74eb6100c Sep 23 00:24:53 devstack sudo[100112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:53 devstack sudo[100112]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6e3e12a7-cc11-4488-b644-e0e441f2abff tempest-GroupSnapshotsTest-551234149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8d88a84b-bd81-4198-b719-45d87470ecee.988df983-a287-47da-ac9a-a0d74eb6100c" returned: 0 in 0.751s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:53 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-6e3e12a7-cc11-4488-b644-e0e441f2abff tempest-GroupSnapshotsTest-551234149 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d88a84b-bd81-4198-b719-45d87470ecee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:24:54 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7ecab2-131d-48cd-8549-853537a2cddc]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6e3e12a7-cc11-4488-b644-e0e441f2abff tempest-GroupSnapshotsTest-551234149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8d88a84b-bd81-4198-b719-45d87470ecee {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:54 devstack sudo[100215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8d88a84b-bd81-4198-b719-45d87470ecee Sep 23 00:24:54 devstack sudo[100215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:54 devstack sudo[100215]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6e3e12a7-cc11-4488-b644-e0e441f2abff tempest-GroupSnapshotsTest-551234149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8d88a84b-bd81-4198-b719-45d87470ecee" returned: 0 in 0.920s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6e3e12a7-cc11-4488-b644-e0e441f2abff tempest-GroupSnapshotsTest-551234149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8d88a84b-bd81-4198-b719-45d87470ecee.988df983-a287-47da-ac9a-a0d74eb6100c {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:55 devstack sudo[100570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8d88a84b-bd81-4198-b719-45d87470ecee.988df983-a287-47da-ac9a-a0d74eb6100c Sep 23 00:24:55 devstack sudo[100570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:55 devstack sudo[100570]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6e3e12a7-cc11-4488-b644-e0e441f2abff tempest-GroupSnapshotsTest-551234149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8d88a84b-bd81-4198-b719-45d87470ecee.988df983-a287-47da-ac9a-a0d74eb6100c" returned: 0 in 0.795s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6e3e12a7-cc11-4488-b644-e0e441f2abff tempest-GroupSnapshotsTest-551234149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8d88a84b-bd81-4198-b719-45d87470ecee.988df983-a287-47da-ac9a-a0d74eb6100c {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:55 devstack sudo[100599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8d88a84b-bd81-4198-b719-45d87470ecee.988df983-a287-47da-ac9a-a0d74eb6100c Sep 23 00:24:55 devstack sudo[100599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:56 devstack sudo[100599]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6e3e12a7-cc11-4488-b644-e0e441f2abff tempest-GroupSnapshotsTest-551234149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8d88a84b-bd81-4198-b719-45d87470ecee.988df983-a287-47da-ac9a-a0d74eb6100c" returned: 0 in 0.433s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:56 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6e3e12a7-cc11-4488-b644-e0e441f2abff tempest-GroupSnapshotsTest-551234149 None] Lock "cinder-quobyte-988df983-a287-47da-ac9a-a0d74eb6100c" released by "_delete_snapshot" :: held 3.140s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:56 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6e3e12a7-cc11-4488-b644-e0e441f2abff tempest-GroupSnapshotsTest-551234149 None] Lock "cinder-quobyte-8d88a84b-bd81-4198-b719-45d87470ecee" released by "delete_snapshot" :: held 3.185s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:56 devstack cinder-volume[86591]: WARNING cinder.quota [None req-6e3e12a7-cc11-4488-b644-e0e441f2abff tempest-GroupSnapshotsTest-551234149 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-372803345 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-372803345, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:24:56 devstack cinder-volume[86591]: WARNING cinder.quota [None req-6e3e12a7-cc11-4488-b644-e0e441f2abff tempest-GroupSnapshotsTest-551234149 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-372803345 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-372803345, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:24:56 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-6e3e12a7-cc11-4488-b644-e0e441f2abff tempest-GroupSnapshotsTest-551234149 None] Created reservations ['6b77cf39-1918-4edc-ae9a-d6e2f622bac8', 'd8dc8a94-7382-41ae-87df-edb087821e12', 'e5c29137-107f-45b8-9a4b-d6a8a2e6bd70', '0937fcd5-9142-40eb-a2df-a0eab6cdf65b'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:24:56 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-6e3e12a7-cc11-4488-b644-e0e441f2abff tempest-GroupSnapshotsTest-551234149 None] Created reservations ['a96ee9d8-c6ac-4bee-967e-273bafe62a38', 'cffebc6b-e8db-4093-984c-6253d08fc6e6', 'e6eff44f-2cda-4213-bf1b-836e7321e1b5', '9b60c4a8-2d94-4b20-8b08-4747d56811e0'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:24:56 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-6e3e12a7-cc11-4488-b644-e0e441f2abff tempest-GroupSnapshotsTest-551234149 None] group_snapshot 3471567a-74c6-44b1-bbd6-a668b3e8d1bf: deleted successfully Sep 23 00:24:58 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-58696ce7-3333-4c55-9fd0-003dd97c11de tempest-GroupSnapshotsTest-551234149 None] Acquiring lock "cinder-quobyte-434b0146-59d8-4883-8b4b-742aceebf230" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:58 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-58696ce7-3333-4c55-9fd0-003dd97c11de tempest-GroupSnapshotsTest-551234149 None] Lock "cinder-quobyte-434b0146-59d8-4883-8b4b-742aceebf230" acquired by "delete_volume" :: waited 0.027s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:58 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2454854-2b6a-4ca0-9c33-37840debcfdc]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-58696ce7-3333-4c55-9fd0-003dd97c11de tempest-GroupSnapshotsTest-551234149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-434b0146-59d8-4883-8b4b-742aceebf230 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:58 devstack sudo[100609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-434b0146-59d8-4883-8b4b-742aceebf230 Sep 23 00:24:58 devstack sudo[100609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:58 devstack sudo[100609]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-58696ce7-3333-4c55-9fd0-003dd97c11de tempest-GroupSnapshotsTest-551234149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-434b0146-59d8-4883-8b4b-742aceebf230" returned: 0 in 0.796s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-58696ce7-3333-4c55-9fd0-003dd97c11de tempest-GroupSnapshotsTest-551234149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-434b0146-59d8-4883-8b4b-742aceebf230 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:59 devstack sudo[100616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-434b0146-59d8-4883-8b4b-742aceebf230 Sep 23 00:24:59 devstack sudo[100616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:59 devstack sudo[100616]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-58696ce7-3333-4c55-9fd0-003dd97c11de tempest-GroupSnapshotsTest-551234149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-434b0146-59d8-4883-8b4b-742aceebf230" returned: 0 in 0.515s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:59 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-58696ce7-3333-4c55-9fd0-003dd97c11de tempest-GroupSnapshotsTest-551234149 None] Lock "cinder-quobyte-434b0146-59d8-4883-8b4b-742aceebf230" released by "delete_volume" :: held 1.469s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:59 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-58696ce7-3333-4c55-9fd0-003dd97c11de tempest-GroupSnapshotsTest-551234149 None] Acquiring lock "cinder-quobyte-8d88a84b-bd81-4198-b719-45d87470ecee" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:59 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-58696ce7-3333-4c55-9fd0-003dd97c11de tempest-GroupSnapshotsTest-551234149 None] Lock "cinder-quobyte-8d88a84b-bd81-4198-b719-45d87470ecee" acquired by "delete_volume" :: waited 0.041s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:59 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[1178c2f5-9fdc-4d45-9a0d-80c26dbbb9b8]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-58696ce7-3333-4c55-9fd0-003dd97c11de tempest-GroupSnapshotsTest-551234149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8d88a84b-bd81-4198-b719-45d87470ecee {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:59 devstack sudo[100620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8d88a84b-bd81-4198-b719-45d87470ecee Sep 23 00:24:59 devstack sudo[100620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:00 devstack sudo[100620]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-58696ce7-3333-4c55-9fd0-003dd97c11de tempest-GroupSnapshotsTest-551234149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8d88a84b-bd81-4198-b719-45d87470ecee" returned: 0 in 0.608s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-58696ce7-3333-4c55-9fd0-003dd97c11de tempest-GroupSnapshotsTest-551234149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8d88a84b-bd81-4198-b719-45d87470ecee {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:00 devstack sudo[100625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8d88a84b-bd81-4198-b719-45d87470ecee Sep 23 00:25:00 devstack sudo[100625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:00 devstack sudo[100625]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-58696ce7-3333-4c55-9fd0-003dd97c11de tempest-GroupSnapshotsTest-551234149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8d88a84b-bd81-4198-b719-45d87470ecee" returned: 0 in 0.415s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:00 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-58696ce7-3333-4c55-9fd0-003dd97c11de tempest-GroupSnapshotsTest-551234149 None] Lock "cinder-quobyte-8d88a84b-bd81-4198-b719-45d87470ecee" released by "delete_volume" :: held 1.179s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:00 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-58696ce7-3333-4c55-9fd0-003dd97c11de tempest-GroupSnapshotsTest-551234149 None] Created reservations ['f293a661-c45d-4b26-9de2-de5d1811a1bf'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:25:01 devstack cinder-volume[86591]: WARNING cinder.quota [None req-58696ce7-3333-4c55-9fd0-003dd97c11de tempest-GroupSnapshotsTest-551234149 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-372803345 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-372803345, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:25:01 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-58696ce7-3333-4c55-9fd0-003dd97c11de tempest-GroupSnapshotsTest-551234149 None] Created reservations ['ebd31a9e-cc5d-43fa-ab1d-0d26b21a2ca5', 'db74cbf8-a5da-4bd3-9240-01ae89ee9321', 'ff04aa8a-de51-49fe-92e9-6216320f05cb', '3f06be4d-4145-4c98-8ee6-d89700671813'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:25:01 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-58696ce7-3333-4c55-9fd0-003dd97c11de tempest-GroupSnapshotsTest-551234149 None] Created reservations ['e277a405-afc7-4ea4-8ae9-1e782527bd13', '628da3b2-8510-418b-9b8e-1bf5626c3225', '34d7f21d-2d17-4b6c-8ca5-0519461d1f70', '81483353-a0ff-4697-95b6-5bff03fe3419'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:25:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-58696ce7-3333-4c55-9fd0-003dd97c11de tempest-GroupSnapshotsTest-551234149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-58696ce7-3333-4c55-9fd0-003dd97c11de tempest-GroupSnapshotsTest-551234149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-58696ce7-3333-4c55-9fd0-003dd97c11de tempest-GroupSnapshotsTest-551234149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-58696ce7-3333-4c55-9fd0-003dd97c11de tempest-GroupSnapshotsTest-551234149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-58696ce7-3333-4c55-9fd0-003dd97c11de tempest-GroupSnapshotsTest-551234149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-58696ce7-3333-4c55-9fd0-003dd97c11de tempest-GroupSnapshotsTest-551234149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:01 devstack sudo[100628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:25:01 devstack sudo[100628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:02 devstack sudo[100628]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-58696ce7-3333-4c55-9fd0-003dd97c11de tempest-GroupSnapshotsTest-551234149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.575s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:02 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-58696ce7-3333-4c55-9fd0-003dd97c11de tempest-GroupSnapshotsTest-551234149 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:25:02 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-58696ce7-3333-4c55-9fd0-003dd97c11de tempest-GroupSnapshotsTest-551234149 None] Delete group completed successfully. Sep 23 00:25:03 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-5d5c8570-8954-49f6-8107-77451ef4f9d2 tempest-GroupSnapshotsTest-551234149 None] Group tempest-GroupSnapshotsTest-Group-1480214974: creating Sep 23 00:25:03 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-5d5c8570-8954-49f6-8107-77451ef4f9d2 tempest-GroupSnapshotsTest-551234149 None] Group tempest-GroupSnapshotsTest-Group-1480214974: created successfully Sep 23 00:25:03 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-5d5c8570-8954-49f6-8107-77451ef4f9d2 tempest-GroupSnapshotsTest-551234149 None] Create group completed successfully. Sep 23 00:25:05 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-9586df55-0127-4b70-9c19-33c8c80eef8f tempest-GroupSnapshotsTest-551234149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:25:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9586df55-0127-4b70-9c19-33c8c80eef8f tempest-GroupSnapshotsTest-551234149 None] Flow 'volume_create_manager' (2dfbdce4-1418-4af6-bd97-6c7935fa9285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9586df55-0127-4b70-9c19-33c8c80eef8f tempest-GroupSnapshotsTest-551234149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0733742d-c68f-40ba-b67b-209b42297493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9586df55-0127-4b70-9c19-33c8c80eef8f tempest-GroupSnapshotsTest-551234149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0733742d-c68f-40ba-b67b-209b42297493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-825491606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=13129679-ac47-45f6-9124-84111e7cd1e1,host='devstack@QuobyteHD#QuobyteHD',id=085ffd91-957d-41a2-9aec-691bb420d4d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30618508f4cf422c8e7adfbbbdc767cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:06Z,use_quota=True,user_id='b87bbe3221254f829469d272c67c983a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af429e92-ce58-4b1d-b9da-cf4b6ea4e292),volume_type_id=af429e92-ce58-4b1d-b9da-cf4b6ea4e292)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9586df55-0127-4b70-9c19-33c8c80eef8f tempest-GroupSnapshotsTest-551234149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb8cd235-dbda-498b-9ae8-2ee04c52708c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9586df55-0127-4b70-9c19-33c8c80eef8f tempest-GroupSnapshotsTest-551234149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb8cd235-dbda-498b-9ae8-2ee04c52708c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9586df55-0127-4b70-9c19-33c8c80eef8f tempest-GroupSnapshotsTest-551234149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aeb1321-525a-4ed6-94d3-1b1758d4ec9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9586df55-0127-4b70-9c19-33c8c80eef8f tempest-GroupSnapshotsTest-551234149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aeb1321-525a-4ed6-94d3-1b1758d4ec9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '085ffd91-957d-41a2-9aec-691bb420d4d9', 'volume_name': 'volume-085ffd91-957d-41a2-9aec-691bb420d4d9', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9586df55-0127-4b70-9c19-33c8c80eef8f tempest-GroupSnapshotsTest-551234149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9db6eebb-4193-4718-bda9-d47aedecfc95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9586df55-0127-4b70-9c19-33c8c80eef8f tempest-GroupSnapshotsTest-551234149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9db6eebb-4193-4718-bda9-d47aedecfc95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9586df55-0127-4b70-9c19-33c8c80eef8f tempest-GroupSnapshotsTest-551234149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b22ca8b-3ae1-47ba-91b2-1a454c86b036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:06 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-9586df55-0127-4b70-9c19-33c8c80eef8f tempest-GroupSnapshotsTest-551234149 None] Volume 085ffd91-957d-41a2-9aec-691bb420d4d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-085ffd91-957d-41a2-9aec-691bb420d4d9', 'volume_size': 1} Sep 23 00:25:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9586df55-0127-4b70-9c19-33c8c80eef8f tempest-GroupSnapshotsTest-551234149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9586df55-0127-4b70-9c19-33c8c80eef8f tempest-GroupSnapshotsTest-551234149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9586df55-0127-4b70-9c19-33c8c80eef8f tempest-GroupSnapshotsTest-551234149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=13129679-ac47-45f6-9124-84111e7cd1e1,created_at=2026-09-22T22:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-825491606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=13129679-ac47-45f6-9124-84111e7cd1e1,host='devstack@QuobyteHD#QuobyteHD',id=085ffd91-957d-41a2-9aec-691bb420d4d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30618508f4cf422c8e7adfbbbdc767cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:06Z,use_quota=True,user_id='b87bbe3221254f829469d272c67c983a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af429e92-ce58-4b1d-b9da-cf4b6ea4e292),volume_type_id=af429e92-ce58-4b1d-b9da-cf4b6ea4e292)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:25:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-9586df55-0127-4b70-9c19-33c8c80eef8f tempest-GroupSnapshotsTest-551234149 None] Creating volume 085ffd91-957d-41a2-9aec-691bb420d4d9 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:25:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9586df55-0127-4b70-9c19-33c8c80eef8f tempest-GroupSnapshotsTest-551234149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9586df55-0127-4b70-9c19-33c8c80eef8f tempest-GroupSnapshotsTest-551234149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9586df55-0127-4b70-9c19-33c8c80eef8f tempest-GroupSnapshotsTest-551234149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9586df55-0127-4b70-9c19-33c8c80eef8f tempest-GroupSnapshotsTest-551234149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9586df55-0127-4b70-9c19-33c8c80eef8f tempest-GroupSnapshotsTest-551234149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9586df55-0127-4b70-9c19-33c8c80eef8f tempest-GroupSnapshotsTest-551234149 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:25:06 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-9586df55-0127-4b70-9c19-33c8c80eef8f tempest-GroupSnapshotsTest-551234149 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:25:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9586df55-0127-4b70-9c19-33c8c80eef8f tempest-GroupSnapshotsTest-551234149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-085ffd91-957d-41a2-9aec-691bb420d4d9 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:06 devstack sudo[101194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-085ffd91-957d-41a2-9aec-691bb420d4d9 1073741824 Sep 23 00:25:06 devstack sudo[101194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:07 devstack sudo[101194]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9586df55-0127-4b70-9c19-33c8c80eef8f tempest-GroupSnapshotsTest-551234149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-085ffd91-957d-41a2-9aec-691bb420d4d9 1073741824" returned: 0 in 0.971s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9586df55-0127-4b70-9c19-33c8c80eef8f tempest-GroupSnapshotsTest-551234149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-085ffd91-957d-41a2-9aec-691bb420d4d9 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:07 devstack sudo[101204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-085ffd91-957d-41a2-9aec-691bb420d4d9 Sep 23 00:25:07 devstack sudo[101204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:07 devstack sudo[101204]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9586df55-0127-4b70-9c19-33c8c80eef8f tempest-GroupSnapshotsTest-551234149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-085ffd91-957d-41a2-9aec-691bb420d4d9" returned: 0 in 0.477s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:07 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9586df55-0127-4b70-9c19-33c8c80eef8f tempest-GroupSnapshotsTest-551234149 None] <== create_volume: return (1591ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:25:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9586df55-0127-4b70-9c19-33c8c80eef8f tempest-GroupSnapshotsTest-551234149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.599s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9586df55-0127-4b70-9c19-33c8c80eef8f tempest-GroupSnapshotsTest-551234149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b22ca8b-3ae1-47ba-91b2-1a454c86b036) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-085ffd91-957d-41a2-9aec-691bb420d4d9', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9586df55-0127-4b70-9c19-33c8c80eef8f tempest-GroupSnapshotsTest-551234149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3bc57e0-3a11-465b-ab24-11a838700555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:07 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-9586df55-0127-4b70-9c19-33c8c80eef8f tempest-GroupSnapshotsTest-551234149 None] Volume volume-085ffd91-957d-41a2-9aec-691bb420d4d9 (085ffd91-957d-41a2-9aec-691bb420d4d9): created successfully Sep 23 00:25:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9586df55-0127-4b70-9c19-33c8c80eef8f tempest-GroupSnapshotsTest-551234149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3bc57e0-3a11-465b-ab24-11a838700555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9586df55-0127-4b70-9c19-33c8c80eef8f tempest-GroupSnapshotsTest-551234149 None] Flow 'volume_create_manager' (2dfbdce4-1418-4af6-bd97-6c7935fa9285) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:07 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-9586df55-0127-4b70-9c19-33c8c80eef8f tempest-GroupSnapshotsTest-551234149 None] Created volume successfully. Sep 23 00:25:09 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-4b787d1c-e112-40f3-b484-a37650b00b79 tempest-GroupSnapshotsTest-551234149 None] GroupSnapshot a06463d3-fdf0-4913-a484-f1fb12a52fd9: creating. Sep 23 00:25:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4b787d1c-e112-40f3-b484-a37650b00b79 tempest-GroupSnapshotsTest-551234149 None] Group snapshot a06463d3-fdf0-4913-a484-f1fb12a52fd9: creating. {{(pid=86591) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 23 00:25:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4b787d1c-e112-40f3-b484-a37650b00b79 tempest-GroupSnapshotsTest-551234149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4b787d1c-e112-40f3-b484-a37650b00b79 tempest-GroupSnapshotsTest-551234149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:09 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-4b787d1c-e112-40f3-b484-a37650b00b79 tempest-GroupSnapshotsTest-551234149 None] Creating offline snapshot 519ed94c-29ec-4e5d-8326-5e8026f5604a of volume 085ffd91-957d-41a2-9aec-691bb420d4d9 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:25:09 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8bc7c6-d9c7-4698-b85f-dc7ce1cd835c]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4b787d1c-e112-40f3-b484-a37650b00b79 tempest-GroupSnapshotsTest-551234149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-085ffd91-957d-41a2-9aec-691bb420d4d9 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:09 devstack sudo[101207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-085ffd91-957d-41a2-9aec-691bb420d4d9 Sep 23 00:25:09 devstack sudo[101207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:09 devstack sudo[101207]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4b787d1c-e112-40f3-b484-a37650b00b79 tempest-GroupSnapshotsTest-551234149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-085ffd91-957d-41a2-9aec-691bb420d4d9" returned: 0 in 0.702s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4b787d1c-e112-40f3-b484-a37650b00b79 tempest-GroupSnapshotsTest-551234149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-085ffd91-957d-41a2-9aec-691bb420d4d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-085ffd91-957d-41a2-9aec-691bb420d4d9.519ed94c-29ec-4e5d-8326-5e8026f5604a 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:10 devstack sudo[101212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-085ffd91-957d-41a2-9aec-691bb420d4d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-085ffd91-957d-41a2-9aec-691bb420d4d9.519ed94c-29ec-4e5d-8326-5e8026f5604a 1G Sep 23 00:25:10 devstack sudo[101212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:10 devstack sudo[101212]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4b787d1c-e112-40f3-b484-a37650b00b79 tempest-GroupSnapshotsTest-551234149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-085ffd91-957d-41a2-9aec-691bb420d4d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-085ffd91-957d-41a2-9aec-691bb420d4d9.519ed94c-29ec-4e5d-8326-5e8026f5604a 1G" returned: 0 in 0.650s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4b787d1c-e112-40f3-b484-a37650b00b79 tempest-GroupSnapshotsTest-551234149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-085ffd91-957d-41a2-9aec-691bb420d4d9 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-085ffd91-957d-41a2-9aec-691bb420d4d9.519ed94c-29ec-4e5d-8326-5e8026f5604a {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:10 devstack sudo[101224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-085ffd91-957d-41a2-9aec-691bb420d4d9 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-085ffd91-957d-41a2-9aec-691bb420d4d9.519ed94c-29ec-4e5d-8326-5e8026f5604a Sep 23 00:25:10 devstack sudo[101224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:11 devstack sudo[101224]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4b787d1c-e112-40f3-b484-a37650b00b79 tempest-GroupSnapshotsTest-551234149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-085ffd91-957d-41a2-9aec-691bb420d4d9 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-085ffd91-957d-41a2-9aec-691bb420d4d9.519ed94c-29ec-4e5d-8326-5e8026f5604a" returned: 0 in 0.425s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:11 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-4b787d1c-e112-40f3-b484-a37650b00b79 tempest-GroupSnapshotsTest-551234149 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-085ffd91-957d-41a2-9aec-691bb420d4d9.519ed94c-29ec-4e5d-8326-5e8026f5604a is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:25:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4b787d1c-e112-40f3-b484-a37650b00b79 tempest-GroupSnapshotsTest-551234149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-085ffd91-957d-41a2-9aec-691bb420d4d9.519ed94c-29ec-4e5d-8326-5e8026f5604a {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:11 devstack sudo[101230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-085ffd91-957d-41a2-9aec-691bb420d4d9.519ed94c-29ec-4e5d-8326-5e8026f5604a Sep 23 00:25:11 devstack sudo[101230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:11 devstack sudo[101230]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4b787d1c-e112-40f3-b484-a37650b00b79 tempest-GroupSnapshotsTest-551234149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-085ffd91-957d-41a2-9aec-691bb420d4d9.519ed94c-29ec-4e5d-8326-5e8026f5604a" returned: 0 in 0.354s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4b787d1c-e112-40f3-b484-a37650b00b79 tempest-GroupSnapshotsTest-551234149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-085ffd91-957d-41a2-9aec-691bb420d4d9.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:11 devstack sudo[101233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-085ffd91-957d-41a2-9aec-691bb420d4d9.info Sep 23 00:25:11 devstack sudo[101233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:11 devstack sudo[101233]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4b787d1c-e112-40f3-b484-a37650b00b79 tempest-GroupSnapshotsTest-551234149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-085ffd91-957d-41a2-9aec-691bb420d4d9.info" returned: 0 in 0.443s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:11 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-4b787d1c-e112-40f3-b484-a37650b00b79 tempest-GroupSnapshotsTest-551234149 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-085ffd91-957d-41a2-9aec-691bb420d4d9.info is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:25:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4b787d1c-e112-40f3-b484-a37650b00b79 tempest-GroupSnapshotsTest-551234149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-085ffd91-957d-41a2-9aec-691bb420d4d9.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:11 devstack sudo[101236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-085ffd91-957d-41a2-9aec-691bb420d4d9.info Sep 23 00:25:11 devstack sudo[101236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:12 devstack sudo[101236]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4b787d1c-e112-40f3-b484-a37650b00b79 tempest-GroupSnapshotsTest-551234149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-085ffd91-957d-41a2-9aec-691bb420d4d9.info" returned: 0 in 0.417s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4b787d1c-e112-40f3-b484-a37650b00b79 tempest-GroupSnapshotsTest-551234149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.156s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:12 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=123,cinder:UPDATE=106,cinder:INSERT=32,cinder:DELETE=4 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:25:12 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:UPDATE=125,cinder:INSERT=24,cinder:SELECT=104,cinder:DELETE=4 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:25:12 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-4b787d1c-e112-40f3-b484-a37650b00b79 tempest-GroupSnapshotsTest-551234149 None] group_snapshot a06463d3-fdf0-4913-a484-f1fb12a52fd9: created successfully Sep 23 00:25:14 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-91e3dcc1-dfad-41fa-ad66-ab8b3cb41e93 tempest-GroupSnapshotsTest-551234149 None] group_snapshot a06463d3-fdf0-4913-a484-f1fb12a52fd9: deleting Sep 23 00:25:14 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-91e3dcc1-dfad-41fa-ad66-ab8b3cb41e93 tempest-GroupSnapshotsTest-551234149 None] group_snapshot a06463d3-fdf0-4913-a484-f1fb12a52fd9: deleting {{(pid=86591) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 23 00:25:14 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-91e3dcc1-dfad-41fa-ad66-ab8b3cb41e93 tempest-GroupSnapshotsTest-551234149 None] Acquiring lock "cinder-quobyte-085ffd91-957d-41a2-9aec-691bb420d4d9" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:14 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-91e3dcc1-dfad-41fa-ad66-ab8b3cb41e93 tempest-GroupSnapshotsTest-551234149 None] Lock "cinder-quobyte-085ffd91-957d-41a2-9aec-691bb420d4d9" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:14 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-91e3dcc1-dfad-41fa-ad66-ab8b3cb41e93 tempest-GroupSnapshotsTest-551234149 None] Acquiring lock "cinder-quobyte-519ed94c-29ec-4e5d-8326-5e8026f5604a" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:14 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-91e3dcc1-dfad-41fa-ad66-ab8b3cb41e93 tempest-GroupSnapshotsTest-551234149 None] Lock "cinder-quobyte-519ed94c-29ec-4e5d-8326-5e8026f5604a" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:14 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-91e3dcc1-dfad-41fa-ad66-ab8b3cb41e93 tempest-GroupSnapshotsTest-551234149 None] Deleting offline snapshot 519ed94c-29ec-4e5d-8326-5e8026f5604a of volume 085ffd91-957d-41a2-9aec-691bb420d4d9 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:25:14 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-91e3dcc1-dfad-41fa-ad66-ab8b3cb41e93 tempest-GroupSnapshotsTest-551234149 None] snapshot_file for this snap is: volume-085ffd91-957d-41a2-9aec-691bb420d4d9.519ed94c-29ec-4e5d-8326-5e8026f5604a {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:25:14 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[66688db8-f2b3-430d-a521-41298e0d3ec3]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-91e3dcc1-dfad-41fa-ad66-ab8b3cb41e93 tempest-GroupSnapshotsTest-551234149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-085ffd91-957d-41a2-9aec-691bb420d4d9.519ed94c-29ec-4e5d-8326-5e8026f5604a {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:14 devstack sudo[101385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-085ffd91-957d-41a2-9aec-691bb420d4d9.519ed94c-29ec-4e5d-8326-5e8026f5604a Sep 23 00:25:14 devstack sudo[101385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:14 devstack sudo[101385]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-91e3dcc1-dfad-41fa-ad66-ab8b3cb41e93 tempest-GroupSnapshotsTest-551234149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-085ffd91-957d-41a2-9aec-691bb420d4d9.519ed94c-29ec-4e5d-8326-5e8026f5604a" returned: 0 in 0.521s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:14 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-91e3dcc1-dfad-41fa-ad66-ab8b3cb41e93 tempest-GroupSnapshotsTest-551234149 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-085ffd91-957d-41a2-9aec-691bb420d4d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:25:14 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ed0495-5d1a-4910-b54d-87ecc444730b]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-91e3dcc1-dfad-41fa-ad66-ab8b3cb41e93 tempest-GroupSnapshotsTest-551234149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-085ffd91-957d-41a2-9aec-691bb420d4d9 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:15 devstack sudo[101390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-085ffd91-957d-41a2-9aec-691bb420d4d9 Sep 23 00:25:15 devstack sudo[101390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:15 devstack sudo[101390]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-91e3dcc1-dfad-41fa-ad66-ab8b3cb41e93 tempest-GroupSnapshotsTest-551234149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-085ffd91-957d-41a2-9aec-691bb420d4d9" returned: 0 in 0.614s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-91e3dcc1-dfad-41fa-ad66-ab8b3cb41e93 tempest-GroupSnapshotsTest-551234149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-085ffd91-957d-41a2-9aec-691bb420d4d9.519ed94c-29ec-4e5d-8326-5e8026f5604a {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:15 devstack sudo[101408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-085ffd91-957d-41a2-9aec-691bb420d4d9.519ed94c-29ec-4e5d-8326-5e8026f5604a Sep 23 00:25:15 devstack sudo[101408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:16 devstack sudo[101408]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-91e3dcc1-dfad-41fa-ad66-ab8b3cb41e93 tempest-GroupSnapshotsTest-551234149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-085ffd91-957d-41a2-9aec-691bb420d4d9.519ed94c-29ec-4e5d-8326-5e8026f5604a" returned: 0 in 0.660s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-91e3dcc1-dfad-41fa-ad66-ab8b3cb41e93 tempest-GroupSnapshotsTest-551234149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-085ffd91-957d-41a2-9aec-691bb420d4d9.519ed94c-29ec-4e5d-8326-5e8026f5604a {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:16 devstack sudo[101415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-085ffd91-957d-41a2-9aec-691bb420d4d9.519ed94c-29ec-4e5d-8326-5e8026f5604a Sep 23 00:25:16 devstack sudo[101415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:16 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:25:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:16 devstack sudo[101415]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-91e3dcc1-dfad-41fa-ad66-ab8b3cb41e93 tempest-GroupSnapshotsTest-551234149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-085ffd91-957d-41a2-9aec-691bb420d4d9.519ed94c-29ec-4e5d-8326-5e8026f5604a" returned: 0 in 0.459s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:16 devstack sudo[101418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:25:16 devstack sudo[101418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:16 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-91e3dcc1-dfad-41fa-ad66-ab8b3cb41e93 tempest-GroupSnapshotsTest-551234149 None] Lock "cinder-quobyte-519ed94c-29ec-4e5d-8326-5e8026f5604a" released by "_delete_snapshot" :: held 2.490s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:16 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-91e3dcc1-dfad-41fa-ad66-ab8b3cb41e93 tempest-GroupSnapshotsTest-551234149 None] Lock "cinder-quobyte-085ffd91-957d-41a2-9aec-691bb420d4d9" released by "delete_snapshot" :: held 2.530s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:16 devstack cinder-volume[86591]: WARNING cinder.quota [None req-91e3dcc1-dfad-41fa-ad66-ab8b3cb41e93 tempest-GroupSnapshotsTest-551234149 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-192342717 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-192342717, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:25:16 devstack cinder-volume[86591]: WARNING cinder.quota [None req-91e3dcc1-dfad-41fa-ad66-ab8b3cb41e93 tempest-GroupSnapshotsTest-551234149 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-192342717 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-192342717, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:25:16 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-91e3dcc1-dfad-41fa-ad66-ab8b3cb41e93 tempest-GroupSnapshotsTest-551234149 None] Created reservations ['dd3fafed-f891-4203-8bfd-daae0f5158a7', 'fd651067-1421-4437-8d85-c81a247843c9', 'a0b0c8b1-8918-4c65-884c-c3e60085055e', '785ede86-7eee-43e6-a532-a07563d1d17c'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:25:17 devstack sudo[101418]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.390s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:17 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:25:17 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running periodic task VolumeManager._thread_info {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:25:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] thread count: 29 {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:25:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] thread info: [<_MainThread(MainThread, started 135440660459648)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:25:17 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-91e3dcc1-dfad-41fa-ad66-ab8b3cb41e93 tempest-GroupSnapshotsTest-551234149 None] group_snapshot a06463d3-fdf0-4913-a484-f1fb12a52fd9: deleted successfully Sep 23 00:25:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-56b3af3d-77d2-48b5-97a1-25209aa01cf4 tempest-GroupSnapshotsTest-551234149 None] Acquiring lock "cinder-quobyte-085ffd91-957d-41a2-9aec-691bb420d4d9" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-56b3af3d-77d2-48b5-97a1-25209aa01cf4 tempest-GroupSnapshotsTest-551234149 None] Lock "cinder-quobyte-085ffd91-957d-41a2-9aec-691bb420d4d9" acquired by "delete_volume" :: waited 0.029s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:18 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a602c27-7ced-461f-ae52-a4a8e2a743b4]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-56b3af3d-77d2-48b5-97a1-25209aa01cf4 tempest-GroupSnapshotsTest-551234149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-085ffd91-957d-41a2-9aec-691bb420d4d9 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:18 devstack sudo[101422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-085ffd91-957d-41a2-9aec-691bb420d4d9 Sep 23 00:25:18 devstack sudo[101422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:18 devstack sudo[101422]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-56b3af3d-77d2-48b5-97a1-25209aa01cf4 tempest-GroupSnapshotsTest-551234149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-085ffd91-957d-41a2-9aec-691bb420d4d9" returned: 0 in 0.513s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-56b3af3d-77d2-48b5-97a1-25209aa01cf4 tempest-GroupSnapshotsTest-551234149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-085ffd91-957d-41a2-9aec-691bb420d4d9 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:18 devstack sudo[101427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-085ffd91-957d-41a2-9aec-691bb420d4d9 Sep 23 00:25:18 devstack sudo[101427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:19 devstack sudo[101427]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-56b3af3d-77d2-48b5-97a1-25209aa01cf4 tempest-GroupSnapshotsTest-551234149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-085ffd91-957d-41a2-9aec-691bb420d4d9" returned: 0 in 0.280s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-56b3af3d-77d2-48b5-97a1-25209aa01cf4 tempest-GroupSnapshotsTest-551234149 None] Lock "cinder-quobyte-085ffd91-957d-41a2-9aec-691bb420d4d9" released by "delete_volume" :: held 0.921s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:19 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-56b3af3d-77d2-48b5-97a1-25209aa01cf4 tempest-GroupSnapshotsTest-551234149 None] Created reservations ['7c0631a3-d235-42ac-9df8-cc0327308f54'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:25:19 devstack cinder-volume[86591]: WARNING cinder.quota [None req-56b3af3d-77d2-48b5-97a1-25209aa01cf4 tempest-GroupSnapshotsTest-551234149 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-192342717 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-192342717, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:25:19 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-56b3af3d-77d2-48b5-97a1-25209aa01cf4 tempest-GroupSnapshotsTest-551234149 None] Created reservations ['d5503387-4fb3-41ff-b552-16340ce2c756', '074c359a-ea75-4aef-ae07-9debcd3e6f63', '8e9e5e8d-21a4-4b5a-af22-d81dfed7a9be', 'd2e9bc4f-4cad-4955-93d9-fe2f820de4e1'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:25:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-56b3af3d-77d2-48b5-97a1-25209aa01cf4 tempest-GroupSnapshotsTest-551234149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-56b3af3d-77d2-48b5-97a1-25209aa01cf4 tempest-GroupSnapshotsTest-551234149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:19 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-56b3af3d-77d2-48b5-97a1-25209aa01cf4 tempest-GroupSnapshotsTest-551234149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:19 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-56b3af3d-77d2-48b5-97a1-25209aa01cf4 tempest-GroupSnapshotsTest-551234149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-56b3af3d-77d2-48b5-97a1-25209aa01cf4 tempest-GroupSnapshotsTest-551234149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-56b3af3d-77d2-48b5-97a1-25209aa01cf4 tempest-GroupSnapshotsTest-551234149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:19 devstack sudo[101430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:25:19 devstack sudo[101430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:19 devstack sudo[101430]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-56b3af3d-77d2-48b5-97a1-25209aa01cf4 tempest-GroupSnapshotsTest-551234149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.312s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:19 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-56b3af3d-77d2-48b5-97a1-25209aa01cf4 tempest-GroupSnapshotsTest-551234149 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:25:19 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-56b3af3d-77d2-48b5-97a1-25209aa01cf4 tempest-GroupSnapshotsTest-551234149 None] Delete group completed successfully. Sep 23 00:25:24 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fba403d-0d6c-406a-b993-24499d6972a5 tempest-SnapshotDependencyTests-39572979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:25:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2fba403d-0d6c-406a-b993-24499d6972a5 tempest-SnapshotDependencyTests-39572979 None] Flow 'volume_create_manager' (cab6450f-b2d7-4f09-9061-952dbeb1e407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2fba403d-0d6c-406a-b993-24499d6972a5 tempest-SnapshotDependencyTests-39572979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (940be813-ae49-4f35-9130-e323f0b1a624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2fba403d-0d6c-406a-b993-24499d6972a5 tempest-SnapshotDependencyTests-39572979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (940be813-ae49-4f35-9130-e323f0b1a624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-244248568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='689f032211db4bc4bb87dc2620327d4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:24Z,use_quota=True,user_id='237a59c99faf4ff1b00fe83f71700ea3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2fba403d-0d6c-406a-b993-24499d6972a5 tempest-SnapshotDependencyTests-39572979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76c3bd6c-505e-4aa1-9674-293a619a5a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2fba403d-0d6c-406a-b993-24499d6972a5 tempest-SnapshotDependencyTests-39572979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76c3bd6c-505e-4aa1-9674-293a619a5a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2fba403d-0d6c-406a-b993-24499d6972a5 tempest-SnapshotDependencyTests-39572979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03140bae-693d-4883-9aed-ec38f84c4b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2fba403d-0d6c-406a-b993-24499d6972a5 tempest-SnapshotDependencyTests-39572979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03140bae-693d-4883-9aed-ec38f84c4b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a', 'volume_name': 'volume-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2fba403d-0d6c-406a-b993-24499d6972a5 tempest-SnapshotDependencyTests-39572979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34e1cca4-a5d5-4126-8fb0-7c5596915848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2fba403d-0d6c-406a-b993-24499d6972a5 tempest-SnapshotDependencyTests-39572979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34e1cca4-a5d5-4126-8fb0-7c5596915848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2fba403d-0d6c-406a-b993-24499d6972a5 tempest-SnapshotDependencyTests-39572979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fada5ca-c096-4c3e-94dd-b739d4eca061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:24 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-2fba403d-0d6c-406a-b993-24499d6972a5 tempest-SnapshotDependencyTests-39572979 None] Volume 8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a', 'volume_size': 1} Sep 23 00:25:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2fba403d-0d6c-406a-b993-24499d6972a5 tempest-SnapshotDependencyTests-39572979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2fba403d-0d6c-406a-b993-24499d6972a5 tempest-SnapshotDependencyTests-39572979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:24 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2fba403d-0d6c-406a-b993-24499d6972a5 tempest-SnapshotDependencyTests-39572979 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-244248568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='689f032211db4bc4bb87dc2620327d4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:24Z,use_quota=True,user_id='237a59c99faf4ff1b00fe83f71700ea3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:25:24 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-2fba403d-0d6c-406a-b993-24499d6972a5 tempest-SnapshotDependencyTests-39572979 None] Creating volume 8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:25:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2fba403d-0d6c-406a-b993-24499d6972a5 tempest-SnapshotDependencyTests-39572979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2fba403d-0d6c-406a-b993-24499d6972a5 tempest-SnapshotDependencyTests-39572979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:24 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2fba403d-0d6c-406a-b993-24499d6972a5 tempest-SnapshotDependencyTests-39572979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:24 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2fba403d-0d6c-406a-b993-24499d6972a5 tempest-SnapshotDependencyTests-39572979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2fba403d-0d6c-406a-b993-24499d6972a5 tempest-SnapshotDependencyTests-39572979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:24 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2fba403d-0d6c-406a-b993-24499d6972a5 tempest-SnapshotDependencyTests-39572979 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:25:24 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-2fba403d-0d6c-406a-b993-24499d6972a5 tempest-SnapshotDependencyTests-39572979 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:25:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2fba403d-0d6c-406a-b993-24499d6972a5 tempest-SnapshotDependencyTests-39572979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:24 devstack sudo[101433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a 1073741824 Sep 23 00:25:24 devstack sudo[101433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:25 devstack sudo[101433]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2fba403d-0d6c-406a-b993-24499d6972a5 tempest-SnapshotDependencyTests-39572979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a 1073741824" returned: 0 in 0.717s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2fba403d-0d6c-406a-b993-24499d6972a5 tempest-SnapshotDependencyTests-39572979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:25 devstack sudo[101439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a Sep 23 00:25:25 devstack sudo[101439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:25 devstack sudo[101439]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2fba403d-0d6c-406a-b993-24499d6972a5 tempest-SnapshotDependencyTests-39572979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a" returned: 0 in 0.555s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:25 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2fba403d-0d6c-406a-b993-24499d6972a5 tempest-SnapshotDependencyTests-39572979 None] <== create_volume: return (1432ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:25:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2fba403d-0d6c-406a-b993-24499d6972a5 tempest-SnapshotDependencyTests-39572979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.439s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2fba403d-0d6c-406a-b993-24499d6972a5 tempest-SnapshotDependencyTests-39572979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fada5ca-c096-4c3e-94dd-b739d4eca061) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2fba403d-0d6c-406a-b993-24499d6972a5 tempest-SnapshotDependencyTests-39572979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf91fa84-1cd1-44fa-be44-f509a394c553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:26 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-2fba403d-0d6c-406a-b993-24499d6972a5 tempest-SnapshotDependencyTests-39572979 None] Volume volume-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a (8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a): created successfully Sep 23 00:25:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2fba403d-0d6c-406a-b993-24499d6972a5 tempest-SnapshotDependencyTests-39572979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf91fa84-1cd1-44fa-be44-f509a394c553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-2fba403d-0d6c-406a-b993-24499d6972a5 tempest-SnapshotDependencyTests-39572979 None] Flow 'volume_create_manager' (cab6450f-b2d7-4f09-9061-952dbeb1e407) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:26 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-2fba403d-0d6c-406a-b993-24499d6972a5 tempest-SnapshotDependencyTests-39572979 None] Created volume successfully. Sep 23 00:25:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c5a17e54-4ee0-44c0-9478-278b1586ccb3 tempest-SnapshotDependencyTests-39572979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c5a17e54-4ee0-44c0-9478-278b1586ccb3 tempest-SnapshotDependencyTests-39572979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:27 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-c5a17e54-4ee0-44c0-9478-278b1586ccb3 tempest-SnapshotDependencyTests-39572979 None] Creating offline snapshot 3ec17635-747d-422d-a04e-2c303f84ad7f of volume 8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:25:27 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[230de76b-295b-4f06-8a79-57cd208c578f]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c5a17e54-4ee0-44c0-9478-278b1586ccb3 tempest-SnapshotDependencyTests-39572979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:27 devstack sudo[101448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a Sep 23 00:25:27 devstack sudo[101448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:27 devstack sudo[101448]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c5a17e54-4ee0-44c0-9478-278b1586ccb3 tempest-SnapshotDependencyTests-39572979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a" returned: 0 in 0.667s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c5a17e54-4ee0-44c0-9478-278b1586ccb3 tempest-SnapshotDependencyTests-39572979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a.3ec17635-747d-422d-a04e-2c303f84ad7f 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:27 devstack sudo[101453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a.3ec17635-747d-422d-a04e-2c303f84ad7f 1G Sep 23 00:25:27 devstack sudo[101453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:28 devstack sudo[101453]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c5a17e54-4ee0-44c0-9478-278b1586ccb3 tempest-SnapshotDependencyTests-39572979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a.3ec17635-747d-422d-a04e-2c303f84ad7f 1G" returned: 0 in 0.791s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c5a17e54-4ee0-44c0-9478-278b1586ccb3 tempest-SnapshotDependencyTests-39572979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a.3ec17635-747d-422d-a04e-2c303f84ad7f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:28 devstack sudo[101461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a.3ec17635-747d-422d-a04e-2c303f84ad7f Sep 23 00:25:28 devstack sudo[101461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:29 devstack sudo[101461]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c5a17e54-4ee0-44c0-9478-278b1586ccb3 tempest-SnapshotDependencyTests-39572979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a.3ec17635-747d-422d-a04e-2c303f84ad7f" returned: 0 in 0.666s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:29 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-c5a17e54-4ee0-44c0-9478-278b1586ccb3 tempest-SnapshotDependencyTests-39572979 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a.3ec17635-747d-422d-a04e-2c303f84ad7f is being set with open permissions: ugo+rw Sep 23 00:25:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c5a17e54-4ee0-44c0-9478-278b1586ccb3 tempest-SnapshotDependencyTests-39572979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a.3ec17635-747d-422d-a04e-2c303f84ad7f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:29 devstack sudo[101467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a.3ec17635-747d-422d-a04e-2c303f84ad7f Sep 23 00:25:29 devstack sudo[101467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:29 devstack sudo[101467]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c5a17e54-4ee0-44c0-9478-278b1586ccb3 tempest-SnapshotDependencyTests-39572979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a.3ec17635-747d-422d-a04e-2c303f84ad7f" returned: 0 in 0.443s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c5a17e54-4ee0-44c0-9478-278b1586ccb3 tempest-SnapshotDependencyTests-39572979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:30 devstack sudo[101485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a.info Sep 23 00:25:30 devstack sudo[101485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:30 devstack sudo[101485]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c5a17e54-4ee0-44c0-9478-278b1586ccb3 tempest-SnapshotDependencyTests-39572979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a.info" returned: 0 in 0.450s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:30 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-c5a17e54-4ee0-44c0-9478-278b1586ccb3 tempest-SnapshotDependencyTests-39572979 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a.info is being set with open permissions: ugo+rw Sep 23 00:25:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c5a17e54-4ee0-44c0-9478-278b1586ccb3 tempest-SnapshotDependencyTests-39572979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:30 devstack sudo[101495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a.info Sep 23 00:25:30 devstack sudo[101495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:30 devstack sudo[101495]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c5a17e54-4ee0-44c0-9478-278b1586ccb3 tempest-SnapshotDependencyTests-39572979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a.info" returned: 0 in 0.460s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c5a17e54-4ee0-44c0-9478-278b1586ccb3 tempest-SnapshotDependencyTests-39572979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.750s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:30 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-c5a17e54-4ee0-44c0-9478-278b1586ccb3 tempest-SnapshotDependencyTests-39572979 None] Create snapshot completed successfully Sep 23 00:25:32 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c70dc0a-a414-4566-8b00-66ef10f90075 tempest-SnapshotDependencyTests-39572979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:25:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7c70dc0a-a414-4566-8b00-66ef10f90075 tempest-SnapshotDependencyTests-39572979 None] Flow 'volume_create_manager' (472f231c-698b-4c65-b0e7-26c51d4b7d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7c70dc0a-a414-4566-8b00-66ef10f90075 tempest-SnapshotDependencyTests-39572979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afa15627-099a-425a-af5a-af93451aa032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7c70dc0a-a414-4566-8b00-66ef10f90075 tempest-SnapshotDependencyTests-39572979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afa15627-099a-425a-af5a-af93451aa032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:32Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea5a85d1-7e20-4736-ac70-d9d07b3e7cc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='689f032211db4bc4bb87dc2620327d4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3ec17635-747d-422d-a04e-2c303f84ad7f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:33Z,use_quota=True,user_id='237a59c99faf4ff1b00fe83f71700ea3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7c70dc0a-a414-4566-8b00-66ef10f90075 tempest-SnapshotDependencyTests-39572979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddeaa509-f8e5-44a3-92b5-cf7b39b4eea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7c70dc0a-a414-4566-8b00-66ef10f90075 tempest-SnapshotDependencyTests-39572979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddeaa509-f8e5-44a3-92b5-cf7b39b4eea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7c70dc0a-a414-4566-8b00-66ef10f90075 tempest-SnapshotDependencyTests-39572979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a4a4392-ddc1-4156-a9ea-dce1c627a95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7c70dc0a-a414-4566-8b00-66ef10f90075 tempest-SnapshotDependencyTests-39572979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a4a4392-ddc1-4156-a9ea-dce1c627a95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ea5a85d1-7e20-4736-ac70-d9d07b3e7cc4', 'volume_name': 'volume-ea5a85d1-7e20-4736-ac70-d9d07b3e7cc4', 'volume_size': 1, 'snapshot_id': '3ec17635-747d-422d-a04e-2c303f84ad7f'}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7c70dc0a-a414-4566-8b00-66ef10f90075 tempest-SnapshotDependencyTests-39572979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d037d883-6581-47e6-b2a8-1c3d24b34fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7c70dc0a-a414-4566-8b00-66ef10f90075 tempest-SnapshotDependencyTests-39572979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d037d883-6581-47e6-b2a8-1c3d24b34fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7c70dc0a-a414-4566-8b00-66ef10f90075 tempest-SnapshotDependencyTests-39572979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce716012-8d5c-40d3-85b6-a58e40b979fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:33 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-7c70dc0a-a414-4566-8b00-66ef10f90075 tempest-SnapshotDependencyTests-39572979 None] Volume ea5a85d1-7e20-4736-ac70-d9d07b3e7cc4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ea5a85d1-7e20-4736-ac70-d9d07b3e7cc4', 'volume_size': 1, 'snapshot_id': '3ec17635-747d-422d-a04e-2c303f84ad7f'} Sep 23 00:25:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7c70dc0a-a414-4566-8b00-66ef10f90075 tempest-SnapshotDependencyTests-39572979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7c70dc0a-a414-4566-8b00-66ef10f90075 tempest-SnapshotDependencyTests-39572979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.003s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:33 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-7c70dc0a-a414-4566-8b00-66ef10f90075 tempest-SnapshotDependencyTests-39572979 None] Acquiring lock "cinder-quobyte-3ec17635-747d-422d-a04e-2c303f84ad7f-ea5a85d1-7e20-4736-ac70-d9d07b3e7cc4" by "_create_volume_from_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:33 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-7c70dc0a-a414-4566-8b00-66ef10f90075 tempest-SnapshotDependencyTests-39572979 None] Lock "cinder-quobyte-3ec17635-747d-422d-a04e-2c303f84ad7f-ea5a85d1-7e20-4736-ac70-d9d07b3e7cc4" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:33 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7c70dc0a-a414-4566-8b00-66ef10f90075 tempest-SnapshotDependencyTests-39572979 None] Creating volume ea5a85d1-7e20-4736-ac70-d9d07b3e7cc4 from snapshot 3ec17635-747d-422d-a04e-2c303f84ad7f {{(pid=86591) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 00:25:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7c70dc0a-a414-4566-8b00-66ef10f90075 tempest-SnapshotDependencyTests-39572979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7c70dc0a-a414-4566-8b00-66ef10f90075 tempest-SnapshotDependencyTests-39572979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:33 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7c70dc0a-a414-4566-8b00-66ef10f90075 tempest-SnapshotDependencyTests-39572979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:33 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7c70dc0a-a414-4566-8b00-66ef10f90075 tempest-SnapshotDependencyTests-39572979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7c70dc0a-a414-4566-8b00-66ef10f90075 tempest-SnapshotDependencyTests-39572979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:33 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7c70dc0a-a414-4566-8b00-66ef10f90075 tempest-SnapshotDependencyTests-39572979 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:25:33 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-7c70dc0a-a414-4566-8b00-66ef10f90075 tempest-SnapshotDependencyTests-39572979 None] Acquiring lock "cinder-quobyte-ea5a85d1-7e20-4736-ac70-d9d07b3e7cc4" by "_copy_volume_from_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:33 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-7c70dc0a-a414-4566-8b00-66ef10f90075 tempest-SnapshotDependencyTests-39572979 None] Lock "cinder-quobyte-ea5a85d1-7e20-4736-ac70-d9d07b3e7cc4" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:33 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7c70dc0a-a414-4566-8b00-66ef10f90075 tempest-SnapshotDependencyTests-39572979 None] snapshot: 3ec17635-747d-422d-a04e-2c303f84ad7f, volume: ea5a85d1-7e20-4736-ac70-d9d07b3e7cc4, {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:25:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7c70dc0a-a414-4566-8b00-66ef10f90075 tempest-SnapshotDependencyTests-39572979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7c70dc0a-a414-4566-8b00-66ef10f90075 tempest-SnapshotDependencyTests-39572979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:33 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7c70dc0a-a414-4566-8b00-66ef10f90075 tempest-SnapshotDependencyTests-39572979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:33 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7c70dc0a-a414-4566-8b00-66ef10f90075 tempest-SnapshotDependencyTests-39572979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7c70dc0a-a414-4566-8b00-66ef10f90075 tempest-SnapshotDependencyTests-39572979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:33 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1e7198-e7da-4c32-a6ed-621ff47367d9]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7c70dc0a-a414-4566-8b00-66ef10f90075 tempest-SnapshotDependencyTests-39572979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a.3ec17635-747d-422d-a04e-2c303f84ad7f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:33 devstack sudo[101501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a.3ec17635-747d-422d-a04e-2c303f84ad7f Sep 23 00:25:33 devstack sudo[101501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:33 devstack sudo[101501]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7c70dc0a-a414-4566-8b00-66ef10f90075 tempest-SnapshotDependencyTests-39572979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a.3ec17635-747d-422d-a04e-2c303f84ad7f" returned: 0 in 0.747s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:33 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-7c70dc0a-a414-4566-8b00-66ef10f90075 tempest-SnapshotDependencyTests-39572979 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:25:33 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[78bbb009-a238-4a68-8d98-bedadd14958b]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7c70dc0a-a414-4566-8b00-66ef10f90075 tempest-SnapshotDependencyTests-39572979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:34 devstack sudo[101507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a Sep 23 00:25:34 devstack sudo[101507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:34 devstack sudo[101507]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7c70dc0a-a414-4566-8b00-66ef10f90075 tempest-SnapshotDependencyTests-39572979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a" returned: 0 in 0.666s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:34 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7c70dc0a-a414-4566-8b00-66ef10f90075 tempest-SnapshotDependencyTests-39572979 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:25:34 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7c70dc0a-a414-4566-8b00-66ef10f90075 tempest-SnapshotDependencyTests-39572979 None] Creating direct copy from snapshot {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:25:34 devstack cinder-volume[86591]: DEBUG cinder.utils [None req-7c70dc0a-a414-4566-8b00-66ef10f90075 tempest-SnapshotDependencyTests-39572979 None] Path /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ea5a85d1-7e20-4736-ac70-d9d07b3e7cc4 not found in is_blk_device check {{(pid=86591) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:25:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7c70dc0a-a414-4566-8b00-66ef10f90075 tempest-SnapshotDependencyTests-39572979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ea5a85d1-7e20-4736-ac70-d9d07b3e7cc4 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:34 devstack sudo[101514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ea5a85d1-7e20-4736-ac70-d9d07b3e7cc4 Sep 23 00:25:34 devstack sudo[101514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:34 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-5d86603f-adf0-43e2-855e-21bd94fef572 req-04f87c24-ea89-41d0-99fb-b7e100227108 tempest-TestShelveInstance-858165662 None] Terminate volume connection completed successfully. Sep 23 00:25:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-5d86603f-adf0-43e2-855e-21bd94fef572 req-04f87c24-ea89-41d0-99fb-b7e100227108 tempest-TestShelveInstance-858165662 None] Deleting attachment be4147cf-f4bd-4358-9d75-322402772c8f. {{(pid=86591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:25:35 devstack cinder-volume[86591]: DEBUG cinder.coordination [req-5d86603f-adf0-43e2-855e-21bd94fef572 req-d2cedd0a-7a75-4d09-854b-f29464789dd9 tempest-TestShelveInstance-858165662 None] Acquiring lock "cinder-5742048b-8986-4b18-98b4-10946835dfb3-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:35 devstack cinder-volume[86591]: DEBUG cinder.coordination [req-5d86603f-adf0-43e2-855e-21bd94fef572 req-d2cedd0a-7a75-4d09-854b-f29464789dd9 tempest-TestShelveInstance-858165662 None] Lock "cinder-5742048b-8986-4b18-98b4-10946835dfb3-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:35 devstack cinder-volume[86591]: DEBUG cinder.coordination [req-5d86603f-adf0-43e2-855e-21bd94fef572 req-d2cedd0a-7a75-4d09-854b-f29464789dd9 tempest-TestShelveInstance-858165662 None] Acquiring lock "cinder-quobyte-5742048b-8986-4b18-98b4-10946835dfb3" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:35 devstack cinder-volume[86591]: DEBUG cinder.coordination [req-5d86603f-adf0-43e2-855e-21bd94fef572 req-d2cedd0a-7a75-4d09-854b-f29464789dd9 tempest-TestShelveInstance-858165662 None] Lock "cinder-quobyte-5742048b-8986-4b18-98b4-10946835dfb3" acquired by "delete_volume" :: waited 0.029s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:35 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b727e0ad-bd96-4fe8-9554-f72f1e23c9ca]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-5d86603f-adf0-43e2-855e-21bd94fef572 req-d2cedd0a-7a75-4d09-854b-f29464789dd9 tempest-TestShelveInstance-858165662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-5742048b-8986-4b18-98b4-10946835dfb3 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:35 devstack sudo[101519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-5742048b-8986-4b18-98b4-10946835dfb3 Sep 23 00:25:35 devstack sudo[101519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:36 devstack sudo[101519]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-5d86603f-adf0-43e2-855e-21bd94fef572 req-d2cedd0a-7a75-4d09-854b-f29464789dd9 tempest-TestShelveInstance-858165662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-5742048b-8986-4b18-98b4-10946835dfb3" returned: 0 in 1.034s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-5d86603f-adf0-43e2-855e-21bd94fef572 req-d2cedd0a-7a75-4d09-854b-f29464789dd9 tempest-TestShelveInstance-858165662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-5742048b-8986-4b18-98b4-10946835dfb3 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:36 devstack sudo[101532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-5742048b-8986-4b18-98b4-10946835dfb3 Sep 23 00:25:36 devstack sudo[101532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:36 devstack sudo[101532]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-5d86603f-adf0-43e2-855e-21bd94fef572 req-d2cedd0a-7a75-4d09-854b-f29464789dd9 tempest-TestShelveInstance-858165662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-5742048b-8986-4b18-98b4-10946835dfb3" returned: 0 in 0.518s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:36 devstack cinder-volume[86591]: DEBUG cinder.coordination [req-5d86603f-adf0-43e2-855e-21bd94fef572 req-d2cedd0a-7a75-4d09-854b-f29464789dd9 tempest-TestShelveInstance-858165662 None] Lock "cinder-quobyte-5742048b-8986-4b18-98b4-10946835dfb3" released by "delete_volume" :: held 1.640s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:37 devstack cinder-volume[86591]: DEBUG cinder.quota [req-5d86603f-adf0-43e2-855e-21bd94fef572 req-d2cedd0a-7a75-4d09-854b-f29464789dd9 tempest-TestShelveInstance-858165662 None] Created reservations ['8e98148b-61fc-4294-9577-08e233e6517c', '498373ca-35b9-42f8-a70b-ee8b83273f8e', 'f3d17441-ea9a-4ad7-ace0-d690f1875502', 'e3c600a3-f0ea-48eb-94e2-8d94ec90720d'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:25:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-5d86603f-adf0-43e2-855e-21bd94fef572 req-d2cedd0a-7a75-4d09-854b-f29464789dd9 tempest-TestShelveInstance-858165662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-5d86603f-adf0-43e2-855e-21bd94fef572 req-d2cedd0a-7a75-4d09-854b-f29464789dd9 tempest-TestShelveInstance-858165662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [req-5d86603f-adf0-43e2-855e-21bd94fef572 req-d2cedd0a-7a75-4d09-854b-f29464789dd9 tempest-TestShelveInstance-858165662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [req-5d86603f-adf0-43e2-855e-21bd94fef572 req-d2cedd0a-7a75-4d09-854b-f29464789dd9 tempest-TestShelveInstance-858165662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-5d86603f-adf0-43e2-855e-21bd94fef572 req-d2cedd0a-7a75-4d09-854b-f29464789dd9 tempest-TestShelveInstance-858165662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-5d86603f-adf0-43e2-855e-21bd94fef572 req-d2cedd0a-7a75-4d09-854b-f29464789dd9 tempest-TestShelveInstance-858165662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:37 devstack sudo[101537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:25:37 devstack sudo[101537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:38 devstack sudo[101537]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [req-5d86603f-adf0-43e2-855e-21bd94fef572 req-d2cedd0a-7a75-4d09-854b-f29464789dd9 tempest-TestShelveInstance-858165662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.943s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:38 devstack cinder-volume[86591]: DEBUG cinder.manager [req-5d86603f-adf0-43e2-855e-21bd94fef572 req-d2cedd0a-7a75-4d09-854b-f29464789dd9 tempest-TestShelveInstance-858165662 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:25:38 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-5d86603f-adf0-43e2-855e-21bd94fef572 req-d2cedd0a-7a75-4d09-854b-f29464789dd9 tempest-TestShelveInstance-858165662 None] Deleted volume successfully. Sep 23 00:25:38 devstack cinder-volume[86591]: DEBUG cinder.coordination [req-5d86603f-adf0-43e2-855e-21bd94fef572 req-d2cedd0a-7a75-4d09-854b-f29464789dd9 tempest-TestShelveInstance-858165662 None] Lock "cinder-5742048b-8986-4b18-98b4-10946835dfb3-delete_volume" released by "delete_volume" :: held 3.161s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:45 devstack sudo[101514]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7c70dc0a-a414-4566-8b00-66ef10f90075 tempest-SnapshotDependencyTests-39572979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ea5a85d1-7e20-4736-ac70-d9d07b3e7cc4" returned: 0 in 11.330s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:45 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-7c70dc0a-a414-4566-8b00-66ef10f90075 tempest-SnapshotDependencyTests-39572979 None] Image conversion details: src /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a, size 1024.00 MB, duration 11.33 sec, destination /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ea5a85d1-7e20-4736-ac70-d9d07b3e7cc4 {{(pid=86591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:25:45 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-7c70dc0a-a414-4566-8b00-66ef10f90075 tempest-SnapshotDependencyTests-39572979 None] Converted 1024.00 MB image at 90.34 MB/s Sep 23 00:25:45 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-7c70dc0a-a414-4566-8b00-66ef10f90075 tempest-SnapshotDependencyTests-39572979 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ea5a85d1-7e20-4736-ac70-d9d07b3e7cc4 is being set with open permissions: ugo+rw Sep 23 00:25:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7c70dc0a-a414-4566-8b00-66ef10f90075 tempest-SnapshotDependencyTests-39572979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ea5a85d1-7e20-4736-ac70-d9d07b3e7cc4 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:46 devstack sudo[101542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ea5a85d1-7e20-4736-ac70-d9d07b3e7cc4 Sep 23 00:25:46 devstack sudo[101542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:46 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-53fee355-030d-49f0-9317-8ac8c2cb803a tempest-TestInstancesWithCinderVolumes-529309143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:25:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53fee355-030d-49f0-9317-8ac8c2cb803a tempest-TestInstancesWithCinderVolumes-529309143 None] Flow 'volume_create_manager' (e6534bde-8db3-4440-ab89-139898813607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53fee355-030d-49f0-9317-8ac8c2cb803a tempest-TestInstancesWithCinderVolumes-529309143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4e25789-e8db-4ffc-9639-f64e002e4d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53fee355-030d-49f0-9317-8ac8c2cb803a tempest-TestInstancesWithCinderVolumes-529309143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4e25789-e8db-4ffc-9639-f64e002e4d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1270716700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5986a1b4-48aa-4705-8942-5a94a2166b76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='980a65d793a74e4ab4d4586a713df155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:46Z,use_quota=True,user_id='88aed1b0bd8e4836b0fb94f21e3d0456',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(12ce496c-8301-47e1-b322-1c2c2179eec0),volume_type_id=12ce496c-8301-47e1-b322-1c2c2179eec0)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53fee355-030d-49f0-9317-8ac8c2cb803a tempest-TestInstancesWithCinderVolumes-529309143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19ef939b-6d63-4bb9-ae6c-45573d73db39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53fee355-030d-49f0-9317-8ac8c2cb803a tempest-TestInstancesWithCinderVolumes-529309143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19ef939b-6d63-4bb9-ae6c-45573d73db39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53fee355-030d-49f0-9317-8ac8c2cb803a tempest-TestInstancesWithCinderVolumes-529309143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3d11632-5587-4b77-b2db-5832e5080e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53fee355-030d-49f0-9317-8ac8c2cb803a tempest-TestInstancesWithCinderVolumes-529309143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3d11632-5587-4b77-b2db-5832e5080e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5986a1b4-48aa-4705-8942-5a94a2166b76', 'volume_name': 'volume-5986a1b4-48aa-4705-8942-5a94a2166b76', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53fee355-030d-49f0-9317-8ac8c2cb803a tempest-TestInstancesWithCinderVolumes-529309143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66c490c8-f4fb-4182-872f-23e7e853312b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53fee355-030d-49f0-9317-8ac8c2cb803a tempest-TestInstancesWithCinderVolumes-529309143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66c490c8-f4fb-4182-872f-23e7e853312b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53fee355-030d-49f0-9317-8ac8c2cb803a tempest-TestInstancesWithCinderVolumes-529309143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0131effb-c255-4c83-82f0-8048f73465c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:46 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-53fee355-030d-49f0-9317-8ac8c2cb803a tempest-TestInstancesWithCinderVolumes-529309143 None] Volume 5986a1b4-48aa-4705-8942-5a94a2166b76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5986a1b4-48aa-4705-8942-5a94a2166b76', 'volume_size': 1} Sep 23 00:25:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-53fee355-030d-49f0-9317-8ac8c2cb803a tempest-TestInstancesWithCinderVolumes-529309143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:46 devstack sudo[101542]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7c70dc0a-a414-4566-8b00-66ef10f90075 tempest-SnapshotDependencyTests-39572979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ea5a85d1-7e20-4736-ac70-d9d07b3e7cc4" returned: 0 in 0.441s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:46 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-7c70dc0a-a414-4566-8b00-66ef10f90075 tempest-SnapshotDependencyTests-39572979 None] Lock "cinder-quobyte-ea5a85d1-7e20-4736-ac70-d9d07b3e7cc4" released by "_copy_volume_from_snapshot" :: held 13.326s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:46 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-7c70dc0a-a414-4566-8b00-66ef10f90075 tempest-SnapshotDependencyTests-39572979 None] Lock "cinder-quobyte-3ec17635-747d-422d-a04e-2c303f84ad7f-ea5a85d1-7e20-4736-ac70-d9d07b3e7cc4" released by "_create_volume_from_snapshot" :: held 13.468s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7c70dc0a-a414-4566-8b00-66ef10f90075 tempest-SnapshotDependencyTests-39572979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.492s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-53fee355-030d-49f0-9317-8ac8c2cb803a tempest-TestInstancesWithCinderVolumes-529309143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.273s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-53fee355-030d-49f0-9317-8ac8c2cb803a tempest-TestInstancesWithCinderVolumes-529309143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1270716700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5986a1b4-48aa-4705-8942-5a94a2166b76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='980a65d793a74e4ab4d4586a713df155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:46Z,use_quota=True,user_id='88aed1b0bd8e4836b0fb94f21e3d0456',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(12ce496c-8301-47e1-b322-1c2c2179eec0),volume_type_id=12ce496c-8301-47e1-b322-1c2c2179eec0)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:25:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-53fee355-030d-49f0-9317-8ac8c2cb803a tempest-TestInstancesWithCinderVolumes-529309143 None] Creating volume 5986a1b4-48aa-4705-8942-5a94a2166b76 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:25:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-53fee355-030d-49f0-9317-8ac8c2cb803a tempest-TestInstancesWithCinderVolumes-529309143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-53fee355-030d-49f0-9317-8ac8c2cb803a tempest-TestInstancesWithCinderVolumes-529309143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-53fee355-030d-49f0-9317-8ac8c2cb803a tempest-TestInstancesWithCinderVolumes-529309143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-53fee355-030d-49f0-9317-8ac8c2cb803a tempest-TestInstancesWithCinderVolumes-529309143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-53fee355-030d-49f0-9317-8ac8c2cb803a tempest-TestInstancesWithCinderVolumes-529309143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-53fee355-030d-49f0-9317-8ac8c2cb803a tempest-TestInstancesWithCinderVolumes-529309143 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:25:46 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-53fee355-030d-49f0-9317-8ac8c2cb803a tempest-TestInstancesWithCinderVolumes-529309143 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:25:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-53fee355-030d-49f0-9317-8ac8c2cb803a tempest-TestInstancesWithCinderVolumes-529309143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-5986a1b4-48aa-4705-8942-5a94a2166b76 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:46 devstack sudo[101545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-5986a1b4-48aa-4705-8942-5a94a2166b76 1073741824 Sep 23 00:25:46 devstack sudo[101545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7c70dc0a-a414-4566-8b00-66ef10f90075 tempest-SnapshotDependencyTests-39572979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce716012-8d5c-40d3-85b6-a58e40b979fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea5a85d1-7e20-4736-ac70-d9d07b3e7cc4', 'volume_size': 1, 'snapshot_id': '3ec17635-747d-422d-a04e-2c303f84ad7f'}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7c70dc0a-a414-4566-8b00-66ef10f90075 tempest-SnapshotDependencyTests-39572979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52b678eb-3f17-4b50-b52b-a2b49cfae54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:46 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-7c70dc0a-a414-4566-8b00-66ef10f90075 tempest-SnapshotDependencyTests-39572979 None] Volume volume-ea5a85d1-7e20-4736-ac70-d9d07b3e7cc4 (ea5a85d1-7e20-4736-ac70-d9d07b3e7cc4): created successfully Sep 23 00:25:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7c70dc0a-a414-4566-8b00-66ef10f90075 tempest-SnapshotDependencyTests-39572979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52b678eb-3f17-4b50-b52b-a2b49cfae54b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7c70dc0a-a414-4566-8b00-66ef10f90075 tempest-SnapshotDependencyTests-39572979 None] Flow 'volume_create_manager' (472f231c-698b-4c65-b0e7-26c51d4b7d1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:46 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-7c70dc0a-a414-4566-8b00-66ef10f90075 tempest-SnapshotDependencyTests-39572979 None] Created volume successfully. Sep 23 00:25:46 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4cd7c79-a23a-4d59-b5c6-c5ddd2ecff51 tempest-TestInstancesWithCinderVolumes-529309143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:25:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b4cd7c79-a23a-4d59-b5c6-c5ddd2ecff51 tempest-TestInstancesWithCinderVolumes-529309143 None] Flow 'volume_create_manager' (82caf0a3-65fd-402e-b652-70f2f8d9ab00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b4cd7c79-a23a-4d59-b5c6-c5ddd2ecff51 tempest-TestInstancesWithCinderVolumes-529309143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b6f75cf-f8a2-4d6c-b336-bb1d986315fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b4cd7c79-a23a-4d59-b5c6-c5ddd2ecff51 tempest-TestInstancesWithCinderVolumes-529309143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b6f75cf-f8a2-4d6c-b336-bb1d986315fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-512449857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30359e71-a53b-4cee-b44e-ae39bc3ce28d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='980a65d793a74e4ab4d4586a713df155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:47Z,use_quota=True,user_id='88aed1b0bd8e4836b0fb94f21e3d0456',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37dd4d73-3e7c-48f1-a957-545237e4576c),volume_type_id=37dd4d73-3e7c-48f1-a957-545237e4576c)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b4cd7c79-a23a-4d59-b5c6-c5ddd2ecff51 tempest-TestInstancesWithCinderVolumes-529309143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38c59916-c040-4efa-b434-3b9f95f3d00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b4cd7c79-a23a-4d59-b5c6-c5ddd2ecff51 tempest-TestInstancesWithCinderVolumes-529309143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38c59916-c040-4efa-b434-3b9f95f3d00e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b4cd7c79-a23a-4d59-b5c6-c5ddd2ecff51 tempest-TestInstancesWithCinderVolumes-529309143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92e0743a-10c2-4000-9f94-c7e40d40766f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b4cd7c79-a23a-4d59-b5c6-c5ddd2ecff51 tempest-TestInstancesWithCinderVolumes-529309143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92e0743a-10c2-4000-9f94-c7e40d40766f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30359e71-a53b-4cee-b44e-ae39bc3ce28d', 'volume_name': 'volume-30359e71-a53b-4cee-b44e-ae39bc3ce28d', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b4cd7c79-a23a-4d59-b5c6-c5ddd2ecff51 tempest-TestInstancesWithCinderVolumes-529309143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13895261-51e5-4542-b660-3f2dc5107ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b4cd7c79-a23a-4d59-b5c6-c5ddd2ecff51 tempest-TestInstancesWithCinderVolumes-529309143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13895261-51e5-4542-b660-3f2dc5107ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b4cd7c79-a23a-4d59-b5c6-c5ddd2ecff51 tempest-TestInstancesWithCinderVolumes-529309143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81ccaee6-07a2-4f83-ae32-1d5bc4d286b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:47 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-b4cd7c79-a23a-4d59-b5c6-c5ddd2ecff51 tempest-TestInstancesWithCinderVolumes-529309143 None] Volume 30359e71-a53b-4cee-b44e-ae39bc3ce28d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30359e71-a53b-4cee-b44e-ae39bc3ce28d', 'volume_size': 1} Sep 23 00:25:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b4cd7c79-a23a-4d59-b5c6-c5ddd2ecff51 tempest-TestInstancesWithCinderVolumes-529309143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:47 devstack sudo[101545]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-53fee355-030d-49f0-9317-8ac8c2cb803a tempest-TestInstancesWithCinderVolumes-529309143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-5986a1b4-48aa-4705-8942-5a94a2166b76 1073741824" returned: 0 in 0.704s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-53fee355-030d-49f0-9317-8ac8c2cb803a tempest-TestInstancesWithCinderVolumes-529309143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-5986a1b4-48aa-4705-8942-5a94a2166b76 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:47 devstack sudo[101552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-5986a1b4-48aa-4705-8942-5a94a2166b76 Sep 23 00:25:47 devstack sudo[101552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:47 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-50a28ab6-34e7-4570-b7ae-d2e63b515e74 tempest-SnapshotDependencyTests-39572979 None] Acquiring lock "cinder-3ec17635-747d-422d-a04e-2c303f84ad7f-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:47 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-50a28ab6-34e7-4570-b7ae-d2e63b515e74 tempest-SnapshotDependencyTests-39572979 None] Lock "cinder-3ec17635-747d-422d-a04e-2c303f84ad7f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:47 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-50a28ab6-34e7-4570-b7ae-d2e63b515e74 tempest-SnapshotDependencyTests-39572979 None] Acquiring lock "cinder-quobyte-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:47 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-50a28ab6-34e7-4570-b7ae-d2e63b515e74 tempest-SnapshotDependencyTests-39572979 None] Lock "cinder-quobyte-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:47 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-50a28ab6-34e7-4570-b7ae-d2e63b515e74 tempest-SnapshotDependencyTests-39572979 None] Acquiring lock "cinder-quobyte-3ec17635-747d-422d-a04e-2c303f84ad7f" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:47 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-50a28ab6-34e7-4570-b7ae-d2e63b515e74 tempest-SnapshotDependencyTests-39572979 None] Lock "cinder-quobyte-3ec17635-747d-422d-a04e-2c303f84ad7f" acquired by "_delete_snapshot" :: waited 0.052s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:47 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-50a28ab6-34e7-4570-b7ae-d2e63b515e74 tempest-SnapshotDependencyTests-39572979 None] Deleting offline snapshot 3ec17635-747d-422d-a04e-2c303f84ad7f of volume 8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:25:47 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-50a28ab6-34e7-4570-b7ae-d2e63b515e74 tempest-SnapshotDependencyTests-39572979 None] snapshot_file for this snap is: volume-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a.3ec17635-747d-422d-a04e-2c303f84ad7f {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:25:47 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[518a4b81-01fb-42c1-a5dc-4f2f86409bd7]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-50a28ab6-34e7-4570-b7ae-d2e63b515e74 tempest-SnapshotDependencyTests-39572979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a.3ec17635-747d-422d-a04e-2c303f84ad7f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:47 devstack sudo[101552]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-53fee355-030d-49f0-9317-8ac8c2cb803a tempest-TestInstancesWithCinderVolumes-529309143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-5986a1b4-48aa-4705-8942-5a94a2166b76" returned: 0 in 0.690s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:48 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-53fee355-030d-49f0-9317-8ac8c2cb803a tempest-TestInstancesWithCinderVolumes-529309143 None] <== create_volume: return (1467ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:25:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-53fee355-030d-49f0-9317-8ac8c2cb803a tempest-TestInstancesWithCinderVolumes-529309143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.477s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b4cd7c79-a23a-4d59-b5c6-c5ddd2ecff51 tempest-TestInstancesWithCinderVolumes-529309143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.959s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:48 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b4cd7c79-a23a-4d59-b5c6-c5ddd2ecff51 tempest-TestInstancesWithCinderVolumes-529309143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-512449857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30359e71-a53b-4cee-b44e-ae39bc3ce28d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='980a65d793a74e4ab4d4586a713df155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:47Z,use_quota=True,user_id='88aed1b0bd8e4836b0fb94f21e3d0456',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37dd4d73-3e7c-48f1-a957-545237e4576c),volume_type_id=37dd4d73-3e7c-48f1-a957-545237e4576c)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:25:48 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-b4cd7c79-a23a-4d59-b5c6-c5ddd2ecff51 tempest-TestInstancesWithCinderVolumes-529309143 None] Creating volume 30359e71-a53b-4cee-b44e-ae39bc3ce28d {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:25:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b4cd7c79-a23a-4d59-b5c6-c5ddd2ecff51 tempest-TestInstancesWithCinderVolumes-529309143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b4cd7c79-a23a-4d59-b5c6-c5ddd2ecff51 tempest-TestInstancesWithCinderVolumes-529309143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:48 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b4cd7c79-a23a-4d59-b5c6-c5ddd2ecff51 tempest-TestInstancesWithCinderVolumes-529309143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:48 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b4cd7c79-a23a-4d59-b5c6-c5ddd2ecff51 tempest-TestInstancesWithCinderVolumes-529309143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b4cd7c79-a23a-4d59-b5c6-c5ddd2ecff51 tempest-TestInstancesWithCinderVolumes-529309143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:48 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b4cd7c79-a23a-4d59-b5c6-c5ddd2ecff51 tempest-TestInstancesWithCinderVolumes-529309143 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:25:48 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-b4cd7c79-a23a-4d59-b5c6-c5ddd2ecff51 tempest-TestInstancesWithCinderVolumes-529309143 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:25:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b4cd7c79-a23a-4d59-b5c6-c5ddd2ecff51 tempest-TestInstancesWithCinderVolumes-529309143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-30359e71-a53b-4cee-b44e-ae39bc3ce28d 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:48 devstack sudo[101556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-30359e71-a53b-4cee-b44e-ae39bc3ce28d 1073741824 Sep 23 00:25:48 devstack sudo[101556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:48 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53fee355-030d-49f0-9317-8ac8c2cb803a tempest-TestInstancesWithCinderVolumes-529309143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0131effb-c255-4c83-82f0-8048f73465c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5986a1b4-48aa-4705-8942-5a94a2166b76', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:48 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53fee355-030d-49f0-9317-8ac8c2cb803a tempest-TestInstancesWithCinderVolumes-529309143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b42e3d1-5f4f-404d-a171-13e3b68d1860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:48 devstack sudo[101555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a.3ec17635-747d-422d-a04e-2c303f84ad7f Sep 23 00:25:48 devstack sudo[101555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:48 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-53fee355-030d-49f0-9317-8ac8c2cb803a tempest-TestInstancesWithCinderVolumes-529309143 None] Volume volume-5986a1b4-48aa-4705-8942-5a94a2166b76 (5986a1b4-48aa-4705-8942-5a94a2166b76): created successfully Sep 23 00:25:48 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53fee355-030d-49f0-9317-8ac8c2cb803a tempest-TestInstancesWithCinderVolumes-529309143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b42e3d1-5f4f-404d-a171-13e3b68d1860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:48 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53fee355-030d-49f0-9317-8ac8c2cb803a tempest-TestInstancesWithCinderVolumes-529309143 None] Flow 'volume_create_manager' (e6534bde-8db3-4440-ab89-139898813607) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:48 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-53fee355-030d-49f0-9317-8ac8c2cb803a tempest-TestInstancesWithCinderVolumes-529309143 None] Created volume successfully. Sep 23 00:25:48 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-d16f0f23-bcfe-4a1d-bfc1-2eb2d878590b tempest-TestInstancesWithCinderVolumes-529309143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:25:48 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d16f0f23-bcfe-4a1d-bfc1-2eb2d878590b tempest-TestInstancesWithCinderVolumes-529309143 None] Flow 'volume_create_manager' (89a49aee-01a8-4949-92a8-19ed79f7e84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:48 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d16f0f23-bcfe-4a1d-bfc1-2eb2d878590b tempest-TestInstancesWithCinderVolumes-529309143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa241059-93cb-4811-9a79-05723465b027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:48 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d16f0f23-bcfe-4a1d-bfc1-2eb2d878590b tempest-TestInstancesWithCinderVolumes-529309143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa241059-93cb-4811-9a79-05723465b027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1874386895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea0e1ce5-eada-4735-a408-9f67ef644e00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='980a65d793a74e4ab4d4586a713df155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:48Z,use_quota=True,user_id='88aed1b0bd8e4836b0fb94f21e3d0456',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bcdb38f2-3197-4d9a-8bbb-760fc13f463a),volume_type_id=bcdb38f2-3197-4d9a-8bbb-760fc13f463a)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:48 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d16f0f23-bcfe-4a1d-bfc1-2eb2d878590b tempest-TestInstancesWithCinderVolumes-529309143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc9a00cf-9fbd-4f99-9924-ceb8e5b4912c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:48 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d16f0f23-bcfe-4a1d-bfc1-2eb2d878590b tempest-TestInstancesWithCinderVolumes-529309143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc9a00cf-9fbd-4f99-9924-ceb8e5b4912c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:48 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d16f0f23-bcfe-4a1d-bfc1-2eb2d878590b tempest-TestInstancesWithCinderVolumes-529309143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3298be3-8bd6-470e-b0f6-3356bf74ca7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:48 devstack cinder-volume[86591]: DEBUG cinder.image.glance [None req-d16f0f23-bcfe-4a1d-bfc1-2eb2d878590b tempest-TestInstancesWithCinderVolumes-529309143 None] Creating Keystone auth plugin from conf {{(pid=86591) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 00:25:48 devstack sudo[101555]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-50a28ab6-34e7-4570-b7ae-d2e63b515e74 tempest-SnapshotDependencyTests-39572979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a.3ec17635-747d-422d-a04e-2c303f84ad7f" returned: 0 in 0.680s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:48 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-50a28ab6-34e7-4570-b7ae-d2e63b515e74 tempest-SnapshotDependencyTests-39572979 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:25:48 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[26662323-e83f-486d-8321-8f467e39a8c4]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-50a28ab6-34e7-4570-b7ae-d2e63b515e74 tempest-SnapshotDependencyTests-39572979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:48 devstack sudo[101567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a Sep 23 00:25:48 devstack sudo[101567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:48 devstack sudo[101556]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b4cd7c79-a23a-4d59-b5c6-c5ddd2ecff51 tempest-TestInstancesWithCinderVolumes-529309143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-30359e71-a53b-4cee-b44e-ae39bc3ce28d 1073741824" returned: 0 in 0.900s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b4cd7c79-a23a-4d59-b5c6-c5ddd2ecff51 tempest-TestInstancesWithCinderVolumes-529309143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-30359e71-a53b-4cee-b44e-ae39bc3ce28d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:49 devstack sudo[101569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-30359e71-a53b-4cee-b44e-ae39bc3ce28d Sep 23 00:25:49 devstack sudo[101569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:49 devstack sudo[101569]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b4cd7c79-a23a-4d59-b5c6-c5ddd2ecff51 tempest-TestInstancesWithCinderVolumes-529309143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-30359e71-a53b-4cee-b44e-ae39bc3ce28d" returned: 0 in 0.428s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:49 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b4cd7c79-a23a-4d59-b5c6-c5ddd2ecff51 tempest-TestInstancesWithCinderVolumes-529309143 None] <== create_volume: return (1440ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:25:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b4cd7c79-a23a-4d59-b5c6-c5ddd2ecff51 tempest-TestInstancesWithCinderVolumes-529309143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.445s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b4cd7c79-a23a-4d59-b5c6-c5ddd2ecff51 tempest-TestInstancesWithCinderVolumes-529309143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81ccaee6-07a2-4f83-ae32-1d5bc4d286b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30359e71-a53b-4cee-b44e-ae39bc3ce28d', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b4cd7c79-a23a-4d59-b5c6-c5ddd2ecff51 tempest-TestInstancesWithCinderVolumes-529309143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8df5ce1e-381c-4d28-bf85-7f16d77d1f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d16f0f23-bcfe-4a1d-bfc1-2eb2d878590b tempest-TestInstancesWithCinderVolumes-529309143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3298be3-8bd6-470e-b0f6-3356bf74ca7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ea0e1ce5-eada-4735-a408-9f67ef644e00', 'volume_name': 'volume-ea0e1ce5-eada-4735-a408-9f67ef644e00', 'volume_size': 1, 'image_id': '29fd2cca-3af4-492c-9f7d-c806b35072b1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/29fd2cca-3af4-492c-9f7d-c806b35072b1', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1003878957', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '980a65d793a74e4ab4d4586a713df155', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '29fd2cca-3af4-492c-9f7d-c806b35072b1', 'created_at': datetime.datetime(2026, 9, 22, 22, 25, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 25, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/29fd2cca-3af4-492c-9f7d-c806b35072b1/file', 'properties': {}}, 'image_service': }' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d16f0f23-bcfe-4a1d-bfc1-2eb2d878590b tempest-TestInstancesWithCinderVolumes-529309143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b61396a-9294-4bc9-9b84-d34a69f5d1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d16f0f23-bcfe-4a1d-bfc1-2eb2d878590b tempest-TestInstancesWithCinderVolumes-529309143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b61396a-9294-4bc9-9b84-d34a69f5d1da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d16f0f23-bcfe-4a1d-bfc1-2eb2d878590b tempest-TestInstancesWithCinderVolumes-529309143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78f086ee-7a6e-4279-a94c-1d41506832bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:49 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-d16f0f23-bcfe-4a1d-bfc1-2eb2d878590b tempest-TestInstancesWithCinderVolumes-529309143 None] Volume ea0e1ce5-eada-4735-a408-9f67ef644e00: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ea0e1ce5-eada-4735-a408-9f67ef644e00', 'volume_size': 1, 'image_id': '29fd2cca-3af4-492c-9f7d-c806b35072b1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/29fd2cca-3af4-492c-9f7d-c806b35072b1', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1003878957', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '980a65d793a74e4ab4d4586a713df155', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '29fd2cca-3af4-492c-9f7d-c806b35072b1', 'created_at': datetime.datetime(2026, 9, 22, 22, 25, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 25, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/29fd2cca-3af4-492c-9f7d-c806b35072b1/file', 'properties': {}}, 'image_service': } Sep 23 00:25:49 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-d16f0f23-bcfe-4a1d-bfc1-2eb2d878590b tempest-TestInstancesWithCinderVolumes-529309143 None] Trying to clone ea0e1ce5-eada-4735-a408-9f67ef644e00 from image 29fd2cca-3af4-492c-9f7d-c806b35072b1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/29fd2cca-3af4-492c-9f7d-c806b35072b1', 'metadata': {}}]). {{(pid=86591) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 00:25:49 devstack sudo[101567]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:49 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-b4cd7c79-a23a-4d59-b5c6-c5ddd2ecff51 tempest-TestInstancesWithCinderVolumes-529309143 None] Volume volume-30359e71-a53b-4cee-b44e-ae39bc3ce28d (30359e71-a53b-4cee-b44e-ae39bc3ce28d): created successfully Sep 23 00:25:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b4cd7c79-a23a-4d59-b5c6-c5ddd2ecff51 tempest-TestInstancesWithCinderVolumes-529309143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8df5ce1e-381c-4d28-bf85-7f16d77d1f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b4cd7c79-a23a-4d59-b5c6-c5ddd2ecff51 tempest-TestInstancesWithCinderVolumes-529309143 None] Flow 'volume_create_manager' (82caf0a3-65fd-402e-b652-70f2f8d9ab00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-50a28ab6-34e7-4570-b7ae-d2e63b515e74 tempest-SnapshotDependencyTests-39572979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a" returned: 0 in 0.968s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-50a28ab6-34e7-4570-b7ae-d2e63b515e74 tempest-SnapshotDependencyTests-39572979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a.3ec17635-747d-422d-a04e-2c303f84ad7f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:49 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-b4cd7c79-a23a-4d59-b5c6-c5ddd2ecff51 tempest-TestInstancesWithCinderVolumes-529309143 None] Created volume successfully. Sep 23 00:25:49 devstack sudo[101575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a.3ec17635-747d-422d-a04e-2c303f84ad7f Sep 23 00:25:49 devstack sudo[101575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:50 devstack sudo[101575]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-50a28ab6-34e7-4570-b7ae-d2e63b515e74 tempest-SnapshotDependencyTests-39572979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a.3ec17635-747d-422d-a04e-2c303f84ad7f" returned: 0 in 0.670s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-50a28ab6-34e7-4570-b7ae-d2e63b515e74 tempest-SnapshotDependencyTests-39572979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a.3ec17635-747d-422d-a04e-2c303f84ad7f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:50 devstack sudo[101581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a.3ec17635-747d-422d-a04e-2c303f84ad7f Sep 23 00:25:50 devstack sudo[101581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:50 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-e879a648-eb78-4963-88aa-da090d439616 tempest-GroupsV314Test-881346209 None] Group tempest-GroupsV314Test-Group-349285664: creating Sep 23 00:25:50 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-e879a648-eb78-4963-88aa-da090d439616 tempest-GroupsV314Test-881346209 None] Group tempest-GroupsV314Test-Group-349285664: created successfully Sep 23 00:25:50 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-e879a648-eb78-4963-88aa-da090d439616 tempest-GroupsV314Test-881346209 None] Create group completed successfully. Sep 23 00:25:50 devstack sudo[101581]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-50a28ab6-34e7-4570-b7ae-d2e63b515e74 tempest-SnapshotDependencyTests-39572979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a.3ec17635-747d-422d-a04e-2c303f84ad7f" returned: 0 in 0.408s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:50 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-50a28ab6-34e7-4570-b7ae-d2e63b515e74 tempest-SnapshotDependencyTests-39572979 None] Lock "cinder-quobyte-3ec17635-747d-422d-a04e-2c303f84ad7f" released by "_delete_snapshot" :: held 2.983s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:50 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-50a28ab6-34e7-4570-b7ae-d2e63b515e74 tempest-SnapshotDependencyTests-39572979 None] Lock "cinder-quobyte-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a" released by "delete_snapshot" :: held 3.049s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:50 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-50a28ab6-34e7-4570-b7ae-d2e63b515e74 tempest-SnapshotDependencyTests-39572979 None] Created reservations ['9c48409f-7d8b-48f5-8e58-0413900700ce', '0e8220df-03df-4079-9f5b-4fe886a76c93', 'aca2d97e-f14d-4e7b-b1da-39116d80e657', '8128c194-d8bb-4894-bd05-e5cd9a1547ec'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:25:51 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-50a28ab6-34e7-4570-b7ae-d2e63b515e74 tempest-SnapshotDependencyTests-39572979 None] Delete snapshot completed successfully. Sep 23 00:25:51 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-50a28ab6-34e7-4570-b7ae-d2e63b515e74 tempest-SnapshotDependencyTests-39572979 None] Lock "cinder-3ec17635-747d-422d-a04e-2c303f84ad7f-delete_snapshot" released by "delete_snapshot" :: held 3.312s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:51 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-46da06ec-2da1-4dac-bc8c-bb429e685de7 tempest-SnapshotDependencyTests-39572979 None] Acquiring lock "cinder-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:51 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-46da06ec-2da1-4dac-bc8c-bb429e685de7 tempest-SnapshotDependencyTests-39572979 None] Lock "cinder-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:51 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-46da06ec-2da1-4dac-bc8c-bb429e685de7 tempest-SnapshotDependencyTests-39572979 None] Acquiring lock "cinder-quobyte-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:51 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-46da06ec-2da1-4dac-bc8c-bb429e685de7 tempest-SnapshotDependencyTests-39572979 None] Lock "cinder-quobyte-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a" acquired by "delete_volume" :: waited 0.015s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:51 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aeddb8f-9146-4c80-9507-312b1665d413]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-46da06ec-2da1-4dac-bc8c-bb429e685de7 tempest-SnapshotDependencyTests-39572979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:51 devstack sudo[101584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a Sep 23 00:25:51 devstack sudo[101584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:51 devstack sudo[101584]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-46da06ec-2da1-4dac-bc8c-bb429e685de7 tempest-SnapshotDependencyTests-39572979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a" returned: 0 in 0.517s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-46da06ec-2da1-4dac-bc8c-bb429e685de7 tempest-SnapshotDependencyTests-39572979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:51 devstack sudo[101589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a Sep 23 00:25:51 devstack sudo[101589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:52 devstack sudo[101589]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-46da06ec-2da1-4dac-bc8c-bb429e685de7 tempest-SnapshotDependencyTests-39572979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a" returned: 0 in 0.526s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:52 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-46da06ec-2da1-4dac-bc8c-bb429e685de7 tempest-SnapshotDependencyTests-39572979 None] Lock "cinder-quobyte-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a" released by "delete_volume" :: held 1.143s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:52 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-46da06ec-2da1-4dac-bc8c-bb429e685de7 tempest-SnapshotDependencyTests-39572979 None] Created reservations ['c21c39c2-4a52-4ec0-907b-4214b9b037bd', '8e36b011-933e-47c9-ab4e-e3602a3b09f4', '06864b15-8529-457c-ad76-ea06469f710e', 'de7758d1-bd62-4f6d-b04c-095fb0bcc67a'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:25:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-46da06ec-2da1-4dac-bc8c-bb429e685de7 tempest-SnapshotDependencyTests-39572979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-46da06ec-2da1-4dac-bc8c-bb429e685de7 tempest-SnapshotDependencyTests-39572979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:52 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-46da06ec-2da1-4dac-bc8c-bb429e685de7 tempest-SnapshotDependencyTests-39572979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:52 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-46da06ec-2da1-4dac-bc8c-bb429e685de7 tempest-SnapshotDependencyTests-39572979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-46da06ec-2da1-4dac-bc8c-bb429e685de7 tempest-SnapshotDependencyTests-39572979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-46da06ec-2da1-4dac-bc8c-bb429e685de7 tempest-SnapshotDependencyTests-39572979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:52 devstack sudo[101594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:25:52 devstack sudo[101594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:52 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-53d23421-e3f1-404f-be57-9e4128c50a71 tempest-GroupsV314Test-881346209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:25:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53d23421-e3f1-404f-be57-9e4128c50a71 tempest-GroupsV314Test-881346209 None] Flow 'volume_create_manager' (4cf9559a-79b0-4fb0-9474-03f6e4ffeab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53d23421-e3f1-404f-be57-9e4128c50a71 tempest-GroupsV314Test-881346209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d26444a-83da-4706-904a-45f5be8cc141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53d23421-e3f1-404f-be57-9e4128c50a71 tempest-GroupsV314Test-881346209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d26444a-83da-4706-904a-45f5be8cc141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-200548685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a6811e3f-f174-42df-9ec2-f8e6f39ec04a,host='devstack@QuobyteHD#QuobyteHD',id=cf99786d-8b2a-419e-be4e-ed4cbc218bf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd6b0bab227c40568b75394ded134c82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:53Z,use_quota=True,user_id='21195b36c1ff41e39dcf7c8b8d6d157e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73da3afb-ccb9-4bd1-b52c-a297261efa72),volume_type_id=73da3afb-ccb9-4bd1-b52c-a297261efa72)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53d23421-e3f1-404f-be57-9e4128c50a71 tempest-GroupsV314Test-881346209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c542dee2-1354-4bc3-bc0e-07f905036cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53d23421-e3f1-404f-be57-9e4128c50a71 tempest-GroupsV314Test-881346209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c542dee2-1354-4bc3-bc0e-07f905036cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53d23421-e3f1-404f-be57-9e4128c50a71 tempest-GroupsV314Test-881346209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6c7b1c3-8bc1-4a3b-98e9-00001eb72a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53d23421-e3f1-404f-be57-9e4128c50a71 tempest-GroupsV314Test-881346209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6c7b1c3-8bc1-4a3b-98e9-00001eb72a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf99786d-8b2a-419e-be4e-ed4cbc218bf1', 'volume_name': 'volume-cf99786d-8b2a-419e-be4e-ed4cbc218bf1', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53d23421-e3f1-404f-be57-9e4128c50a71 tempest-GroupsV314Test-881346209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5fe5ff7-b998-4bae-99f9-094938fcace7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53d23421-e3f1-404f-be57-9e4128c50a71 tempest-GroupsV314Test-881346209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5fe5ff7-b998-4bae-99f9-094938fcace7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:52 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53d23421-e3f1-404f-be57-9e4128c50a71 tempest-GroupsV314Test-881346209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c330d75-31f0-427a-ad4a-345db294192b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:52 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-53d23421-e3f1-404f-be57-9e4128c50a71 tempest-GroupsV314Test-881346209 None] Volume cf99786d-8b2a-419e-be4e-ed4cbc218bf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf99786d-8b2a-419e-be4e-ed4cbc218bf1', 'volume_size': 1} Sep 23 00:25:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-53d23421-e3f1-404f-be57-9e4128c50a71 tempest-GroupsV314Test-881346209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-53d23421-e3f1-404f-be57-9e4128c50a71 tempest-GroupsV314Test-881346209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:52 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-53d23421-e3f1-404f-be57-9e4128c50a71 tempest-GroupsV314Test-881346209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a6811e3f-f174-42df-9ec2-f8e6f39ec04a,created_at=2026-09-22T22:25:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-200548685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a6811e3f-f174-42df-9ec2-f8e6f39ec04a,host='devstack@QuobyteHD#QuobyteHD',id=cf99786d-8b2a-419e-be4e-ed4cbc218bf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd6b0bab227c40568b75394ded134c82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:53Z,use_quota=True,user_id='21195b36c1ff41e39dcf7c8b8d6d157e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73da3afb-ccb9-4bd1-b52c-a297261efa72),volume_type_id=73da3afb-ccb9-4bd1-b52c-a297261efa72)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:25:52 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-53d23421-e3f1-404f-be57-9e4128c50a71 tempest-GroupsV314Test-881346209 None] Creating volume cf99786d-8b2a-419e-be4e-ed4cbc218bf1 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:25:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-53d23421-e3f1-404f-be57-9e4128c50a71 tempest-GroupsV314Test-881346209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-53d23421-e3f1-404f-be57-9e4128c50a71 tempest-GroupsV314Test-881346209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:52 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-53d23421-e3f1-404f-be57-9e4128c50a71 tempest-GroupsV314Test-881346209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:52 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-53d23421-e3f1-404f-be57-9e4128c50a71 tempest-GroupsV314Test-881346209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-53d23421-e3f1-404f-be57-9e4128c50a71 tempest-GroupsV314Test-881346209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:52 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-53d23421-e3f1-404f-be57-9e4128c50a71 tempest-GroupsV314Test-881346209 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:25:52 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-53d23421-e3f1-404f-be57-9e4128c50a71 tempest-GroupsV314Test-881346209 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:25:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-53d23421-e3f1-404f-be57-9e4128c50a71 tempest-GroupsV314Test-881346209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf99786d-8b2a-419e-be4e-ed4cbc218bf1 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:52 devstack sudo[101596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf99786d-8b2a-419e-be4e-ed4cbc218bf1 1073741824 Sep 23 00:25:52 devstack sudo[101596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:53 devstack sudo[101594]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-46da06ec-2da1-4dac-bc8c-bb429e685de7 tempest-SnapshotDependencyTests-39572979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.398s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:53 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-46da06ec-2da1-4dac-bc8c-bb429e685de7 tempest-SnapshotDependencyTests-39572979 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:25:53 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-46da06ec-2da1-4dac-bc8c-bb429e685de7 tempest-SnapshotDependencyTests-39572979 None] Deleted volume successfully. Sep 23 00:25:53 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-46da06ec-2da1-4dac-bc8c-bb429e685de7 tempest-SnapshotDependencyTests-39572979 None] Lock "cinder-8dcfc1a3-0369-4a00-bb0d-6781a5d85f2a-delete_volume" released by "delete_volume" :: held 1.917s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:53 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-dfb605be-3096-4700-9075-e1303554d0a6 tempest-SnapshotDependencyTests-39572979 None] Acquiring lock "cinder-ea5a85d1-7e20-4736-ac70-d9d07b3e7cc4-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:53 devstack sudo[101596]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-53d23421-e3f1-404f-be57-9e4128c50a71 tempest-GroupsV314Test-881346209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf99786d-8b2a-419e-be4e-ed4cbc218bf1 1073741824" returned: 0 in 0.713s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:53 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-dfb605be-3096-4700-9075-e1303554d0a6 tempest-SnapshotDependencyTests-39572979 None] Lock "cinder-ea5a85d1-7e20-4736-ac70-d9d07b3e7cc4-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-53d23421-e3f1-404f-be57-9e4128c50a71 tempest-GroupsV314Test-881346209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf99786d-8b2a-419e-be4e-ed4cbc218bf1 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:53 devstack sudo[101602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf99786d-8b2a-419e-be4e-ed4cbc218bf1 Sep 23 00:25:53 devstack sudo[101602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:53 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-dfb605be-3096-4700-9075-e1303554d0a6 tempest-SnapshotDependencyTests-39572979 None] Acquiring lock "cinder-quobyte-ea5a85d1-7e20-4736-ac70-d9d07b3e7cc4" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:53 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-dfb605be-3096-4700-9075-e1303554d0a6 tempest-SnapshotDependencyTests-39572979 None] Lock "cinder-quobyte-ea5a85d1-7e20-4736-ac70-d9d07b3e7cc4" acquired by "delete_volume" :: waited 0.027s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:53 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[613425ac-5d70-4619-99e5-6e04a525ea8d]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dfb605be-3096-4700-9075-e1303554d0a6 tempest-SnapshotDependencyTests-39572979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ea5a85d1-7e20-4736-ac70-d9d07b3e7cc4 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:53 devstack sudo[101604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ea5a85d1-7e20-4736-ac70-d9d07b3e7cc4 Sep 23 00:25:53 devstack sudo[101604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:54 devstack sudo[101602]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-53d23421-e3f1-404f-be57-9e4128c50a71 tempest-GroupsV314Test-881346209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf99786d-8b2a-419e-be4e-ed4cbc218bf1" returned: 0 in 0.411s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-53d23421-e3f1-404f-be57-9e4128c50a71 tempest-GroupsV314Test-881346209 None] <== create_volume: return (1212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:25:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-53d23421-e3f1-404f-be57-9e4128c50a71 tempest-GroupsV314Test-881346209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.215s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53d23421-e3f1-404f-be57-9e4128c50a71 tempest-GroupsV314Test-881346209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c330d75-31f0-427a-ad4a-345db294192b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf99786d-8b2a-419e-be4e-ed4cbc218bf1', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53d23421-e3f1-404f-be57-9e4128c50a71 tempest-GroupsV314Test-881346209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8d45714-deb9-4f11-acae-24d0d95b7939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:54 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-53d23421-e3f1-404f-be57-9e4128c50a71 tempest-GroupsV314Test-881346209 None] Volume volume-cf99786d-8b2a-419e-be4e-ed4cbc218bf1 (cf99786d-8b2a-419e-be4e-ed4cbc218bf1): created successfully Sep 23 00:25:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53d23421-e3f1-404f-be57-9e4128c50a71 tempest-GroupsV314Test-881346209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8d45714-deb9-4f11-acae-24d0d95b7939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-53d23421-e3f1-404f-be57-9e4128c50a71 tempest-GroupsV314Test-881346209 None] Flow 'volume_create_manager' (4cf9559a-79b0-4fb0-9474-03f6e4ffeab0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:54 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-53d23421-e3f1-404f-be57-9e4128c50a71 tempest-GroupsV314Test-881346209 None] Created volume successfully. Sep 23 00:25:54 devstack sudo[101604]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dfb605be-3096-4700-9075-e1303554d0a6 tempest-SnapshotDependencyTests-39572979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ea5a85d1-7e20-4736-ac70-d9d07b3e7cc4" returned: 0 in 0.542s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dfb605be-3096-4700-9075-e1303554d0a6 tempest-SnapshotDependencyTests-39572979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ea5a85d1-7e20-4736-ac70-d9d07b3e7cc4 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:54 devstack sudo[101610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ea5a85d1-7e20-4736-ac70-d9d07b3e7cc4 Sep 23 00:25:54 devstack sudo[101610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:54 devstack sudo[101610]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dfb605be-3096-4700-9075-e1303554d0a6 tempest-SnapshotDependencyTests-39572979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ea5a85d1-7e20-4736-ac70-d9d07b3e7cc4" returned: 0 in 0.308s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:54 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-dfb605be-3096-4700-9075-e1303554d0a6 tempest-SnapshotDependencyTests-39572979 None] Lock "cinder-quobyte-ea5a85d1-7e20-4736-ac70-d9d07b3e7cc4" released by "delete_volume" :: held 0.921s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:54 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-dfb605be-3096-4700-9075-e1303554d0a6 tempest-SnapshotDependencyTests-39572979 None] Created reservations ['6ad798e8-0c1c-460b-8c2a-1f784a525511', '36027c7f-f84d-44f6-869b-b915adb44562', '56ce606c-26ee-4eba-b1f3-6f7c31d7d1bc', '7bf030d9-d7e9-4b3a-ac54-72a443cdb888'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:25:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-dfb605be-3096-4700-9075-e1303554d0a6 tempest-SnapshotDependencyTests-39572979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-dfb605be-3096-4700-9075-e1303554d0a6 tempest-SnapshotDependencyTests-39572979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-dfb605be-3096-4700-9075-e1303554d0a6 tempest-SnapshotDependencyTests-39572979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-dfb605be-3096-4700-9075-e1303554d0a6 tempest-SnapshotDependencyTests-39572979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-dfb605be-3096-4700-9075-e1303554d0a6 tempest-SnapshotDependencyTests-39572979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dfb605be-3096-4700-9075-e1303554d0a6 tempest-SnapshotDependencyTests-39572979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:54 devstack sudo[101613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:25:54 devstack sudo[101613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:55 devstack sudo[101613]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dfb605be-3096-4700-9075-e1303554d0a6 tempest-SnapshotDependencyTests-39572979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.476s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:55 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-dfb605be-3096-4700-9075-e1303554d0a6 tempest-SnapshotDependencyTests-39572979 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:25:55 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-dfb605be-3096-4700-9075-e1303554d0a6 tempest-SnapshotDependencyTests-39572979 None] Deleted volume successfully. Sep 23 00:25:55 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-dfb605be-3096-4700-9075-e1303554d0a6 tempest-SnapshotDependencyTests-39572979 None] Lock "cinder-ea5a85d1-7e20-4736-ac70-d9d07b3e7cc4-delete_volume" released by "delete_volume" :: held 1.773s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:55 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-d16f0f23-bcfe-4a1d-bfc1-2eb2d878590b tempest-TestInstancesWithCinderVolumes-529309143 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_29fd2cca-3af4-492c-9f7d-c806b35072b1_mojgogaxdevstack@QuobyteHD, size 20.69 MB, duration 5.98 sec {{(pid=86591) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 00:25:55 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-d16f0f23-bcfe-4a1d-bfc1-2eb2d878590b tempest-TestInstancesWithCinderVolumes-529309143 None] Image download 20.69 MB at 3.46 MB/s Sep 23 00:25:55 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[afbeeb63-8872-4b29-acaf-904f658dbc63]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d16f0f23-bcfe-4a1d-bfc1-2eb2d878590b tempest-TestInstancesWithCinderVolumes-529309143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_29fd2cca-3af4-492c-9f7d-c806b35072b1_mojgogaxdevstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:55 devstack sudo[101616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_29fd2cca-3af4-492c-9f7d-c806b35072b1_mojgogaxdevstack@QuobyteHD Sep 23 00:25:55 devstack sudo[101616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2be38dcd-0130-4f04-bd19-4eb874e30940 tempest-GroupsV314Test-881346209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2be38dcd-0130-4f04-bd19-4eb874e30940 tempest-GroupsV314Test-881346209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:56 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-2be38dcd-0130-4f04-bd19-4eb874e30940 tempest-GroupsV314Test-881346209 None] Cloning volume cf99786d-8b2a-419e-be4e-ed4cbc218bf1 to volume ea5488dd-5c49-4cec-9b89-73a537503235 Sep 23 00:25:56 devstack sudo[101616]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d16f0f23-bcfe-4a1d-bfc1-2eb2d878590b tempest-TestInstancesWithCinderVolumes-529309143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_29fd2cca-3af4-492c-9f7d-c806b35072b1_mojgogaxdevstack@QuobyteHD" returned: 0 in 0.548s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:56 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-d16f0f23-bcfe-4a1d-bfc1-2eb2d878590b tempest-TestInstancesWithCinderVolumes-529309143 None] Temporary image 29fd2cca-3af4-492c-9f7d-c806b35072b1 is fetched for user 88aed1b0bd8e4836b0fb94f21e3d0456. {{(pid=86591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 00:25:56 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-2be38dcd-0130-4f04-bd19-4eb874e30940 tempest-GroupsV314Test-881346209 None] Creating offline snapshot e9193301-2394-4209-a216-e5c8c4f0fcd9 of volume cf99786d-8b2a-419e-be4e-ed4cbc218bf1 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:25:56 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0604aef-ae0c-4ce1-ac3e-727ec627bc8b]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2be38dcd-0130-4f04-bd19-4eb874e30940 tempest-GroupsV314Test-881346209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf99786d-8b2a-419e-be4e-ed4cbc218bf1 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:56 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a5a469-4c15-4b00-8023-6e59bb3d662a]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d16f0f23-bcfe-4a1d-bfc1-2eb2d878590b tempest-TestInstancesWithCinderVolumes-529309143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_29fd2cca-3af4-492c-9f7d-c806b35072b1_mojgogaxdevstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:56 devstack sudo[101623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_29fd2cca-3af4-492c-9f7d-c806b35072b1_mojgogaxdevstack@QuobyteHD Sep 23 00:25:56 devstack sudo[101623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:56 devstack sudo[101622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf99786d-8b2a-419e-be4e-ed4cbc218bf1 Sep 23 00:25:56 devstack sudo[101622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:57 devstack sudo[101623]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d16f0f23-bcfe-4a1d-bfc1-2eb2d878590b tempest-TestInstancesWithCinderVolumes-529309143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_29fd2cca-3af4-492c-9f7d-c806b35072b1_mojgogaxdevstack@QuobyteHD" returned: 0 in 0.624s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d16f0f23-bcfe-4a1d-bfc1-2eb2d878590b tempest-TestInstancesWithCinderVolumes-529309143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:57 devstack sudo[101622]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2be38dcd-0130-4f04-bd19-4eb874e30940 tempest-GroupsV314Test-881346209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf99786d-8b2a-419e-be4e-ed4cbc218bf1" returned: 0 in 0.695s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2be38dcd-0130-4f04-bd19-4eb874e30940 tempest-GroupsV314Test-881346209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf99786d-8b2a-419e-be4e-ed4cbc218bf1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf99786d-8b2a-419e-be4e-ed4cbc218bf1.e9193301-2394-4209-a216-e5c8c4f0fcd9 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:57 devstack sudo[101634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf99786d-8b2a-419e-be4e-ed4cbc218bf1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf99786d-8b2a-419e-be4e-ed4cbc218bf1.e9193301-2394-4209-a216-e5c8c4f0fcd9 1G Sep 23 00:25:57 devstack sudo[101634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:57 devstack sudo[101634]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2be38dcd-0130-4f04-bd19-4eb874e30940 tempest-GroupsV314Test-881346209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf99786d-8b2a-419e-be4e-ed4cbc218bf1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf99786d-8b2a-419e-be4e-ed4cbc218bf1.e9193301-2394-4209-a216-e5c8c4f0fcd9 1G" returned: 0 in 0.530s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2be38dcd-0130-4f04-bd19-4eb874e30940 tempest-GroupsV314Test-881346209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf99786d-8b2a-419e-be4e-ed4cbc218bf1 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf99786d-8b2a-419e-be4e-ed4cbc218bf1.e9193301-2394-4209-a216-e5c8c4f0fcd9 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:57 devstack sudo[101640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf99786d-8b2a-419e-be4e-ed4cbc218bf1 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf99786d-8b2a-419e-be4e-ed4cbc218bf1.e9193301-2394-4209-a216-e5c8c4f0fcd9 Sep 23 00:25:57 devstack sudo[101640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:58 devstack sudo[101640]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2be38dcd-0130-4f04-bd19-4eb874e30940 tempest-GroupsV314Test-881346209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf99786d-8b2a-419e-be4e-ed4cbc218bf1 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf99786d-8b2a-419e-be4e-ed4cbc218bf1.e9193301-2394-4209-a216-e5c8c4f0fcd9" returned: 0 in 0.448s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:58 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-2be38dcd-0130-4f04-bd19-4eb874e30940 tempest-GroupsV314Test-881346209 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf99786d-8b2a-419e-be4e-ed4cbc218bf1.e9193301-2394-4209-a216-e5c8c4f0fcd9 is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:25:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2be38dcd-0130-4f04-bd19-4eb874e30940 tempest-GroupsV314Test-881346209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf99786d-8b2a-419e-be4e-ed4cbc218bf1.e9193301-2394-4209-a216-e5c8c4f0fcd9 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:58 devstack sudo[101646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf99786d-8b2a-419e-be4e-ed4cbc218bf1.e9193301-2394-4209-a216-e5c8c4f0fcd9 Sep 23 00:25:58 devstack sudo[101646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:58 devstack sudo[101646]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2be38dcd-0130-4f04-bd19-4eb874e30940 tempest-GroupsV314Test-881346209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf99786d-8b2a-419e-be4e-ed4cbc218bf1.e9193301-2394-4209-a216-e5c8c4f0fcd9" returned: 0 in 0.343s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2be38dcd-0130-4f04-bd19-4eb874e30940 tempest-GroupsV314Test-881346209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf99786d-8b2a-419e-be4e-ed4cbc218bf1.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:58 devstack sudo[101651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf99786d-8b2a-419e-be4e-ed4cbc218bf1.info Sep 23 00:25:58 devstack sudo[101651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:58 devstack sudo[101651]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2be38dcd-0130-4f04-bd19-4eb874e30940 tempest-GroupsV314Test-881346209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf99786d-8b2a-419e-be4e-ed4cbc218bf1.info" returned: 0 in 0.370s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:58 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-2be38dcd-0130-4f04-bd19-4eb874e30940 tempest-GroupsV314Test-881346209 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf99786d-8b2a-419e-be4e-ed4cbc218bf1.info is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:25:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2be38dcd-0130-4f04-bd19-4eb874e30940 tempest-GroupsV314Test-881346209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf99786d-8b2a-419e-be4e-ed4cbc218bf1.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:58 devstack sudo[101654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf99786d-8b2a-419e-be4e-ed4cbc218bf1.info Sep 23 00:25:58 devstack sudo[101654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:59 devstack sudo[101654]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2be38dcd-0130-4f04-bd19-4eb874e30940 tempest-GroupsV314Test-881346209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf99786d-8b2a-419e-be4e-ed4cbc218bf1.info" returned: 0 in 0.343s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:59 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-2be38dcd-0130-4f04-bd19-4eb874e30940 tempest-GroupsV314Test-881346209 None] Acquiring lock "cinder-quobyte-ea5488dd-5c49-4cec-9b89-73a537503235" by "_copy_volume_from_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:59 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-2be38dcd-0130-4f04-bd19-4eb874e30940 tempest-GroupsV314Test-881346209 None] Lock "cinder-quobyte-ea5488dd-5c49-4cec-9b89-73a537503235" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2be38dcd-0130-4f04-bd19-4eb874e30940 tempest-GroupsV314Test-881346209 None] snapshot: e9193301-2394-4209-a216-e5c8c4f0fcd9, volume: ea5488dd-5c49-4cec-9b89-73a537503235, {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:25:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2be38dcd-0130-4f04-bd19-4eb874e30940 tempest-GroupsV314Test-881346209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2be38dcd-0130-4f04-bd19-4eb874e30940 tempest-GroupsV314Test-881346209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2be38dcd-0130-4f04-bd19-4eb874e30940 tempest-GroupsV314Test-881346209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2be38dcd-0130-4f04-bd19-4eb874e30940 tempest-GroupsV314Test-881346209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2be38dcd-0130-4f04-bd19-4eb874e30940 tempest-GroupsV314Test-881346209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:59 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[f671d49b-6721-4b3d-bca8-38e4387b7a6d]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2be38dcd-0130-4f04-bd19-4eb874e30940 tempest-GroupsV314Test-881346209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf99786d-8b2a-419e-be4e-ed4cbc218bf1.e9193301-2394-4209-a216-e5c8c4f0fcd9 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:59 devstack sudo[101657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf99786d-8b2a-419e-be4e-ed4cbc218bf1.e9193301-2394-4209-a216-e5c8c4f0fcd9 Sep 23 00:25:59 devstack sudo[101657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:59 devstack sudo[101657]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2be38dcd-0130-4f04-bd19-4eb874e30940 tempest-GroupsV314Test-881346209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf99786d-8b2a-419e-be4e-ed4cbc218bf1.e9193301-2394-4209-a216-e5c8c4f0fcd9" returned: 0 in 0.427s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-2be38dcd-0130-4f04-bd19-4eb874e30940 tempest-GroupsV314Test-881346209 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf99786d-8b2a-419e-be4e-ed4cbc218bf1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:25:59 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ecce1ad-4663-416d-a752-878e7aae9d36]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2be38dcd-0130-4f04-bd19-4eb874e30940 tempest-GroupsV314Test-881346209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf99786d-8b2a-419e-be4e-ed4cbc218bf1 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:59 devstack sudo[101664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf99786d-8b2a-419e-be4e-ed4cbc218bf1 Sep 23 00:25:59 devstack sudo[101664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:00 devstack sudo[101664]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2be38dcd-0130-4f04-bd19-4eb874e30940 tempest-GroupsV314Test-881346209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf99786d-8b2a-419e-be4e-ed4cbc218bf1" returned: 0 in 0.441s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:00 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2be38dcd-0130-4f04-bd19-4eb874e30940 tempest-GroupsV314Test-881346209 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf99786d-8b2a-419e-be4e-ed4cbc218bf1 {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:26:00 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2be38dcd-0130-4f04-bd19-4eb874e30940 tempest-GroupsV314Test-881346209 None] Creating direct copy from snapshot {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:26:00 devstack cinder-volume[86591]: DEBUG cinder.utils [None req-2be38dcd-0130-4f04-bd19-4eb874e30940 tempest-GroupsV314Test-881346209 None] Path /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ea5488dd-5c49-4cec-9b89-73a537503235 not found in is_blk_device check {{(pid=86591) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:26:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2be38dcd-0130-4f04-bd19-4eb874e30940 tempest-GroupsV314Test-881346209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf99786d-8b2a-419e-be4e-ed4cbc218bf1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ea5488dd-5c49-4cec-9b89-73a537503235 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:00 devstack sudo[101669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf99786d-8b2a-419e-be4e-ed4cbc218bf1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ea5488dd-5c49-4cec-9b89-73a537503235 Sep 23 00:26:00 devstack sudo[101669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:08 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=59,cinder:UPDATE=58,cinder:INSERT=15,cinder:DELETE=3 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:26:08 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=67,cinder:UPDATE=74,cinder:INSERT=19,cinder:DELETE=6 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:26:08 devstack sudo[101669]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2be38dcd-0130-4f04-bd19-4eb874e30940 tempest-GroupsV314Test-881346209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf99786d-8b2a-419e-be4e-ed4cbc218bf1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ea5488dd-5c49-4cec-9b89-73a537503235" returned: 0 in 8.730s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:08 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-2be38dcd-0130-4f04-bd19-4eb874e30940 tempest-GroupsV314Test-881346209 None] Image conversion details: src /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf99786d-8b2a-419e-be4e-ed4cbc218bf1, size 1024.00 MB, duration 8.73 sec, destination /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ea5488dd-5c49-4cec-9b89-73a537503235 {{(pid=86591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:26:08 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-2be38dcd-0130-4f04-bd19-4eb874e30940 tempest-GroupsV314Test-881346209 None] Converted 1024.00 MB image at 117.28 MB/s Sep 23 00:26:08 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-2be38dcd-0130-4f04-bd19-4eb874e30940 tempest-GroupsV314Test-881346209 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ea5488dd-5c49-4cec-9b89-73a537503235 is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:26:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2be38dcd-0130-4f04-bd19-4eb874e30940 tempest-GroupsV314Test-881346209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ea5488dd-5c49-4cec-9b89-73a537503235 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:09 devstack sudo[101687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ea5488dd-5c49-4cec-9b89-73a537503235 Sep 23 00:26:09 devstack sudo[101687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:09 devstack sudo[101687]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2be38dcd-0130-4f04-bd19-4eb874e30940 tempest-GroupsV314Test-881346209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ea5488dd-5c49-4cec-9b89-73a537503235" returned: 0 in 0.320s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:09 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-2be38dcd-0130-4f04-bd19-4eb874e30940 tempest-GroupsV314Test-881346209 None] Lock "cinder-quobyte-ea5488dd-5c49-4cec-9b89-73a537503235" released by "_copy_volume_from_snapshot" :: held 10.064s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:09 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-2be38dcd-0130-4f04-bd19-4eb874e30940 tempest-GroupsV314Test-881346209 None] Acquiring lock "cinder-quobyte-e9193301-2394-4209-a216-e5c8c4f0fcd9" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:09 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-2be38dcd-0130-4f04-bd19-4eb874e30940 tempest-GroupsV314Test-881346209 None] Lock "cinder-quobyte-e9193301-2394-4209-a216-e5c8c4f0fcd9" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:09 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-2be38dcd-0130-4f04-bd19-4eb874e30940 tempest-GroupsV314Test-881346209 None] Deleting offline snapshot e9193301-2394-4209-a216-e5c8c4f0fcd9 of volume cf99786d-8b2a-419e-be4e-ed4cbc218bf1 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:26:09 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-2be38dcd-0130-4f04-bd19-4eb874e30940 tempest-GroupsV314Test-881346209 None] snapshot_file for this snap is: volume-cf99786d-8b2a-419e-be4e-ed4cbc218bf1.e9193301-2394-4209-a216-e5c8c4f0fcd9 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:26:09 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb79a72a-7dc7-4948-aff8-7f5e657c9624]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2be38dcd-0130-4f04-bd19-4eb874e30940 tempest-GroupsV314Test-881346209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf99786d-8b2a-419e-be4e-ed4cbc218bf1.e9193301-2394-4209-a216-e5c8c4f0fcd9 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:09 devstack sudo[101690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf99786d-8b2a-419e-be4e-ed4cbc218bf1.e9193301-2394-4209-a216-e5c8c4f0fcd9 Sep 23 00:26:09 devstack sudo[101690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:09 devstack sudo[101690]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2be38dcd-0130-4f04-bd19-4eb874e30940 tempest-GroupsV314Test-881346209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf99786d-8b2a-419e-be4e-ed4cbc218bf1.e9193301-2394-4209-a216-e5c8c4f0fcd9" returned: 0 in 0.450s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:09 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-2be38dcd-0130-4f04-bd19-4eb874e30940 tempest-GroupsV314Test-881346209 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf99786d-8b2a-419e-be4e-ed4cbc218bf1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:26:09 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[8125e7dd-d044-4b1a-8adf-76124894eaa9]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2be38dcd-0130-4f04-bd19-4eb874e30940 tempest-GroupsV314Test-881346209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf99786d-8b2a-419e-be4e-ed4cbc218bf1 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:10 devstack sudo[101695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf99786d-8b2a-419e-be4e-ed4cbc218bf1 Sep 23 00:26:10 devstack sudo[101695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:10 devstack sudo[101695]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2be38dcd-0130-4f04-bd19-4eb874e30940 tempest-GroupsV314Test-881346209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf99786d-8b2a-419e-be4e-ed4cbc218bf1" returned: 0 in 0.861s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2be38dcd-0130-4f04-bd19-4eb874e30940 tempest-GroupsV314Test-881346209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf99786d-8b2a-419e-be4e-ed4cbc218bf1.e9193301-2394-4209-a216-e5c8c4f0fcd9 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:10 devstack sudo[101706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf99786d-8b2a-419e-be4e-ed4cbc218bf1.e9193301-2394-4209-a216-e5c8c4f0fcd9 Sep 23 00:26:10 devstack sudo[101706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:11 devstack sudo[101706]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2be38dcd-0130-4f04-bd19-4eb874e30940 tempest-GroupsV314Test-881346209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf99786d-8b2a-419e-be4e-ed4cbc218bf1.e9193301-2394-4209-a216-e5c8c4f0fcd9" returned: 0 in 0.515s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2be38dcd-0130-4f04-bd19-4eb874e30940 tempest-GroupsV314Test-881346209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf99786d-8b2a-419e-be4e-ed4cbc218bf1.e9193301-2394-4209-a216-e5c8c4f0fcd9 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:11 devstack sudo[101711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf99786d-8b2a-419e-be4e-ed4cbc218bf1.e9193301-2394-4209-a216-e5c8c4f0fcd9 Sep 23 00:26:11 devstack sudo[101711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:11 devstack sudo[101711]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2be38dcd-0130-4f04-bd19-4eb874e30940 tempest-GroupsV314Test-881346209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf99786d-8b2a-419e-be4e-ed4cbc218bf1.e9193301-2394-4209-a216-e5c8c4f0fcd9" returned: 0 in 0.365s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:11 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-2be38dcd-0130-4f04-bd19-4eb874e30940 tempest-GroupsV314Test-881346209 None] Lock "cinder-quobyte-e9193301-2394-4209-a216-e5c8c4f0fcd9" released by "_delete_snapshot" :: held 2.345s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2be38dcd-0130-4f04-bd19-4eb874e30940 tempest-GroupsV314Test-881346209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.543s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d16f0f23-bcfe-4a1d-bfc1-2eb2d878590b tempest-TestInstancesWithCinderVolumes-529309143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.688s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:11 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d16f0f23-bcfe-4a1d-bfc1-2eb2d878590b tempest-TestInstancesWithCinderVolumes-529309143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1874386895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea0e1ce5-eada-4735-a408-9f67ef644e00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='980a65d793a74e4ab4d4586a713df155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:48Z,use_quota=True,user_id='88aed1b0bd8e4836b0fb94f21e3d0456',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bcdb38f2-3197-4d9a-8bbb-760fc13f463a),volume_type_id=bcdb38f2-3197-4d9a-8bbb-760fc13f463a)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:26:11 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-d16f0f23-bcfe-4a1d-bfc1-2eb2d878590b tempest-TestInstancesWithCinderVolumes-529309143 None] Creating volume ea0e1ce5-eada-4735-a408-9f67ef644e00 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:26:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d16f0f23-bcfe-4a1d-bfc1-2eb2d878590b tempest-TestInstancesWithCinderVolumes-529309143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d16f0f23-bcfe-4a1d-bfc1-2eb2d878590b tempest-TestInstancesWithCinderVolumes-529309143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:11 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d16f0f23-bcfe-4a1d-bfc1-2eb2d878590b tempest-TestInstancesWithCinderVolumes-529309143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:11 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d16f0f23-bcfe-4a1d-bfc1-2eb2d878590b tempest-TestInstancesWithCinderVolumes-529309143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d16f0f23-bcfe-4a1d-bfc1-2eb2d878590b tempest-TestInstancesWithCinderVolumes-529309143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:11 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d16f0f23-bcfe-4a1d-bfc1-2eb2d878590b tempest-TestInstancesWithCinderVolumes-529309143 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:26:11 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-d16f0f23-bcfe-4a1d-bfc1-2eb2d878590b tempest-TestInstancesWithCinderVolumes-529309143 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:26:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d16f0f23-bcfe-4a1d-bfc1-2eb2d878590b tempest-TestInstancesWithCinderVolumes-529309143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ea0e1ce5-eada-4735-a408-9f67ef644e00 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:11 devstack sudo[101714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ea0e1ce5-eada-4735-a408-9f67ef644e00 1073741824 Sep 23 00:26:11 devstack sudo[101714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:11 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-2be38dcd-0130-4f04-bd19-4eb874e30940 tempest-GroupsV314Test-881346209 None] Create group from source-group-a6811e3f-f174-42df-9ec2-f8e6f39ec04a completed successfully. Sep 23 00:26:12 devstack sudo[101714]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d16f0f23-bcfe-4a1d-bfc1-2eb2d878590b tempest-TestInstancesWithCinderVolumes-529309143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ea0e1ce5-eada-4735-a408-9f67ef644e00 1073741824" returned: 0 in 0.686s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d16f0f23-bcfe-4a1d-bfc1-2eb2d878590b tempest-TestInstancesWithCinderVolumes-529309143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ea0e1ce5-eada-4735-a408-9f67ef644e00 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:12 devstack sudo[101720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ea0e1ce5-eada-4735-a408-9f67ef644e00 Sep 23 00:26:12 devstack sudo[101720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:12 devstack sudo[101720]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d16f0f23-bcfe-4a1d-bfc1-2eb2d878590b tempest-TestInstancesWithCinderVolumes-529309143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ea0e1ce5-eada-4735-a408-9f67ef644e00" returned: 0 in 0.401s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:12 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d16f0f23-bcfe-4a1d-bfc1-2eb2d878590b tempest-TestInstancesWithCinderVolumes-529309143 None] <== create_volume: return (1182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:26:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d16f0f23-bcfe-4a1d-bfc1-2eb2d878590b tempest-TestInstancesWithCinderVolumes-529309143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.186s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:12 devstack cinder-volume[86591]: DEBUG cinder.volume.volume_utils [None req-d16f0f23-bcfe-4a1d-bfc1-2eb2d878590b tempest-TestInstancesWithCinderVolumes-529309143 None] Attempting download of 29fd2cca-3af4-492c-9f7d-c806b35072b1 ((None, [{'url': 'file:///opt/stack/data/glance/images/29fd2cca-3af4-492c-9f7d-c806b35072b1', 'metadata': {}}])) to volume ea0e1ce5-eada-4735-a408-9f67ef644e00. {{(pid=86591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 00:26:13 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b46a44b-9bbd-4f98-a03a-d17784e69cd6]: (4, 'raw') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d16f0f23-bcfe-4a1d-bfc1-2eb2d878590b tempest-TestInstancesWithCinderVolumes-529309143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_29fd2cca-3af4-492c-9f7d-c806b35072b1_wjtru44r {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:13 devstack sudo[101723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_29fd2cca-3af4-492c-9f7d-c806b35072b1_wjtru44r Sep 23 00:26:13 devstack sudo[101723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:13 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9d0dde8c-892c-48c2-bc28-2be37f1d30ca tempest-GroupsV314Test-881346209 None] Acquiring lock "cinder-quobyte-ea5488dd-5c49-4cec-9b89-73a537503235" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:13 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9d0dde8c-892c-48c2-bc28-2be37f1d30ca tempest-GroupsV314Test-881346209 None] Lock "cinder-quobyte-ea5488dd-5c49-4cec-9b89-73a537503235" acquired by "delete_volume" :: waited 0.025s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:13 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[82883e0c-5ccc-4206-869a-0c3d068ce232]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9d0dde8c-892c-48c2-bc28-2be37f1d30ca tempest-GroupsV314Test-881346209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ea5488dd-5c49-4cec-9b89-73a537503235 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:13 devstack sudo[101723]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d16f0f23-bcfe-4a1d-bfc1-2eb2d878590b tempest-TestInstancesWithCinderVolumes-529309143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_29fd2cca-3af4-492c-9f7d-c806b35072b1_wjtru44r" returned: 0 in 0.574s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d16f0f23-bcfe-4a1d-bfc1-2eb2d878590b tempest-TestInstancesWithCinderVolumes-529309143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_29fd2cca-3af4-492c-9f7d-c806b35072b1_wjtru44r {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:13 devstack sudo[101727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ea5488dd-5c49-4cec-9b89-73a537503235 Sep 23 00:26:13 devstack sudo[101727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:13 devstack sudo[101728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_29fd2cca-3af4-492c-9f7d-c806b35072b1_wjtru44r Sep 23 00:26:13 devstack sudo[101728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:14 devstack sudo[101727]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:14 devstack sudo[101728]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9d0dde8c-892c-48c2-bc28-2be37f1d30ca tempest-GroupsV314Test-881346209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ea5488dd-5c49-4cec-9b89-73a537503235" returned: 0 in 0.609s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d16f0f23-bcfe-4a1d-bfc1-2eb2d878590b tempest-TestInstancesWithCinderVolumes-529309143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_29fd2cca-3af4-492c-9f7d-c806b35072b1_wjtru44r" returned: 1 in 0.579s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d16f0f23-bcfe-4a1d-bfc1-2eb2d878590b tempest-TestInstancesWithCinderVolumes-529309143 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_29fd2cca-3af4-492c-9f7d-c806b35072b1_wjtru44r' failed. Not Retrying. {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:26:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9d0dde8c-892c-48c2-bc28-2be37f1d30ca tempest-GroupsV314Test-881346209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ea5488dd-5c49-4cec-9b89-73a537503235 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:14 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[6134c99d-fa61-4ab7-898f-32834b25c8d8]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d16f0f23-bcfe-4a1d-bfc1-2eb2d878590b tempest-TestInstancesWithCinderVolumes-529309143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_29fd2cca-3af4-492c-9f7d-c806b35072b1_mojgogaxdevstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:14 devstack sudo[101770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ea5488dd-5c49-4cec-9b89-73a537503235 Sep 23 00:26:14 devstack sudo[101770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:14 devstack sudo[101772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_29fd2cca-3af4-492c-9f7d-c806b35072b1_mojgogaxdevstack@QuobyteHD Sep 23 00:26:14 devstack sudo[101772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:14 devstack sudo[101770]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9d0dde8c-892c-48c2-bc28-2be37f1d30ca tempest-GroupsV314Test-881346209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ea5488dd-5c49-4cec-9b89-73a537503235" returned: 0 in 0.416s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:14 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9d0dde8c-892c-48c2-bc28-2be37f1d30ca tempest-GroupsV314Test-881346209 None] Lock "cinder-quobyte-ea5488dd-5c49-4cec-9b89-73a537503235" released by "delete_volume" :: held 1.113s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:14 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-9d0dde8c-892c-48c2-bc28-2be37f1d30ca tempest-GroupsV314Test-881346209 None] Created reservations ['1b74e06b-9bfa-4226-a1e6-d6ac1378bda2'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:26:14 devstack cinder-volume[86591]: WARNING cinder.quota [None req-9d0dde8c-892c-48c2-bc28-2be37f1d30ca tempest-GroupsV314Test-881346209 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-851483216 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-851483216, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:26:14 devstack cinder-volume[86591]: WARNING cinder.quota [None req-9d0dde8c-892c-48c2-bc28-2be37f1d30ca tempest-GroupsV314Test-881346209 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-851483216 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-851483216, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:26:15 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-9d0dde8c-892c-48c2-bc28-2be37f1d30ca tempest-GroupsV314Test-881346209 None] Created reservations ['0c1b5835-7697-42fa-987e-928735b53cdd', 'e6bbd1f3-ea48-44f1-933c-d1c2171a7f19', '0b8b331e-3568-48f5-8ef4-7fd56790ddf7', 'e3bafd15-ccd8-4fc1-9cf3-dda05849800a'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:26:15 devstack sudo[101772]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d16f0f23-bcfe-4a1d-bfc1-2eb2d878590b tempest-TestInstancesWithCinderVolumes-529309143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_29fd2cca-3af4-492c-9f7d-c806b35072b1_mojgogaxdevstack@QuobyteHD" returned: 0 in 0.841s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:15 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-d16f0f23-bcfe-4a1d-bfc1-2eb2d878590b tempest-TestInstancesWithCinderVolumes-529309143 None] 29fd2cca-3af4-492c-9f7d-c806b35072b1 was qcow2, converting to qcow2 {{(pid=86591) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 00:26:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d16f0f23-bcfe-4a1d-bfc1-2eb2d878590b tempest-TestInstancesWithCinderVolumes-529309143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_29fd2cca-3af4-492c-9f7d-c806b35072b1_mojgogaxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ea0e1ce5-eada-4735-a408-9f67ef644e00 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:15 devstack sudo[101781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_29fd2cca-3af4-492c-9f7d-c806b35072b1_mojgogaxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ea0e1ce5-eada-4735-a408-9f67ef644e00 Sep 23 00:26:15 devstack sudo[101781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9d0dde8c-892c-48c2-bc28-2be37f1d30ca tempest-GroupsV314Test-881346209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9d0dde8c-892c-48c2-bc28-2be37f1d30ca tempest-GroupsV314Test-881346209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:15 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9d0dde8c-892c-48c2-bc28-2be37f1d30ca tempest-GroupsV314Test-881346209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:15 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9d0dde8c-892c-48c2-bc28-2be37f1d30ca tempest-GroupsV314Test-881346209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9d0dde8c-892c-48c2-bc28-2be37f1d30ca tempest-GroupsV314Test-881346209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9d0dde8c-892c-48c2-bc28-2be37f1d30ca tempest-GroupsV314Test-881346209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:15 devstack sudo[101783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:26:15 devstack sudo[101783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:15 devstack sudo[101783]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9d0dde8c-892c-48c2-bc28-2be37f1d30ca tempest-GroupsV314Test-881346209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.437s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:15 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-9d0dde8c-892c-48c2-bc28-2be37f1d30ca tempest-GroupsV314Test-881346209 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:26:15 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-9d0dde8c-892c-48c2-bc28-2be37f1d30ca tempest-GroupsV314Test-881346209 None] Delete group completed successfully. Sep 23 00:26:16 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:26:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:16 devstack sudo[101796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:26:16 devstack sudo[101796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:16 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-fe187eb0-4dbe-4883-8ec8-76c4b3547e62 tempest-GroupsV314Test-881346209 None] Acquiring lock "cinder-quobyte-cf99786d-8b2a-419e-be4e-ed4cbc218bf1" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-fe187eb0-4dbe-4883-8ec8-76c4b3547e62 tempest-GroupsV314Test-881346209 None] Lock "cinder-quobyte-cf99786d-8b2a-419e-be4e-ed4cbc218bf1" acquired by "delete_volume" :: waited 0.047s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:17 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[0907b164-da67-4722-9408-599b941dd07f]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fe187eb0-4dbe-4883-8ec8-76c4b3547e62 tempest-GroupsV314Test-881346209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf99786d-8b2a-419e-be4e-ed4cbc218bf1 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:17 devstack sudo[101796]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.540s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:17 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:26:17 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running periodic task VolumeManager._thread_info {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:26:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] thread count: 29 {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:26:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] thread info: [<_MainThread(MainThread, started 135440660459648)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:26:17 devstack sudo[101799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf99786d-8b2a-419e-be4e-ed4cbc218bf1 Sep 23 00:26:17 devstack sudo[101799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:17 devstack sudo[101799]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fe187eb0-4dbe-4883-8ec8-76c4b3547e62 tempest-GroupsV314Test-881346209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf99786d-8b2a-419e-be4e-ed4cbc218bf1" returned: 0 in 0.602s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fe187eb0-4dbe-4883-8ec8-76c4b3547e62 tempest-GroupsV314Test-881346209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf99786d-8b2a-419e-be4e-ed4cbc218bf1 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:17 devstack sudo[101805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf99786d-8b2a-419e-be4e-ed4cbc218bf1 Sep 23 00:26:17 devstack sudo[101805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:18 devstack sudo[101805]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fe187eb0-4dbe-4883-8ec8-76c4b3547e62 tempest-GroupsV314Test-881346209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cf99786d-8b2a-419e-be4e-ed4cbc218bf1" returned: 0 in 0.315s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-fe187eb0-4dbe-4883-8ec8-76c4b3547e62 tempest-GroupsV314Test-881346209 None] Lock "cinder-quobyte-cf99786d-8b2a-419e-be4e-ed4cbc218bf1" released by "delete_volume" :: held 1.059s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:18 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-fe187eb0-4dbe-4883-8ec8-76c4b3547e62 tempest-GroupsV314Test-881346209 None] Created reservations ['d517f101-0d7f-4bbc-85ed-aae07ea77949'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:26:18 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-fe187eb0-4dbe-4883-8ec8-76c4b3547e62 tempest-GroupsV314Test-881346209 None] Created reservations ['2ed7eb83-b045-4203-b88f-f40b60b74f64', '0e2b7b6c-7aaf-470a-91dd-1a16179cf303', '91431bfb-2d79-40be-bc26-31ad3525edd3', '4fca2154-4072-486c-81a6-09ac3d37d8a0'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:26:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-fe187eb0-4dbe-4883-8ec8-76c4b3547e62 tempest-GroupsV314Test-881346209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-fe187eb0-4dbe-4883-8ec8-76c4b3547e62 tempest-GroupsV314Test-881346209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:18 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-fe187eb0-4dbe-4883-8ec8-76c4b3547e62 tempest-GroupsV314Test-881346209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:18 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-fe187eb0-4dbe-4883-8ec8-76c4b3547e62 tempest-GroupsV314Test-881346209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-fe187eb0-4dbe-4883-8ec8-76c4b3547e62 tempest-GroupsV314Test-881346209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fe187eb0-4dbe-4883-8ec8-76c4b3547e62 tempest-GroupsV314Test-881346209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:18 devstack sudo[101781]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:18 devstack sudo[101808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:26:18 devstack sudo[101808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d16f0f23-bcfe-4a1d-bfc1-2eb2d878590b tempest-TestInstancesWithCinderVolumes-529309143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_29fd2cca-3af4-492c-9f7d-c806b35072b1_mojgogaxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ea0e1ce5-eada-4735-a408-9f67ef644e00" returned: 0 in 3.450s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:18 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-d16f0f23-bcfe-4a1d-bfc1-2eb2d878590b tempest-TestInstancesWithCinderVolumes-529309143 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_29fd2cca-3af4-492c-9f7d-c806b35072b1_mojgogaxdevstack@QuobyteHD, size 112.00 MB, duration 3.45 sec, destination /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ea0e1ce5-eada-4735-a408-9f67ef644e00 {{(pid=86591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:26:18 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-d16f0f23-bcfe-4a1d-bfc1-2eb2d878590b tempest-TestInstancesWithCinderVolumes-529309143 None] Converted 112.00 MB image at 32.43 MB/s Sep 23 00:26:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d16f0f23-bcfe-4a1d-bfc1-2eb2d878590b tempest-TestInstancesWithCinderVolumes-529309143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ea0e1ce5-eada-4735-a408-9f67ef644e00 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:18 devstack sudo[101810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ea0e1ce5-eada-4735-a408-9f67ef644e00 1G Sep 23 00:26:18 devstack sudo[101810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:18 devstack sudo[101808]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fe187eb0-4dbe-4883-8ec8-76c4b3547e62 tempest-GroupsV314Test-881346209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.410s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:18 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-fe187eb0-4dbe-4883-8ec8-76c4b3547e62 tempest-GroupsV314Test-881346209 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:26:18 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-fe187eb0-4dbe-4883-8ec8-76c4b3547e62 tempest-GroupsV314Test-881346209 None] Delete group completed successfully. Sep 23 00:26:19 devstack sudo[101810]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d16f0f23-bcfe-4a1d-bfc1-2eb2d878590b tempest-TestInstancesWithCinderVolumes-529309143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ea0e1ce5-eada-4735-a408-9f67ef644e00 1G" returned: 0 in 0.523s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:19 devstack cinder-volume[86591]: DEBUG cinder.volume.volume_utils [None req-d16f0f23-bcfe-4a1d-bfc1-2eb2d878590b tempest-TestInstancesWithCinderVolumes-529309143 None] Downloaded image 29fd2cca-3af4-492c-9f7d-c806b35072b1 ((None, [{'url': 'file:///opt/stack/data/glance/images/29fd2cca-3af4-492c-9f7d-c806b35072b1', 'metadata': {}}])) to volume ea0e1ce5-eada-4735-a408-9f67ef644e00 successfully. {{(pid=86591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 00:26:19 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-d16f0f23-bcfe-4a1d-bfc1-2eb2d878590b tempest-TestInstancesWithCinderVolumes-529309143 None] Temporary image 29fd2cca-3af4-492c-9f7d-c806b35072b1 for user 88aed1b0bd8e4836b0fb94f21e3d0456 is deleted. {{(pid=86591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 00:26:19 devstack cinder-volume[86591]: DEBUG cinder.volume.volume_utils [None req-d16f0f23-bcfe-4a1d-bfc1-2eb2d878590b tempest-TestInstancesWithCinderVolumes-529309143 None] Marking volume ea0e1ce5-eada-4735-a408-9f67ef644e00 as bootable. {{(pid=86591) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 00:26:19 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-d16f0f23-bcfe-4a1d-bfc1-2eb2d878590b tempest-TestInstancesWithCinderVolumes-529309143 None] Copying metadata from image 29fd2cca-3af4-492c-9f7d-c806b35072b1 to ea0e1ce5-eada-4735-a408-9f67ef644e00. {{(pid=86591) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 00:26:19 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-d16f0f23-bcfe-4a1d-bfc1-2eb2d878590b tempest-TestInstancesWithCinderVolumes-529309143 None] Creating volume glance metadata for volume ea0e1ce5-eada-4735-a408-9f67ef644e00 backed by image 29fd2cca-3af4-492c-9f7d-c806b35072b1 with: {'image_id': '29fd2cca-3af4-492c-9f7d-c806b35072b1', 'image_name': 'tempest-scenario-img--1003878957', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86591) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 00:26:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d16f0f23-bcfe-4a1d-bfc1-2eb2d878590b tempest-TestInstancesWithCinderVolumes-529309143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78f086ee-7a6e-4279-a94c-1d41506832bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea0e1ce5-eada-4735-a408-9f67ef644e00', 'volume_size': 1, 'image_id': '29fd2cca-3af4-492c-9f7d-c806b35072b1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/29fd2cca-3af4-492c-9f7d-c806b35072b1', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1003878957', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '980a65d793a74e4ab4d4586a713df155', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '29fd2cca-3af4-492c-9f7d-c806b35072b1', 'created_at': datetime.datetime(2026, 9, 22, 22, 25, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 25, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/29fd2cca-3af4-492c-9f7d-c806b35072b1/file', 'properties': {}}, 'image_service': }' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d16f0f23-bcfe-4a1d-bfc1-2eb2d878590b tempest-TestInstancesWithCinderVolumes-529309143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7063ae7-f36c-4400-9b88-62906226cdca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:19 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-d16f0f23-bcfe-4a1d-bfc1-2eb2d878590b tempest-TestInstancesWithCinderVolumes-529309143 None] Volume volume-ea0e1ce5-eada-4735-a408-9f67ef644e00 (ea0e1ce5-eada-4735-a408-9f67ef644e00): created successfully Sep 23 00:26:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d16f0f23-bcfe-4a1d-bfc1-2eb2d878590b tempest-TestInstancesWithCinderVolumes-529309143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7063ae7-f36c-4400-9b88-62906226cdca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d16f0f23-bcfe-4a1d-bfc1-2eb2d878590b tempest-TestInstancesWithCinderVolumes-529309143 None] Flow 'volume_create_manager' (89a49aee-01a8-4949-92a8-19ed79f7e84a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:19 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-d16f0f23-bcfe-4a1d-bfc1-2eb2d878590b tempest-TestInstancesWithCinderVolumes-529309143 None] Created volume successfully. Sep 23 00:26:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-6325c70d-e04d-45c7-bade-d28f0bb63c42 req-aa8051f4-820c-4511-803a-829eda361029 tempest-TestInstancesWithCinderVolumes-529309143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-6325c70d-e04d-45c7-bade-d28f0bb63c42 req-aa8051f4-820c-4511-803a-829eda361029 tempest-TestInstancesWithCinderVolumes-529309143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-6325c70d-e04d-45c7-bade-d28f0bb63c42 req-aa8051f4-820c-4511-803a-829eda361029 tempest-TestInstancesWithCinderVolumes-529309143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-6325c70d-e04d-45c7-bade-d28f0bb63c42 req-aa8051f4-820c-4511-803a-829eda361029 tempest-TestInstancesWithCinderVolumes-529309143 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974', 'name': 'volume-ea0e1ce5-eada-4735-a408-9f67ef644e00', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a35b46a4-191b-48f8-b24e-61080857e06e', 'enforce_multipath': True} {{(pid=86591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:26:23 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-6325c70d-e04d-45c7-bade-d28f0bb63c42 req-aa8051f4-820c-4511-803a-829eda361029 tempest-TestInstancesWithCinderVolumes-529309143 None] attachment_update completed successfully. Sep 23 00:26:33 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:UPDATE=36,cinder:SELECT=25,cinder:INSERT=12,cinder:DELETE=1 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:26:33 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:UPDATE=24,cinder:SELECT=35,cinder:INSERT=7 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:26:39 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-b13f5e6e-6d6a-42b0-98a8-7a9caf73055a tempest-TestStampPattern-410397350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:26:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b13f5e6e-6d6a-42b0-98a8-7a9caf73055a tempest-TestStampPattern-410397350 None] Flow 'volume_create_manager' (ef178998-1092-4a92-84ba-5fc017ddf903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b13f5e6e-6d6a-42b0-98a8-7a9caf73055a tempest-TestStampPattern-410397350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c28f790-7940-42bc-91a6-92611fe05e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b13f5e6e-6d6a-42b0-98a8-7a9caf73055a tempest-TestStampPattern-410397350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c28f790-7940-42bc-91a6-92611fe05e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1480045989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18830956-febd-4f80-95cb-29c7f36f4da6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f1047440d9f4cb49ade81a6f2c923bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:40Z,use_quota=True,user_id='8a040be396874195948d4834e53a46a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b13f5e6e-6d6a-42b0-98a8-7a9caf73055a tempest-TestStampPattern-410397350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef2ea077-6648-4162-b4b8-a62d503eab00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b13f5e6e-6d6a-42b0-98a8-7a9caf73055a tempest-TestStampPattern-410397350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef2ea077-6648-4162-b4b8-a62d503eab00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b13f5e6e-6d6a-42b0-98a8-7a9caf73055a tempest-TestStampPattern-410397350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (448a1116-5fb2-42b5-892c-92893c7f420b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b13f5e6e-6d6a-42b0-98a8-7a9caf73055a tempest-TestStampPattern-410397350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (448a1116-5fb2-42b5-892c-92893c7f420b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18830956-febd-4f80-95cb-29c7f36f4da6', 'volume_name': 'volume-18830956-febd-4f80-95cb-29c7f36f4da6', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b13f5e6e-6d6a-42b0-98a8-7a9caf73055a tempest-TestStampPattern-410397350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8dc28e8-dde2-4967-a576-2c1ecfe65747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b13f5e6e-6d6a-42b0-98a8-7a9caf73055a tempest-TestStampPattern-410397350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8dc28e8-dde2-4967-a576-2c1ecfe65747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b13f5e6e-6d6a-42b0-98a8-7a9caf73055a tempest-TestStampPattern-410397350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ae6341e-1a4c-4d1b-8df4-37ee5c05233b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:40 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-b13f5e6e-6d6a-42b0-98a8-7a9caf73055a tempest-TestStampPattern-410397350 None] Volume 18830956-febd-4f80-95cb-29c7f36f4da6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18830956-febd-4f80-95cb-29c7f36f4da6', 'volume_size': 1} Sep 23 00:26:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b13f5e6e-6d6a-42b0-98a8-7a9caf73055a tempest-TestStampPattern-410397350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b13f5e6e-6d6a-42b0-98a8-7a9caf73055a tempest-TestStampPattern-410397350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:40 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b13f5e6e-6d6a-42b0-98a8-7a9caf73055a tempest-TestStampPattern-410397350 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1480045989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18830956-febd-4f80-95cb-29c7f36f4da6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f1047440d9f4cb49ade81a6f2c923bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:40Z,use_quota=True,user_id='8a040be396874195948d4834e53a46a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:26:40 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-b13f5e6e-6d6a-42b0-98a8-7a9caf73055a tempest-TestStampPattern-410397350 None] Creating volume 18830956-febd-4f80-95cb-29c7f36f4da6 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:26:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b13f5e6e-6d6a-42b0-98a8-7a9caf73055a tempest-TestStampPattern-410397350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b13f5e6e-6d6a-42b0-98a8-7a9caf73055a tempest-TestStampPattern-410397350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:40 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b13f5e6e-6d6a-42b0-98a8-7a9caf73055a tempest-TestStampPattern-410397350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:40 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b13f5e6e-6d6a-42b0-98a8-7a9caf73055a tempest-TestStampPattern-410397350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b13f5e6e-6d6a-42b0-98a8-7a9caf73055a tempest-TestStampPattern-410397350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:40 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b13f5e6e-6d6a-42b0-98a8-7a9caf73055a tempest-TestStampPattern-410397350 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:26:40 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-b13f5e6e-6d6a-42b0-98a8-7a9caf73055a tempest-TestStampPattern-410397350 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:26:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b13f5e6e-6d6a-42b0-98a8-7a9caf73055a tempest-TestStampPattern-410397350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-18830956-febd-4f80-95cb-29c7f36f4da6 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:40 devstack sudo[102310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-18830956-febd-4f80-95cb-29c7f36f4da6 1073741824 Sep 23 00:26:40 devstack sudo[102310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:40 devstack sudo[102310]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b13f5e6e-6d6a-42b0-98a8-7a9caf73055a tempest-TestStampPattern-410397350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-18830956-febd-4f80-95cb-29c7f36f4da6 1073741824" returned: 0 in 0.877s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b13f5e6e-6d6a-42b0-98a8-7a9caf73055a tempest-TestStampPattern-410397350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-18830956-febd-4f80-95cb-29c7f36f4da6 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:41 devstack sudo[102317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-18830956-febd-4f80-95cb-29c7f36f4da6 Sep 23 00:26:41 devstack sudo[102317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:41 devstack sudo[102317]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b13f5e6e-6d6a-42b0-98a8-7a9caf73055a tempest-TestStampPattern-410397350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-18830956-febd-4f80-95cb-29c7f36f4da6" returned: 0 in 0.459s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b13f5e6e-6d6a-42b0-98a8-7a9caf73055a tempest-TestStampPattern-410397350 None] <== create_volume: return (1444ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:26:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b13f5e6e-6d6a-42b0-98a8-7a9caf73055a tempest-TestStampPattern-410397350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.452s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b13f5e6e-6d6a-42b0-98a8-7a9caf73055a tempest-TestStampPattern-410397350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ae6341e-1a4c-4d1b-8df4-37ee5c05233b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18830956-febd-4f80-95cb-29c7f36f4da6', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b13f5e6e-6d6a-42b0-98a8-7a9caf73055a tempest-TestStampPattern-410397350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d741ae0-eeb8-4627-a397-de0b02e72049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:41 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-b13f5e6e-6d6a-42b0-98a8-7a9caf73055a tempest-TestStampPattern-410397350 None] Volume volume-18830956-febd-4f80-95cb-29c7f36f4da6 (18830956-febd-4f80-95cb-29c7f36f4da6): created successfully Sep 23 00:26:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b13f5e6e-6d6a-42b0-98a8-7a9caf73055a tempest-TestStampPattern-410397350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d741ae0-eeb8-4627-a397-de0b02e72049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b13f5e6e-6d6a-42b0-98a8-7a9caf73055a tempest-TestStampPattern-410397350 None] Flow 'volume_create_manager' (ef178998-1092-4a92-84ba-5fc017ddf903) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:41 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-b13f5e6e-6d6a-42b0-98a8-7a9caf73055a tempest-TestStampPattern-410397350 None] Created volume successfully. Sep 23 00:26:51 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:26:51 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1,cinder:DELETE=1 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:27:05 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:27:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-8bdaa6d3-b931-42e3-85a9-22844bb6d1fa req-15ef30d5-123a-4fc2-9173-1ccb3f364a93 tempest-TestInstancesWithCinderVolumes-529309143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-8bdaa6d3-b931-42e3-85a9-22844bb6d1fa req-15ef30d5-123a-4fc2-9173-1ccb3f364a93 tempest-TestInstancesWithCinderVolumes-529309143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-8bdaa6d3-b931-42e3-85a9-22844bb6d1fa req-15ef30d5-123a-4fc2-9173-1ccb3f364a93 tempest-TestInstancesWithCinderVolumes-529309143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:08 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-8bdaa6d3-b931-42e3-85a9-22844bb6d1fa req-15ef30d5-123a-4fc2-9173-1ccb3f364a93 tempest-TestInstancesWithCinderVolumes-529309143 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974', 'name': 'volume-5986a1b4-48aa-4705-8942-5a94a2166b76', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c4dce6d2-d286-4a9f-b8d1-eec71bf61cc4', 'enforce_multipath': True} {{(pid=86591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:27:08 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-8bdaa6d3-b931-42e3-85a9-22844bb6d1fa req-15ef30d5-123a-4fc2-9173-1ccb3f364a93 tempest-TestInstancesWithCinderVolumes-529309143 None] attachment_update completed successfully. Sep 23 00:27:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-eca2b30c-d145-4e0a-b519-ea0a569ebd94 req-e9dcaf7d-6c8b-45f9-8cdf-80d16a454479 tempest-TestInstancesWithCinderVolumes-529309143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-eca2b30c-d145-4e0a-b519-ea0a569ebd94 req-e9dcaf7d-6c8b-45f9-8cdf-80d16a454479 tempest-TestInstancesWithCinderVolumes-529309143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-eca2b30c-d145-4e0a-b519-ea0a569ebd94 req-e9dcaf7d-6c8b-45f9-8cdf-80d16a454479 tempest-TestInstancesWithCinderVolumes-529309143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:11 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-eca2b30c-d145-4e0a-b519-ea0a569ebd94 req-e9dcaf7d-6c8b-45f9-8cdf-80d16a454479 tempest-TestInstancesWithCinderVolumes-529309143 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974', 'name': 'volume-30359e71-a53b-4cee-b44e-ae39bc3ce28d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8baef7b0-053d-448f-928f-f9f0217033b2', 'enforce_multipath': True} {{(pid=86591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:27:11 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-eca2b30c-d145-4e0a-b519-ea0a569ebd94 req-e9dcaf7d-6c8b-45f9-8cdf-80d16a454479 tempest-TestInstancesWithCinderVolumes-529309143 None] attachment_update completed successfully. Sep 23 00:27:16 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:27:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:16 devstack sudo[102604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:27:16 devstack sudo[102604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:17 devstack sudo[102604]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.378s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:17 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:27:17 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running periodic task VolumeManager._thread_info {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:27:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] thread count: 29 {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:27:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] thread info: [<_MainThread(MainThread, started 135440660459648)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:27:17 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-ec5d72ba-a66d-4594-904d-4c8b1d9cf5d7 req-dcf120b3-e33a-4a91-99b1-183639615298 tempest-TestInstancesWithCinderVolumes-529309143 None] Terminate volume connection completed successfully. Sep 23 00:27:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-ec5d72ba-a66d-4594-904d-4c8b1d9cf5d7 req-dcf120b3-e33a-4a91-99b1-183639615298 tempest-TestInstancesWithCinderVolumes-529309143 None] Deleting attachment c4dce6d2-d286-4a9f-b8d1-eec71bf61cc4. {{(pid=86591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:27:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ce0f4aac-1cce-4c6c-9498-7ffdebd367d1 tempest-TestInstancesWithCinderVolumes-529309143 None] Acquiring lock "cinder-5986a1b4-48aa-4705-8942-5a94a2166b76-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ce0f4aac-1cce-4c6c-9498-7ffdebd367d1 tempest-TestInstancesWithCinderVolumes-529309143 None] Lock "cinder-5986a1b4-48aa-4705-8942-5a94a2166b76-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ce0f4aac-1cce-4c6c-9498-7ffdebd367d1 tempest-TestInstancesWithCinderVolumes-529309143 None] Acquiring lock "cinder-quobyte-5986a1b4-48aa-4705-8942-5a94a2166b76" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ce0f4aac-1cce-4c6c-9498-7ffdebd367d1 tempest-TestInstancesWithCinderVolumes-529309143 None] Lock "cinder-quobyte-5986a1b4-48aa-4705-8942-5a94a2166b76" acquired by "delete_volume" :: waited 0.019s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:18 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10216ae-5676-451d-9467-bcd086db1f27]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ce0f4aac-1cce-4c6c-9498-7ffdebd367d1 tempest-TestInstancesWithCinderVolumes-529309143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-5986a1b4-48aa-4705-8942-5a94a2166b76 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:18 devstack sudo[102634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-5986a1b4-48aa-4705-8942-5a94a2166b76 Sep 23 00:27:18 devstack sudo[102634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:18 devstack sudo[102634]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ce0f4aac-1cce-4c6c-9498-7ffdebd367d1 tempest-TestInstancesWithCinderVolumes-529309143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-5986a1b4-48aa-4705-8942-5a94a2166b76" returned: 0 in 0.506s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ce0f4aac-1cce-4c6c-9498-7ffdebd367d1 tempest-TestInstancesWithCinderVolumes-529309143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-5986a1b4-48aa-4705-8942-5a94a2166b76 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:18 devstack sudo[102639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-5986a1b4-48aa-4705-8942-5a94a2166b76 Sep 23 00:27:18 devstack sudo[102639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:19 devstack sudo[102639]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ce0f4aac-1cce-4c6c-9498-7ffdebd367d1 tempest-TestInstancesWithCinderVolumes-529309143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-5986a1b4-48aa-4705-8942-5a94a2166b76" returned: 0 in 0.332s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ce0f4aac-1cce-4c6c-9498-7ffdebd367d1 tempest-TestInstancesWithCinderVolumes-529309143 None] Lock "cinder-quobyte-5986a1b4-48aa-4705-8942-5a94a2166b76" released by "delete_volume" :: held 0.889s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:19 devstack cinder-volume[86591]: WARNING cinder.quota [None req-ce0f4aac-1cce-4c6c-9498-7ffdebd367d1 tempest-TestInstancesWithCinderVolumes-529309143 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1196111310-957650945 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1196111310-957650945, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:27:19 devstack cinder-volume[86591]: WARNING cinder.quota [None req-ce0f4aac-1cce-4c6c-9498-7ffdebd367d1 tempest-TestInstancesWithCinderVolumes-529309143 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1196111310-957650945 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1196111310-957650945, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:27:19 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-ce0f4aac-1cce-4c6c-9498-7ffdebd367d1 tempest-TestInstancesWithCinderVolumes-529309143 None] Created reservations ['87e6c091-603f-4043-877c-a9f6589eda35', 'fc565ac6-52b0-4a37-9085-501b6df1c6df', 'edfacec0-fe74-4391-9852-a0a3baf27131', '39077e8b-8c17-4d89-9fee-0583134432ed'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:27:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ce0f4aac-1cce-4c6c-9498-7ffdebd367d1 tempest-TestInstancesWithCinderVolumes-529309143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ce0f4aac-1cce-4c6c-9498-7ffdebd367d1 tempest-TestInstancesWithCinderVolumes-529309143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:19 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ce0f4aac-1cce-4c6c-9498-7ffdebd367d1 tempest-TestInstancesWithCinderVolumes-529309143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:19 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ce0f4aac-1cce-4c6c-9498-7ffdebd367d1 tempest-TestInstancesWithCinderVolumes-529309143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ce0f4aac-1cce-4c6c-9498-7ffdebd367d1 tempest-TestInstancesWithCinderVolumes-529309143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ce0f4aac-1cce-4c6c-9498-7ffdebd367d1 tempest-TestInstancesWithCinderVolumes-529309143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:19 devstack sudo[102642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:27:19 devstack sudo[102642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:19 devstack sudo[102642]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ce0f4aac-1cce-4c6c-9498-7ffdebd367d1 tempest-TestInstancesWithCinderVolumes-529309143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.342s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:19 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-ce0f4aac-1cce-4c6c-9498-7ffdebd367d1 tempest-TestInstancesWithCinderVolumes-529309143 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:27:19 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-ce0f4aac-1cce-4c6c-9498-7ffdebd367d1 tempest-TestInstancesWithCinderVolumes-529309143 None] Deleted volume successfully. Sep 23 00:27:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ce0f4aac-1cce-4c6c-9498-7ffdebd367d1 tempest-TestInstancesWithCinderVolumes-529309143 None] Lock "cinder-5986a1b4-48aa-4705-8942-5a94a2166b76-delete_volume" released by "delete_volume" :: held 1.496s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-3f0c910f-72cc-4b61-b791-2b59704ece0a req-a63bfb2c-2650-49f1-930a-808f4ef44397 tempest-TestStampPattern-410397350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-3f0c910f-72cc-4b61-b791-2b59704ece0a req-a63bfb2c-2650-49f1-930a-808f4ef44397 tempest-TestStampPattern-410397350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-3f0c910f-72cc-4b61-b791-2b59704ece0a req-a63bfb2c-2650-49f1-930a-808f4ef44397 tempest-TestStampPattern-410397350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:22 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-3f0c910f-72cc-4b61-b791-2b59704ece0a req-a63bfb2c-2650-49f1-930a-808f4ef44397 tempest-TestStampPattern-410397350 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974', 'name': 'volume-18830956-febd-4f80-95cb-29c7f36f4da6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '515ddb3b-dae8-4c98-89eb-d2bdf473b73f', 'enforce_multipath': True} {{(pid=86591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:27:22 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-3f0c910f-72cc-4b61-b791-2b59704ece0a req-a63bfb2c-2650-49f1-930a-808f4ef44397 tempest-TestStampPattern-410397350 None] attachment_update completed successfully. Sep 23 00:27:23 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-9153af2a-5c3b-415d-a7c6-2947a7bbd74c req-a01d9650-9867-4aef-9061-5b2f7ed5df50 tempest-TestInstancesWithCinderVolumes-529309143 None] Terminate volume connection completed successfully. Sep 23 00:27:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-9153af2a-5c3b-415d-a7c6-2947a7bbd74c req-a01d9650-9867-4aef-9061-5b2f7ed5df50 tempest-TestInstancesWithCinderVolumes-529309143 None] Deleting attachment 8baef7b0-053d-448f-928f-f9f0217033b2. {{(pid=86591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:27:24 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-92517dc0-7ce6-4164-a3b3-a764b5de1aec tempest-TestInstancesWithCinderVolumes-529309143 None] Acquiring lock "cinder-30359e71-a53b-4cee-b44e-ae39bc3ce28d-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:24 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-92517dc0-7ce6-4164-a3b3-a764b5de1aec tempest-TestInstancesWithCinderVolumes-529309143 None] Lock "cinder-30359e71-a53b-4cee-b44e-ae39bc3ce28d-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:24 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-92517dc0-7ce6-4164-a3b3-a764b5de1aec tempest-TestInstancesWithCinderVolumes-529309143 None] Acquiring lock "cinder-quobyte-30359e71-a53b-4cee-b44e-ae39bc3ce28d" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:24 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-92517dc0-7ce6-4164-a3b3-a764b5de1aec tempest-TestInstancesWithCinderVolumes-529309143 None] Lock "cinder-quobyte-30359e71-a53b-4cee-b44e-ae39bc3ce28d" acquired by "delete_volume" :: waited 0.037s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:24 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f776f5d-0d60-4196-aa8c-4bae92f38b55]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-92517dc0-7ce6-4164-a3b3-a764b5de1aec tempest-TestInstancesWithCinderVolumes-529309143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-30359e71-a53b-4cee-b44e-ae39bc3ce28d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:24 devstack sudo[102762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-30359e71-a53b-4cee-b44e-ae39bc3ce28d Sep 23 00:27:24 devstack sudo[102762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:25 devstack sudo[102762]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-92517dc0-7ce6-4164-a3b3-a764b5de1aec tempest-TestInstancesWithCinderVolumes-529309143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-30359e71-a53b-4cee-b44e-ae39bc3ce28d" returned: 0 in 0.805s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-92517dc0-7ce6-4164-a3b3-a764b5de1aec tempest-TestInstancesWithCinderVolumes-529309143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-30359e71-a53b-4cee-b44e-ae39bc3ce28d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:25 devstack sudo[102767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-30359e71-a53b-4cee-b44e-ae39bc3ce28d Sep 23 00:27:25 devstack sudo[102767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:25 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6893190-b3b3-4cee-a157-fd8b8f81a790 tempest-VolumesActionsTest-1125789447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:27:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b6893190-b3b3-4cee-a157-fd8b8f81a790 tempest-VolumesActionsTest-1125789447 None] Flow 'volume_create_manager' (ce1a595d-8d93-468d-bfbe-188087f30b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:27:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b6893190-b3b3-4cee-a157-fd8b8f81a790 tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c25ef14-67a2-4756-89c3-01bd66fa4453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b6893190-b3b3-4cee-a157-fd8b8f81a790 tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c25ef14-67a2-4756-89c3-01bd66fa4453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:27:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1439008336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e508f15-8440-4900-a486-6202a6f2bf54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddd891706fd54f54b6ac023a39d90b64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:25Z,use_quota=True,user_id='d987a0f9ce5d4654bb1069f3c7a3cddb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b6893190-b3b3-4cee-a157-fd8b8f81a790 tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71acf43e-42c0-4760-aa0f-0d0ec5056aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b6893190-b3b3-4cee-a157-fd8b8f81a790 tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71acf43e-42c0-4760-aa0f-0d0ec5056aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b6893190-b3b3-4cee-a157-fd8b8f81a790 tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (491b6c07-a485-42c2-9c09-3ad5c0eb0fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b6893190-b3b3-4cee-a157-fd8b8f81a790 tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (491b6c07-a485-42c2-9c09-3ad5c0eb0fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e508f15-8440-4900-a486-6202a6f2bf54', 'volume_name': 'volume-5e508f15-8440-4900-a486-6202a6f2bf54', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b6893190-b3b3-4cee-a157-fd8b8f81a790 tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aef4f2c-f048-4f11-81af-71bedaf4f9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b6893190-b3b3-4cee-a157-fd8b8f81a790 tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aef4f2c-f048-4f11-81af-71bedaf4f9a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:25 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b6893190-b3b3-4cee-a157-fd8b8f81a790 tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6a0ed2b-026b-47d5-ad00-e0520dcfc305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:25 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-b6893190-b3b3-4cee-a157-fd8b8f81a790 tempest-VolumesActionsTest-1125789447 None] Volume 5e508f15-8440-4900-a486-6202a6f2bf54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e508f15-8440-4900-a486-6202a6f2bf54', 'volume_size': 1} Sep 23 00:27:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b6893190-b3b3-4cee-a157-fd8b8f81a790 tempest-VolumesActionsTest-1125789447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b6893190-b3b3-4cee-a157-fd8b8f81a790 tempest-VolumesActionsTest-1125789447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:25 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b6893190-b3b3-4cee-a157-fd8b8f81a790 tempest-VolumesActionsTest-1125789447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:27:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1439008336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e508f15-8440-4900-a486-6202a6f2bf54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddd891706fd54f54b6ac023a39d90b64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:25Z,use_quota=True,user_id='d987a0f9ce5d4654bb1069f3c7a3cddb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:27:25 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-b6893190-b3b3-4cee-a157-fd8b8f81a790 tempest-VolumesActionsTest-1125789447 None] Creating volume 5e508f15-8440-4900-a486-6202a6f2bf54 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:27:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b6893190-b3b3-4cee-a157-fd8b8f81a790 tempest-VolumesActionsTest-1125789447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b6893190-b3b3-4cee-a157-fd8b8f81a790 tempest-VolumesActionsTest-1125789447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:25 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b6893190-b3b3-4cee-a157-fd8b8f81a790 tempest-VolumesActionsTest-1125789447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:25 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b6893190-b3b3-4cee-a157-fd8b8f81a790 tempest-VolumesActionsTest-1125789447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b6893190-b3b3-4cee-a157-fd8b8f81a790 tempest-VolumesActionsTest-1125789447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:25 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b6893190-b3b3-4cee-a157-fd8b8f81a790 tempest-VolumesActionsTest-1125789447 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:27:25 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-b6893190-b3b3-4cee-a157-fd8b8f81a790 tempest-VolumesActionsTest-1125789447 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:27:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b6893190-b3b3-4cee-a157-fd8b8f81a790 tempest-VolumesActionsTest-1125789447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-5e508f15-8440-4900-a486-6202a6f2bf54 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:25 devstack sudo[102767]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-92517dc0-7ce6-4164-a3b3-a764b5de1aec tempest-TestInstancesWithCinderVolumes-529309143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-30359e71-a53b-4cee-b44e-ae39bc3ce28d" returned: 0 in 0.414s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:25 devstack sudo[102771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-5e508f15-8440-4900-a486-6202a6f2bf54 1073741824 Sep 23 00:27:25 devstack sudo[102771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:25 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-92517dc0-7ce6-4164-a3b3-a764b5de1aec tempest-TestInstancesWithCinderVolumes-529309143 None] Lock "cinder-quobyte-30359e71-a53b-4cee-b44e-ae39bc3ce28d" released by "delete_volume" :: held 1.311s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:25 devstack cinder-volume[86591]: WARNING cinder.quota [None req-92517dc0-7ce6-4164-a3b3-a764b5de1aec tempest-TestInstancesWithCinderVolumes-529309143 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2022268539-988570546 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2022268539-988570546, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:27:25 devstack cinder-volume[86591]: WARNING cinder.quota [None req-92517dc0-7ce6-4164-a3b3-a764b5de1aec tempest-TestInstancesWithCinderVolumes-529309143 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2022268539-988570546 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2022268539-988570546, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:27:25 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-92517dc0-7ce6-4164-a3b3-a764b5de1aec tempest-TestInstancesWithCinderVolumes-529309143 None] Created reservations ['be724174-9aae-4e80-917e-31877196a8ec', '461d457a-f2b4-4e6a-8e51-34caac1ca0b2', '729be6a1-6e1a-430b-bee3-be87a397a97d', 'f5b4256a-2e2e-43e3-a531-6a576b580783'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:27:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-92517dc0-7ce6-4164-a3b3-a764b5de1aec tempest-TestInstancesWithCinderVolumes-529309143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-92517dc0-7ce6-4164-a3b3-a764b5de1aec tempest-TestInstancesWithCinderVolumes-529309143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:25 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-92517dc0-7ce6-4164-a3b3-a764b5de1aec tempest-TestInstancesWithCinderVolumes-529309143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:25 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-92517dc0-7ce6-4164-a3b3-a764b5de1aec tempest-TestInstancesWithCinderVolumes-529309143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-92517dc0-7ce6-4164-a3b3-a764b5de1aec tempest-TestInstancesWithCinderVolumes-529309143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-92517dc0-7ce6-4164-a3b3-a764b5de1aec tempest-TestInstancesWithCinderVolumes-529309143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:26 devstack sudo[102773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:27:26 devstack sudo[102773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:26 devstack sudo[102773]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-92517dc0-7ce6-4164-a3b3-a764b5de1aec tempest-TestInstancesWithCinderVolumes-529309143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.462s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:26 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-92517dc0-7ce6-4164-a3b3-a764b5de1aec tempest-TestInstancesWithCinderVolumes-529309143 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:27:26 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-92517dc0-7ce6-4164-a3b3-a764b5de1aec tempest-TestInstancesWithCinderVolumes-529309143 None] Deleted volume successfully. Sep 23 00:27:26 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-92517dc0-7ce6-4164-a3b3-a764b5de1aec tempest-TestInstancesWithCinderVolumes-529309143 None] Lock "cinder-30359e71-a53b-4cee-b44e-ae39bc3ce28d-delete_volume" released by "delete_volume" :: held 2.161s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:26 devstack sudo[102771]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b6893190-b3b3-4cee-a157-fd8b8f81a790 tempest-VolumesActionsTest-1125789447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-5e508f15-8440-4900-a486-6202a6f2bf54 1073741824" returned: 0 in 0.841s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b6893190-b3b3-4cee-a157-fd8b8f81a790 tempest-VolumesActionsTest-1125789447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-5e508f15-8440-4900-a486-6202a6f2bf54 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:26 devstack sudo[102782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-5e508f15-8440-4900-a486-6202a6f2bf54 Sep 23 00:27:26 devstack sudo[102782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:26 devstack sudo[102782]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b6893190-b3b3-4cee-a157-fd8b8f81a790 tempest-VolumesActionsTest-1125789447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-5e508f15-8440-4900-a486-6202a6f2bf54" returned: 0 in 0.370s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:26 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b6893190-b3b3-4cee-a157-fd8b8f81a790 tempest-VolumesActionsTest-1125789447 None] <== create_volume: return (1281ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:27:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b6893190-b3b3-4cee-a157-fd8b8f81a790 tempest-VolumesActionsTest-1125789447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.285s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b6893190-b3b3-4cee-a157-fd8b8f81a790 tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6a0ed2b-026b-47d5-ad00-e0520dcfc305) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e508f15-8440-4900-a486-6202a6f2bf54', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b6893190-b3b3-4cee-a157-fd8b8f81a790 tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df84d920-c1a8-4ad0-b15f-65c4bd9745cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:26 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-b6893190-b3b3-4cee-a157-fd8b8f81a790 tempest-VolumesActionsTest-1125789447 None] Volume volume-5e508f15-8440-4900-a486-6202a6f2bf54 (5e508f15-8440-4900-a486-6202a6f2bf54): created successfully Sep 23 00:27:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b6893190-b3b3-4cee-a157-fd8b8f81a790 tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df84d920-c1a8-4ad0-b15f-65c4bd9745cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:27 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b6893190-b3b3-4cee-a157-fd8b8f81a790 tempest-VolumesActionsTest-1125789447 None] Flow 'volume_create_manager' (ce1a595d-8d93-468d-bfbe-188087f30b70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:27:27 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-b6893190-b3b3-4cee-a157-fd8b8f81a790 tempest-VolumesActionsTest-1125789447 None] Created volume successfully. Sep 23 00:27:27 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-dbb0434d-4ddc-4052-bc6d-a126f823fbb5 tempest-VolumesActionsTest-1125789447 None] Acquiring lock "cinder-5e508f15-8440-4900-a486-6202a6f2bf54" by "attach_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:27 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-dbb0434d-4ddc-4052-bc6d-a126f823fbb5 tempest-VolumesActionsTest-1125789447 None] Lock "cinder-5e508f15-8440-4900-a486-6202a6f2bf54" acquired by "attach_volume" :: waited 0.025s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:27 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-dbb0434d-4ddc-4052-bc6d-a126f823fbb5 tempest-VolumesActionsTest-1125789447 None] Attaching volume 5e508f15-8440-4900-a486-6202a6f2bf54 to instance 3b267640-9cc0-4eed-b400-0cf7774a2b15 at mountpoint /dev/vdb on host None. Sep 23 00:27:27 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-dbb0434d-4ddc-4052-bc6d-a126f823fbb5 tempest-VolumesActionsTest-1125789447 None] Attach volume completed successfully. Sep 23 00:27:27 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-dbb0434d-4ddc-4052-bc6d-a126f823fbb5 tempest-VolumesActionsTest-1125789447 None] Lock "cinder-5e508f15-8440-4900-a486-6202a6f2bf54" released by "attach_volume" :: held 0.146s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:29 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-e30fba5b-1f08-448e-8601-a270ea07aa6b tempest-VolumesActionsTest-1863826308 None] Terminate volume connection completed successfully. Sep 23 00:27:29 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e30fba5b-1f08-448e-8601-a270ea07aa6b tempest-VolumesActionsTest-1863826308 None] Acquiring lock "cinder-5e508f15-8440-4900-a486-6202a6f2bf54-detach_volume" by "detach_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:29 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e30fba5b-1f08-448e-8601-a270ea07aa6b tempest-VolumesActionsTest-1863826308 None] Lock "cinder-5e508f15-8440-4900-a486-6202a6f2bf54-detach_volume" acquired by "detach_volume" :: waited 0.057s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:29 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-e30fba5b-1f08-448e-8601-a270ea07aa6b tempest-VolumesActionsTest-1863826308 None] Detaching volume 5e508f15-8440-4900-a486-6202a6f2bf54 from instance 3b267640-9cc0-4eed-b400-0cf7774a2b15. Sep 23 00:27:29 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-e30fba5b-1f08-448e-8601-a270ea07aa6b tempest-VolumesActionsTest-1863826308 None] Detach volume completed successfully. Sep 23 00:27:29 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-e30fba5b-1f08-448e-8601-a270ea07aa6b tempest-VolumesActionsTest-1863826308 None] Lock "cinder-5e508f15-8440-4900-a486-6202a6f2bf54-detach_volume" released by "detach_volume" :: held 0.209s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:29 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-739d13f6-1d3c-491e-8661-8cf01f83c2ec tempest-VolumesActionsTest-1125789447 None] Acquiring lock "cinder-5e508f15-8440-4900-a486-6202a6f2bf54-detach_volume" by "detach_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:29 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-739d13f6-1d3c-491e-8661-8cf01f83c2ec tempest-VolumesActionsTest-1125789447 None] Lock "cinder-5e508f15-8440-4900-a486-6202a6f2bf54-detach_volume" acquired by "detach_volume" :: waited 0.054s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:29 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-739d13f6-1d3c-491e-8661-8cf01f83c2ec tempest-VolumesActionsTest-1125789447 None] Volume detach called, but volume not attached. Sep 23 00:27:30 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-739d13f6-1d3c-491e-8661-8cf01f83c2ec tempest-VolumesActionsTest-1125789447 None] Lock "cinder-5e508f15-8440-4900-a486-6202a6f2bf54-detach_volume" released by "detach_volume" :: held 0.062s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:30 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-843cd011-72e7-4dfb-b36d-89a693c93a9d req-853d66ad-dd15-4eba-914e-6baaf66c3f95 tempest-TestStampPattern-410397350 None] Terminate volume connection completed successfully. Sep 23 00:27:30 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-843cd011-72e7-4dfb-b36d-89a693c93a9d req-853d66ad-dd15-4eba-914e-6baaf66c3f95 tempest-TestStampPattern-410397350 None] Deleting attachment 515ddb3b-dae8-4c98-89eb-d2bdf473b73f. {{(pid=86591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:27:30 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-762ae558-f5e0-4110-8365-800b7bec2766 tempest-VolumesActionsTest-1125789447 None] Acquiring lock "cinder-5e508f15-8440-4900-a486-6202a6f2bf54-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:30 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-762ae558-f5e0-4110-8365-800b7bec2766 tempest-VolumesActionsTest-1125789447 None] Lock "cinder-5e508f15-8440-4900-a486-6202a6f2bf54-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:30 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-762ae558-f5e0-4110-8365-800b7bec2766 tempest-VolumesActionsTest-1125789447 None] Acquiring lock "cinder-quobyte-5e508f15-8440-4900-a486-6202a6f2bf54" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:30 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-762ae558-f5e0-4110-8365-800b7bec2766 tempest-VolumesActionsTest-1125789447 None] Lock "cinder-quobyte-5e508f15-8440-4900-a486-6202a6f2bf54" acquired by "delete_volume" :: waited 0.029s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:30 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[30523be1-608b-4b9c-8178-7817adba9c0e]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-762ae558-f5e0-4110-8365-800b7bec2766 tempest-VolumesActionsTest-1125789447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-5e508f15-8440-4900-a486-6202a6f2bf54 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:30 devstack sudo[102823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-5e508f15-8440-4900-a486-6202a6f2bf54 Sep 23 00:27:30 devstack sudo[102823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:31 devstack sudo[102823]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-762ae558-f5e0-4110-8365-800b7bec2766 tempest-VolumesActionsTest-1125789447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-5e508f15-8440-4900-a486-6202a6f2bf54" returned: 0 in 0.670s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-762ae558-f5e0-4110-8365-800b7bec2766 tempest-VolumesActionsTest-1125789447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-5e508f15-8440-4900-a486-6202a6f2bf54 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:31 devstack sudo[102829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-5e508f15-8440-4900-a486-6202a6f2bf54 Sep 23 00:27:31 devstack sudo[102829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:31 devstack sudo[102829]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-762ae558-f5e0-4110-8365-800b7bec2766 tempest-VolumesActionsTest-1125789447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-5e508f15-8440-4900-a486-6202a6f2bf54" returned: 0 in 0.388s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:31 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-762ae558-f5e0-4110-8365-800b7bec2766 tempest-VolumesActionsTest-1125789447 None] Lock "cinder-quobyte-5e508f15-8440-4900-a486-6202a6f2bf54" released by "delete_volume" :: held 1.157s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:31 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-822356bc-6eb4-4619-94f5-c8d87cb0a444 req-b1bc5544-02b2-42e4-b0ba-67020201a96b tempest-TestInstancesWithCinderVolumes-529309143 None] Terminate volume connection completed successfully. Sep 23 00:27:31 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-822356bc-6eb4-4619-94f5-c8d87cb0a444 req-b1bc5544-02b2-42e4-b0ba-67020201a96b tempest-TestInstancesWithCinderVolumes-529309143 None] Deleting attachment a35b46a4-191b-48f8-b24e-61080857e06e. {{(pid=86591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:27:31 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-762ae558-f5e0-4110-8365-800b7bec2766 tempest-VolumesActionsTest-1125789447 None] Created reservations ['9acd7c80-63a9-4229-9ebd-439e44c130dd', 'f43fbd16-e886-4e4b-a96f-72f2e1c1de2e', '33f95ae3-ff3b-4730-a6c1-a9cb6955e77e', '0e1252d7-64e6-461a-9d35-d7e16e32ea0c'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:27:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-762ae558-f5e0-4110-8365-800b7bec2766 tempest-VolumesActionsTest-1125789447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-762ae558-f5e0-4110-8365-800b7bec2766 tempest-VolumesActionsTest-1125789447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:31 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-762ae558-f5e0-4110-8365-800b7bec2766 tempest-VolumesActionsTest-1125789447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:31 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-762ae558-f5e0-4110-8365-800b7bec2766 tempest-VolumesActionsTest-1125789447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-762ae558-f5e0-4110-8365-800b7bec2766 tempest-VolumesActionsTest-1125789447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-762ae558-f5e0-4110-8365-800b7bec2766 tempest-VolumesActionsTest-1125789447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:31 devstack sudo[102833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:27:31 devstack sudo[102833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4b593f85-1069-4a85-84c2-5c840c38ada7 tempest-TestStampPattern-410397350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4b593f85-1069-4a85-84c2-5c840c38ada7 tempest-TestStampPattern-410397350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:32 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-4b593f85-1069-4a85-84c2-5c840c38ada7 tempest-TestStampPattern-410397350 None] Creating offline snapshot f00cdcbe-6149-45c7-b696-4b521da55dd7 of volume 18830956-febd-4f80-95cb-29c7f36f4da6 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:27:32 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[38164a0f-df1f-4d41-b24f-7b0db8b06f41]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4b593f85-1069-4a85-84c2-5c840c38ada7 tempest-TestStampPattern-410397350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-18830956-febd-4f80-95cb-29c7f36f4da6 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:32 devstack sudo[102835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-18830956-febd-4f80-95cb-29c7f36f4da6 Sep 23 00:27:32 devstack sudo[102835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:32 devstack sudo[102833]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-762ae558-f5e0-4110-8365-800b7bec2766 tempest-VolumesActionsTest-1125789447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.405s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:32 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-762ae558-f5e0-4110-8365-800b7bec2766 tempest-VolumesActionsTest-1125789447 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:27:32 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-762ae558-f5e0-4110-8365-800b7bec2766 tempest-VolumesActionsTest-1125789447 None] Deleted volume successfully. Sep 23 00:27:32 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-762ae558-f5e0-4110-8365-800b7bec2766 tempest-VolumesActionsTest-1125789447 None] Lock "cinder-5e508f15-8440-4900-a486-6202a6f2bf54-delete_volume" released by "delete_volume" :: held 2.010s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:32 devstack sudo[102835]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4b593f85-1069-4a85-84c2-5c840c38ada7 tempest-TestStampPattern-410397350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-18830956-febd-4f80-95cb-29c7f36f4da6" returned: 0 in 0.568s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4b593f85-1069-4a85-84c2-5c840c38ada7 tempest-TestStampPattern-410397350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-18830956-febd-4f80-95cb-29c7f36f4da6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-18830956-febd-4f80-95cb-29c7f36f4da6.f00cdcbe-6149-45c7-b696-4b521da55dd7 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:32 devstack sudo[102841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-18830956-febd-4f80-95cb-29c7f36f4da6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-18830956-febd-4f80-95cb-29c7f36f4da6.f00cdcbe-6149-45c7-b696-4b521da55dd7 1G Sep 23 00:27:32 devstack sudo[102841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:33 devstack sudo[102841]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4b593f85-1069-4a85-84c2-5c840c38ada7 tempest-TestStampPattern-410397350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-18830956-febd-4f80-95cb-29c7f36f4da6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-18830956-febd-4f80-95cb-29c7f36f4da6.f00cdcbe-6149-45c7-b696-4b521da55dd7 1G" returned: 0 in 0.571s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4b593f85-1069-4a85-84c2-5c840c38ada7 tempest-TestStampPattern-410397350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18830956-febd-4f80-95cb-29c7f36f4da6 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-18830956-febd-4f80-95cb-29c7f36f4da6.f00cdcbe-6149-45c7-b696-4b521da55dd7 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:33 devstack sudo[102852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18830956-febd-4f80-95cb-29c7f36f4da6 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-18830956-febd-4f80-95cb-29c7f36f4da6.f00cdcbe-6149-45c7-b696-4b521da55dd7 Sep 23 00:27:33 devstack sudo[102852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:33 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0f8964ce-a2c2-4208-affe-a98d4eda9161 tempest-TestInstancesWithCinderVolumes-529309143 None] Acquiring lock "cinder-ea0e1ce5-eada-4735-a408-9f67ef644e00-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:33 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0f8964ce-a2c2-4208-affe-a98d4eda9161 tempest-TestInstancesWithCinderVolumes-529309143 None] Lock "cinder-ea0e1ce5-eada-4735-a408-9f67ef644e00-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:33 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0f8964ce-a2c2-4208-affe-a98d4eda9161 tempest-TestInstancesWithCinderVolumes-529309143 None] Acquiring lock "cinder-quobyte-ea0e1ce5-eada-4735-a408-9f67ef644e00" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:33 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0f8964ce-a2c2-4208-affe-a98d4eda9161 tempest-TestInstancesWithCinderVolumes-529309143 None] Lock "cinder-quobyte-ea0e1ce5-eada-4735-a408-9f67ef644e00" acquired by "delete_volume" :: waited 0.025s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:33 devstack sudo[102852]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4b593f85-1069-4a85-84c2-5c840c38ada7 tempest-TestStampPattern-410397350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18830956-febd-4f80-95cb-29c7f36f4da6 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-18830956-febd-4f80-95cb-29c7f36f4da6.f00cdcbe-6149-45c7-b696-4b521da55dd7" returned: 0 in 0.586s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:33 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-4b593f85-1069-4a85-84c2-5c840c38ada7 tempest-TestStampPattern-410397350 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-18830956-febd-4f80-95cb-29c7f36f4da6.f00cdcbe-6149-45c7-b696-4b521da55dd7 is being set with open permissions: ugo+rw Sep 23 00:27:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4b593f85-1069-4a85-84c2-5c840c38ada7 tempest-TestStampPattern-410397350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-18830956-febd-4f80-95cb-29c7f36f4da6.f00cdcbe-6149-45c7-b696-4b521da55dd7 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:33 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aaa5d5d-8da6-4f32-ba22-5c76f81910f8]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0f8964ce-a2c2-4208-affe-a98d4eda9161 tempest-TestInstancesWithCinderVolumes-529309143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ea0e1ce5-eada-4735-a408-9f67ef644e00 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:33 devstack sudo[102874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-18830956-febd-4f80-95cb-29c7f36f4da6.f00cdcbe-6149-45c7-b696-4b521da55dd7 Sep 23 00:27:33 devstack sudo[102874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:34 devstack sudo[102875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ea0e1ce5-eada-4735-a408-9f67ef644e00 Sep 23 00:27:34 devstack sudo[102875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:34 devstack sudo[102874]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4b593f85-1069-4a85-84c2-5c840c38ada7 tempest-TestStampPattern-410397350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-18830956-febd-4f80-95cb-29c7f36f4da6.f00cdcbe-6149-45c7-b696-4b521da55dd7" returned: 0 in 0.429s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4b593f85-1069-4a85-84c2-5c840c38ada7 tempest-TestStampPattern-410397350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-18830956-febd-4f80-95cb-29c7f36f4da6.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:34 devstack sudo[102880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-18830956-febd-4f80-95cb-29c7f36f4da6.info Sep 23 00:27:34 devstack sudo[102880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:34 devstack sudo[102875]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0f8964ce-a2c2-4208-affe-a98d4eda9161 tempest-TestInstancesWithCinderVolumes-529309143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ea0e1ce5-eada-4735-a408-9f67ef644e00" returned: 0 in 0.611s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0f8964ce-a2c2-4208-affe-a98d4eda9161 tempest-TestInstancesWithCinderVolumes-529309143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ea0e1ce5-eada-4735-a408-9f67ef644e00 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:34 devstack sudo[102884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ea0e1ce5-eada-4735-a408-9f67ef644e00 Sep 23 00:27:34 devstack sudo[102884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:34 devstack sudo[102880]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4b593f85-1069-4a85-84c2-5c840c38ada7 tempest-TestStampPattern-410397350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-18830956-febd-4f80-95cb-29c7f36f4da6.info" returned: 0 in 0.469s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:34 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-4b593f85-1069-4a85-84c2-5c840c38ada7 tempest-TestStampPattern-410397350 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-18830956-febd-4f80-95cb-29c7f36f4da6.info is being set with open permissions: ugo+rw Sep 23 00:27:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4b593f85-1069-4a85-84c2-5c840c38ada7 tempest-TestStampPattern-410397350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-18830956-febd-4f80-95cb-29c7f36f4da6.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:34 devstack sudo[102888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-18830956-febd-4f80-95cb-29c7f36f4da6.info Sep 23 00:27:34 devstack sudo[102888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:35 devstack sudo[102884]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0f8964ce-a2c2-4208-affe-a98d4eda9161 tempest-TestInstancesWithCinderVolumes-529309143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ea0e1ce5-eada-4735-a408-9f67ef644e00" returned: 0 in 0.532s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:35 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0f8964ce-a2c2-4208-affe-a98d4eda9161 tempest-TestInstancesWithCinderVolumes-529309143 None] Lock "cinder-quobyte-ea0e1ce5-eada-4735-a408-9f67ef644e00" released by "delete_volume" :: held 1.215s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:35 devstack cinder-volume[86591]: WARNING cinder.quota [None req-0f8964ce-a2c2-4208-affe-a98d4eda9161 tempest-TestInstancesWithCinderVolumes-529309143 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1449607378-2117119794 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1449607378-2117119794, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:27:35 devstack cinder-volume[86591]: WARNING cinder.quota [None req-0f8964ce-a2c2-4208-affe-a98d4eda9161 tempest-TestInstancesWithCinderVolumes-529309143 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1449607378-2117119794 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1449607378-2117119794, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:27:35 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-0f8964ce-a2c2-4208-affe-a98d4eda9161 tempest-TestInstancesWithCinderVolumes-529309143 None] Created reservations ['a5c2e92d-8b22-4232-b681-48dd6a455877', '1d0de5a5-56fa-45d2-a6b7-fcf9305325ef', '9b43c6f5-5a80-4f5b-9319-3e4ec0d50656', 'af032500-d8cc-4c01-b2d0-04096dc7d069'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:27:35 devstack sudo[102888]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4b593f85-1069-4a85-84c2-5c840c38ada7 tempest-TestStampPattern-410397350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-18830956-febd-4f80-95cb-29c7f36f4da6.info" returned: 0 in 0.441s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4b593f85-1069-4a85-84c2-5c840c38ada7 tempest-TestStampPattern-410397350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.209s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0f8964ce-a2c2-4208-affe-a98d4eda9161 tempest-TestInstancesWithCinderVolumes-529309143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0f8964ce-a2c2-4208-affe-a98d4eda9161 tempest-TestInstancesWithCinderVolumes-529309143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:35 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0f8964ce-a2c2-4208-affe-a98d4eda9161 tempest-TestInstancesWithCinderVolumes-529309143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:35 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0f8964ce-a2c2-4208-affe-a98d4eda9161 tempest-TestInstancesWithCinderVolumes-529309143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0f8964ce-a2c2-4208-affe-a98d4eda9161 tempest-TestInstancesWithCinderVolumes-529309143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0f8964ce-a2c2-4208-affe-a98d4eda9161 tempest-TestInstancesWithCinderVolumes-529309143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:35 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-4b593f85-1069-4a85-84c2-5c840c38ada7 tempest-TestStampPattern-410397350 None] Create snapshot completed successfully Sep 23 00:27:35 devstack sudo[102895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:27:35 devstack sudo[102895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:35 devstack sudo[102895]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0f8964ce-a2c2-4208-affe-a98d4eda9161 tempest-TestInstancesWithCinderVolumes-529309143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.298s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:35 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-0f8964ce-a2c2-4208-affe-a98d4eda9161 tempest-TestInstancesWithCinderVolumes-529309143 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:27:35 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-0f8964ce-a2c2-4208-affe-a98d4eda9161 tempest-TestInstancesWithCinderVolumes-529309143 None] Deleted volume successfully. Sep 23 00:27:35 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0f8964ce-a2c2-4208-affe-a98d4eda9161 tempest-TestInstancesWithCinderVolumes-529309143 None] Lock "cinder-ea0e1ce5-eada-4735-a408-9f67ef644e00-delete_volume" released by "delete_volume" :: held 1.892s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:37 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-55fe6592-9241-4780-bdcd-d648bf25a35b tempest-VolumesActionsTest-1125789447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:27:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-55fe6592-9241-4780-bdcd-d648bf25a35b tempest-VolumesActionsTest-1125789447 None] Flow 'volume_create_manager' (a38a54b7-c7e5-445b-b363-d8fd5f52c68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:27:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-55fe6592-9241-4780-bdcd-d648bf25a35b tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (988abdba-d2bd-4de2-b2d8-c1409cd3700d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-55fe6592-9241-4780-bdcd-d648bf25a35b tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (988abdba-d2bd-4de2-b2d8-c1409cd3700d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:27:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-4796583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ed10938-6593-44cb-80a3-ea81829b8b55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddd891706fd54f54b6ac023a39d90b64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:38Z,use_quota=True,user_id='d987a0f9ce5d4654bb1069f3c7a3cddb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-55fe6592-9241-4780-bdcd-d648bf25a35b tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7532e472-8a50-4b80-a7bc-aa10ff803648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-55fe6592-9241-4780-bdcd-d648bf25a35b tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7532e472-8a50-4b80-a7bc-aa10ff803648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-55fe6592-9241-4780-bdcd-d648bf25a35b tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6883ef2-4f13-4f47-b18d-00eeaac7002d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-55fe6592-9241-4780-bdcd-d648bf25a35b tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6883ef2-4f13-4f47-b18d-00eeaac7002d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ed10938-6593-44cb-80a3-ea81829b8b55', 'volume_name': 'volume-6ed10938-6593-44cb-80a3-ea81829b8b55', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-55fe6592-9241-4780-bdcd-d648bf25a35b tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b7dc8ff-3b6a-40d6-b769-d407ac6961e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-55fe6592-9241-4780-bdcd-d648bf25a35b tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b7dc8ff-3b6a-40d6-b769-d407ac6961e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-55fe6592-9241-4780-bdcd-d648bf25a35b tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df7dd038-c0a1-419f-adb0-82308dbb5302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:37 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-55fe6592-9241-4780-bdcd-d648bf25a35b tempest-VolumesActionsTest-1125789447 None] Volume 6ed10938-6593-44cb-80a3-ea81829b8b55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ed10938-6593-44cb-80a3-ea81829b8b55', 'volume_size': 1} Sep 23 00:27:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-55fe6592-9241-4780-bdcd-d648bf25a35b tempest-VolumesActionsTest-1125789447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-55fe6592-9241-4780-bdcd-d648bf25a35b tempest-VolumesActionsTest-1125789447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-55fe6592-9241-4780-bdcd-d648bf25a35b tempest-VolumesActionsTest-1125789447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:27:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-4796583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ed10938-6593-44cb-80a3-ea81829b8b55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddd891706fd54f54b6ac023a39d90b64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:38Z,use_quota=True,user_id='d987a0f9ce5d4654bb1069f3c7a3cddb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:27:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-55fe6592-9241-4780-bdcd-d648bf25a35b tempest-VolumesActionsTest-1125789447 None] Creating volume 6ed10938-6593-44cb-80a3-ea81829b8b55 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:27:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-55fe6592-9241-4780-bdcd-d648bf25a35b tempest-VolumesActionsTest-1125789447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-55fe6592-9241-4780-bdcd-d648bf25a35b tempest-VolumesActionsTest-1125789447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-55fe6592-9241-4780-bdcd-d648bf25a35b tempest-VolumesActionsTest-1125789447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-55fe6592-9241-4780-bdcd-d648bf25a35b tempest-VolumesActionsTest-1125789447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-55fe6592-9241-4780-bdcd-d648bf25a35b tempest-VolumesActionsTest-1125789447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-55fe6592-9241-4780-bdcd-d648bf25a35b tempest-VolumesActionsTest-1125789447 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:27:37 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-55fe6592-9241-4780-bdcd-d648bf25a35b tempest-VolumesActionsTest-1125789447 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:27:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-55fe6592-9241-4780-bdcd-d648bf25a35b tempest-VolumesActionsTest-1125789447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6ed10938-6593-44cb-80a3-ea81829b8b55 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:37 devstack sudo[102899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6ed10938-6593-44cb-80a3-ea81829b8b55 1073741824 Sep 23 00:27:37 devstack sudo[102899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:38 devstack sudo[102899]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-55fe6592-9241-4780-bdcd-d648bf25a35b tempest-VolumesActionsTest-1125789447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6ed10938-6593-44cb-80a3-ea81829b8b55 1073741824" returned: 0 in 0.639s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-55fe6592-9241-4780-bdcd-d648bf25a35b tempest-VolumesActionsTest-1125789447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6ed10938-6593-44cb-80a3-ea81829b8b55 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:38 devstack sudo[102909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6ed10938-6593-44cb-80a3-ea81829b8b55 Sep 23 00:27:38 devstack sudo[102909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:38 devstack sudo[102909]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-55fe6592-9241-4780-bdcd-d648bf25a35b tempest-VolumesActionsTest-1125789447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6ed10938-6593-44cb-80a3-ea81829b8b55" returned: 0 in 0.335s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:38 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-55fe6592-9241-4780-bdcd-d648bf25a35b tempest-VolumesActionsTest-1125789447 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:27:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-55fe6592-9241-4780-bdcd-d648bf25a35b tempest-VolumesActionsTest-1125789447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:38 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-55fe6592-9241-4780-bdcd-d648bf25a35b tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df7dd038-c0a1-419f-adb0-82308dbb5302) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ed10938-6593-44cb-80a3-ea81829b8b55', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:38 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-55fe6592-9241-4780-bdcd-d648bf25a35b tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2bc2fc2-15c4-4a78-9efe-15dcb4fc4e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:38 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-55fe6592-9241-4780-bdcd-d648bf25a35b tempest-VolumesActionsTest-1125789447 None] Volume volume-6ed10938-6593-44cb-80a3-ea81829b8b55 (6ed10938-6593-44cb-80a3-ea81829b8b55): created successfully Sep 23 00:27:38 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-55fe6592-9241-4780-bdcd-d648bf25a35b tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2bc2fc2-15c4-4a78-9efe-15dcb4fc4e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:38 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-55fe6592-9241-4780-bdcd-d648bf25a35b tempest-VolumesActionsTest-1125789447 None] Flow 'volume_create_manager' (a38a54b7-c7e5-445b-b363-d8fd5f52c68f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:27:38 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-55fe6592-9241-4780-bdcd-d648bf25a35b tempest-VolumesActionsTest-1125789447 None] Created volume successfully. Sep 23 00:27:40 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-92f8b7fd-fbe1-4010-9a83-4b2e97893c65 tempest-VolumesActionsTest-1863826308 None] Acquiring lock "cinder-6ed10938-6593-44cb-80a3-ea81829b8b55-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:40 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-92f8b7fd-fbe1-4010-9a83-4b2e97893c65 tempest-VolumesActionsTest-1863826308 None] Lock "cinder-6ed10938-6593-44cb-80a3-ea81829b8b55-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:40 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-92f8b7fd-fbe1-4010-9a83-4b2e97893c65 tempest-VolumesActionsTest-1863826308 None] Acquiring lock "cinder-quobyte-6ed10938-6593-44cb-80a3-ea81829b8b55" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:40 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-92f8b7fd-fbe1-4010-9a83-4b2e97893c65 tempest-VolumesActionsTest-1863826308 None] Lock "cinder-quobyte-6ed10938-6593-44cb-80a3-ea81829b8b55" acquired by "delete_volume" :: waited 0.020s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:40 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[1530020f-db00-456e-b599-dade6899308c]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-92f8b7fd-fbe1-4010-9a83-4b2e97893c65 tempest-VolumesActionsTest-1863826308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6ed10938-6593-44cb-80a3-ea81829b8b55 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:40 devstack sudo[102940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6ed10938-6593-44cb-80a3-ea81829b8b55 Sep 23 00:27:40 devstack sudo[102940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:40 devstack sudo[102940]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-92f8b7fd-fbe1-4010-9a83-4b2e97893c65 tempest-VolumesActionsTest-1863826308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6ed10938-6593-44cb-80a3-ea81829b8b55" returned: 0 in 0.453s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-92f8b7fd-fbe1-4010-9a83-4b2e97893c65 tempest-VolumesActionsTest-1863826308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6ed10938-6593-44cb-80a3-ea81829b8b55 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:40 devstack sudo[102946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6ed10938-6593-44cb-80a3-ea81829b8b55 Sep 23 00:27:40 devstack sudo[102946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:41 devstack sudo[102946]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-92f8b7fd-fbe1-4010-9a83-4b2e97893c65 tempest-VolumesActionsTest-1863826308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6ed10938-6593-44cb-80a3-ea81829b8b55" returned: 0 in 0.337s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:41 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-92f8b7fd-fbe1-4010-9a83-4b2e97893c65 tempest-VolumesActionsTest-1863826308 None] Lock "cinder-quobyte-6ed10938-6593-44cb-80a3-ea81829b8b55" released by "delete_volume" :: held 0.860s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:41 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-92f8b7fd-fbe1-4010-9a83-4b2e97893c65 tempest-VolumesActionsTest-1863826308 None] Created reservations ['f3606362-977e-41cc-89d5-94d2b8ba9c5f', '3bd7ed15-7a36-44a0-9469-d0af2081ad4b', 'b1ac02f1-a86e-4561-ad58-060820db077c', 'ff841a7d-2e14-4729-9353-ddd4eef8aa74'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:27:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-92f8b7fd-fbe1-4010-9a83-4b2e97893c65 tempest-VolumesActionsTest-1863826308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-92f8b7fd-fbe1-4010-9a83-4b2e97893c65 tempest-VolumesActionsTest-1863826308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-92f8b7fd-fbe1-4010-9a83-4b2e97893c65 tempest-VolumesActionsTest-1863826308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-92f8b7fd-fbe1-4010-9a83-4b2e97893c65 tempest-VolumesActionsTest-1863826308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-92f8b7fd-fbe1-4010-9a83-4b2e97893c65 tempest-VolumesActionsTest-1863826308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-92f8b7fd-fbe1-4010-9a83-4b2e97893c65 tempest-VolumesActionsTest-1863826308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:41 devstack sudo[102949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:27:41 devstack sudo[102949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:41 devstack sudo[102949]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-92f8b7fd-fbe1-4010-9a83-4b2e97893c65 tempest-VolumesActionsTest-1863826308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.372s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:41 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-92f8b7fd-fbe1-4010-9a83-4b2e97893c65 tempest-VolumesActionsTest-1863826308 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:27:41 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-92f8b7fd-fbe1-4010-9a83-4b2e97893c65 tempest-VolumesActionsTest-1863826308 None] Deleted volume successfully. Sep 23 00:27:41 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-92f8b7fd-fbe1-4010-9a83-4b2e97893c65 tempest-VolumesActionsTest-1863826308 None] Lock "cinder-6ed10938-6593-44cb-80a3-ea81829b8b55-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:42 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-1380eac4-8429-4198-bade-afca08749acf tempest-VolumesActionsTest-1125789447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:27:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1380eac4-8429-4198-bade-afca08749acf tempest-VolumesActionsTest-1125789447 None] Flow 'volume_create_manager' (2b08fe10-0b2b-421c-b343-f7eb7130f917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:27:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1380eac4-8429-4198-bade-afca08749acf tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c03fe7d-db93-4756-a08b-d7fd4fc6376a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1380eac4-8429-4198-bade-afca08749acf tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c03fe7d-db93-4756-a08b-d7fd4fc6376a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1139522741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c66c344b-9d99-49f0-9e6c-1343f6507106,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddd891706fd54f54b6ac023a39d90b64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:42Z,use_quota=True,user_id='d987a0f9ce5d4654bb1069f3c7a3cddb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1380eac4-8429-4198-bade-afca08749acf tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (889a4e52-9844-46ac-a784-8c446fb7280b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1380eac4-8429-4198-bade-afca08749acf tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (889a4e52-9844-46ac-a784-8c446fb7280b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1380eac4-8429-4198-bade-afca08749acf tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c666fa76-2008-41ae-988f-2fd0bb237b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1380eac4-8429-4198-bade-afca08749acf tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c666fa76-2008-41ae-988f-2fd0bb237b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c66c344b-9d99-49f0-9e6c-1343f6507106', 'volume_name': 'volume-c66c344b-9d99-49f0-9e6c-1343f6507106', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1380eac4-8429-4198-bade-afca08749acf tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74a1cb5c-b729-4cf6-bd46-4016b3aac311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1380eac4-8429-4198-bade-afca08749acf tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74a1cb5c-b729-4cf6-bd46-4016b3aac311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1380eac4-8429-4198-bade-afca08749acf tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb8cb47a-d6cf-4f38-8ffa-016255e6d8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:42 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-1380eac4-8429-4198-bade-afca08749acf tempest-VolumesActionsTest-1125789447 None] Volume c66c344b-9d99-49f0-9e6c-1343f6507106: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c66c344b-9d99-49f0-9e6c-1343f6507106', 'volume_size': 1} Sep 23 00:27:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1380eac4-8429-4198-bade-afca08749acf tempest-VolumesActionsTest-1125789447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1380eac4-8429-4198-bade-afca08749acf tempest-VolumesActionsTest-1125789447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1380eac4-8429-4198-bade-afca08749acf tempest-VolumesActionsTest-1125789447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1139522741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c66c344b-9d99-49f0-9e6c-1343f6507106,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddd891706fd54f54b6ac023a39d90b64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:42Z,use_quota=True,user_id='d987a0f9ce5d4654bb1069f3c7a3cddb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:27:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-1380eac4-8429-4198-bade-afca08749acf tempest-VolumesActionsTest-1125789447 None] Creating volume c66c344b-9d99-49f0-9e6c-1343f6507106 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:27:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1380eac4-8429-4198-bade-afca08749acf tempest-VolumesActionsTest-1125789447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1380eac4-8429-4198-bade-afca08749acf tempest-VolumesActionsTest-1125789447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1380eac4-8429-4198-bade-afca08749acf tempest-VolumesActionsTest-1125789447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1380eac4-8429-4198-bade-afca08749acf tempest-VolumesActionsTest-1125789447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1380eac4-8429-4198-bade-afca08749acf tempest-VolumesActionsTest-1125789447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1380eac4-8429-4198-bade-afca08749acf tempest-VolumesActionsTest-1125789447 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:27:42 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-1380eac4-8429-4198-bade-afca08749acf tempest-VolumesActionsTest-1125789447 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:27:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1380eac4-8429-4198-bade-afca08749acf tempest-VolumesActionsTest-1125789447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c66c344b-9d99-49f0-9e6c-1343f6507106 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:42 devstack sudo[102952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c66c344b-9d99-49f0-9e6c-1343f6507106 1073741824 Sep 23 00:27:42 devstack sudo[102952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:43 devstack sudo[102952]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1380eac4-8429-4198-bade-afca08749acf tempest-VolumesActionsTest-1125789447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c66c344b-9d99-49f0-9e6c-1343f6507106 1073741824" returned: 0 in 0.834s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1380eac4-8429-4198-bade-afca08749acf tempest-VolumesActionsTest-1125789447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c66c344b-9d99-49f0-9e6c-1343f6507106 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:43 devstack sudo[102958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c66c344b-9d99-49f0-9e6c-1343f6507106 Sep 23 00:27:43 devstack sudo[102958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:43 devstack sudo[102958]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1380eac4-8429-4198-bade-afca08749acf tempest-VolumesActionsTest-1125789447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c66c344b-9d99-49f0-9e6c-1343f6507106" returned: 0 in 0.385s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:43 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1380eac4-8429-4198-bade-afca08749acf tempest-VolumesActionsTest-1125789447 None] <== create_volume: return (1306ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:27:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1380eac4-8429-4198-bade-afca08749acf tempest-VolumesActionsTest-1125789447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.310s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:43 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1380eac4-8429-4198-bade-afca08749acf tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb8cb47a-d6cf-4f38-8ffa-016255e6d8bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c66c344b-9d99-49f0-9e6c-1343f6507106', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:43 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1380eac4-8429-4198-bade-afca08749acf tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b46f73e-1ea2-4198-8de0-8e416ea3538c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:43 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-1380eac4-8429-4198-bade-afca08749acf tempest-VolumesActionsTest-1125789447 None] Volume volume-c66c344b-9d99-49f0-9e6c-1343f6507106 (c66c344b-9d99-49f0-9e6c-1343f6507106): created successfully Sep 23 00:27:43 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1380eac4-8429-4198-bade-afca08749acf tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b46f73e-1ea2-4198-8de0-8e416ea3538c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:43 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1380eac4-8429-4198-bade-afca08749acf tempest-VolumesActionsTest-1125789447 None] Flow 'volume_create_manager' (2b08fe10-0b2b-421c-b343-f7eb7130f917) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:27:43 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-1380eac4-8429-4198-bade-afca08749acf tempest-VolumesActionsTest-1125789447 None] Created volume successfully. Sep 23 00:27:44 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b4625d12-1f3f-4dd1-ad89-cb4bdb846116 tempest-VolumesActionsTest-1863826308 None] Acquiring lock "cinder-c66c344b-9d99-49f0-9e6c-1343f6507106-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:44 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b4625d12-1f3f-4dd1-ad89-cb4bdb846116 tempest-VolumesActionsTest-1863826308 None] Lock "cinder-c66c344b-9d99-49f0-9e6c-1343f6507106-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:44 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b4625d12-1f3f-4dd1-ad89-cb4bdb846116 tempest-VolumesActionsTest-1863826308 None] Acquiring lock "cinder-quobyte-c66c344b-9d99-49f0-9e6c-1343f6507106" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:44 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b4625d12-1f3f-4dd1-ad89-cb4bdb846116 tempest-VolumesActionsTest-1863826308 None] Lock "cinder-quobyte-c66c344b-9d99-49f0-9e6c-1343f6507106" acquired by "delete_volume" :: waited 0.024s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:44 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1fcb036-c862-4976-aabc-e680d110eb5a]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b4625d12-1f3f-4dd1-ad89-cb4bdb846116 tempest-VolumesActionsTest-1863826308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c66c344b-9d99-49f0-9e6c-1343f6507106 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:44 devstack sudo[102962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c66c344b-9d99-49f0-9e6c-1343f6507106 Sep 23 00:27:44 devstack sudo[102962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:45 devstack sudo[102962]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b4625d12-1f3f-4dd1-ad89-cb4bdb846116 tempest-VolumesActionsTest-1863826308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c66c344b-9d99-49f0-9e6c-1343f6507106" returned: 0 in 0.516s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b4625d12-1f3f-4dd1-ad89-cb4bdb846116 tempest-VolumesActionsTest-1863826308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c66c344b-9d99-49f0-9e6c-1343f6507106 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:45 devstack sudo[102967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c66c344b-9d99-49f0-9e6c-1343f6507106 Sep 23 00:27:45 devstack sudo[102967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:45 devstack sudo[102967]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b4625d12-1f3f-4dd1-ad89-cb4bdb846116 tempest-VolumesActionsTest-1863826308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c66c344b-9d99-49f0-9e6c-1343f6507106" returned: 0 in 0.318s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:45 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b4625d12-1f3f-4dd1-ad89-cb4bdb846116 tempest-VolumesActionsTest-1863826308 None] Lock "cinder-quobyte-c66c344b-9d99-49f0-9e6c-1343f6507106" released by "delete_volume" :: held 0.901s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:45 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-b4625d12-1f3f-4dd1-ad89-cb4bdb846116 tempest-VolumesActionsTest-1863826308 None] Created reservations ['5dc44303-aaf9-49d2-9091-e89788e94c80', '94845a12-b17e-4218-b967-d420874915ef', '240cb415-32fc-4b7c-acbb-07433c36b8b4', 'df628da4-198d-4736-ac26-bda0a6e1bbfe'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:27:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b4625d12-1f3f-4dd1-ad89-cb4bdb846116 tempest-VolumesActionsTest-1863826308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b4625d12-1f3f-4dd1-ad89-cb4bdb846116 tempest-VolumesActionsTest-1863826308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:45 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b4625d12-1f3f-4dd1-ad89-cb4bdb846116 tempest-VolumesActionsTest-1863826308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:45 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b4625d12-1f3f-4dd1-ad89-cb4bdb846116 tempest-VolumesActionsTest-1863826308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b4625d12-1f3f-4dd1-ad89-cb4bdb846116 tempest-VolumesActionsTest-1863826308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b4625d12-1f3f-4dd1-ad89-cb4bdb846116 tempest-VolumesActionsTest-1863826308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:45 devstack sudo[102970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:27:45 devstack sudo[102970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:46 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-c423c66b-eff9-4ca5-b51a-c2c40833d066 tempest-TestStampPattern-410397350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:27:46 devstack sudo[102970]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c423c66b-eff9-4ca5-b51a-c2c40833d066 tempest-TestStampPattern-410397350 None] Flow 'volume_create_manager' (9790ad8f-1da0-4975-a502-5d8049285fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:27:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c423c66b-eff9-4ca5-b51a-c2c40833d066 tempest-TestStampPattern-410397350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e415a05e-73f7-4b7a-91a6-2fbb1ad26005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b4625d12-1f3f-4dd1-ad89-cb4bdb846116 tempest-VolumesActionsTest-1863826308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.468s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:46 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-b4625d12-1f3f-4dd1-ad89-cb4bdb846116 tempest-VolumesActionsTest-1863826308 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:27:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c423c66b-eff9-4ca5-b51a-c2c40833d066 tempest-TestStampPattern-410397350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e415a05e-73f7-4b7a-91a6-2fbb1ad26005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:27:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1305706447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=208fb30b-33b5-4e74-98f4-bc6c32f1e596,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f1047440d9f4cb49ade81a6f2c923bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f00cdcbe-6149-45c7-b696-4b521da55dd7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:46Z,use_quota=True,user_id='8a040be396874195948d4834e53a46a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c423c66b-eff9-4ca5-b51a-c2c40833d066 tempest-TestStampPattern-410397350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0d68a8e-a042-4beb-bc80-cecbd2eb6bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c423c66b-eff9-4ca5-b51a-c2c40833d066 tempest-TestStampPattern-410397350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0d68a8e-a042-4beb-bc80-cecbd2eb6bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c423c66b-eff9-4ca5-b51a-c2c40833d066 tempest-TestStampPattern-410397350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da08d7c0-914c-4cc6-822f-bf8930b072dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c423c66b-eff9-4ca5-b51a-c2c40833d066 tempest-TestStampPattern-410397350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da08d7c0-914c-4cc6-822f-bf8930b072dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '208fb30b-33b5-4e74-98f4-bc6c32f1e596', 'volume_name': 'volume-208fb30b-33b5-4e74-98f4-bc6c32f1e596', 'volume_size': 1, 'snapshot_id': 'f00cdcbe-6149-45c7-b696-4b521da55dd7'}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c423c66b-eff9-4ca5-b51a-c2c40833d066 tempest-TestStampPattern-410397350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58b5351b-0587-48be-8727-f815c5bd7c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c423c66b-eff9-4ca5-b51a-c2c40833d066 tempest-TestStampPattern-410397350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58b5351b-0587-48be-8727-f815c5bd7c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c423c66b-eff9-4ca5-b51a-c2c40833d066 tempest-TestStampPattern-410397350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44751286-b08a-48c6-9a52-ed14eb609d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:46 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-c423c66b-eff9-4ca5-b51a-c2c40833d066 tempest-TestStampPattern-410397350 None] Volume 208fb30b-33b5-4e74-98f4-bc6c32f1e596: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-208fb30b-33b5-4e74-98f4-bc6c32f1e596', 'volume_size': 1, 'snapshot_id': 'f00cdcbe-6149-45c7-b696-4b521da55dd7'} Sep 23 00:27:46 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-b4625d12-1f3f-4dd1-ad89-cb4bdb846116 tempest-VolumesActionsTest-1863826308 None] Deleted volume successfully. Sep 23 00:27:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c423c66b-eff9-4ca5-b51a-c2c40833d066 tempest-TestStampPattern-410397350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c423c66b-eff9-4ca5-b51a-c2c40833d066 tempest-TestStampPattern-410397350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:46 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c423c66b-eff9-4ca5-b51a-c2c40833d066 tempest-TestStampPattern-410397350 None] Acquiring lock "cinder-quobyte-f00cdcbe-6149-45c7-b696-4b521da55dd7-208fb30b-33b5-4e74-98f4-bc6c32f1e596" by "_create_volume_from_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:46 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b4625d12-1f3f-4dd1-ad89-cb4bdb846116 tempest-VolumesActionsTest-1863826308 None] Lock "cinder-c66c344b-9d99-49f0-9e6c-1343f6507106-delete_volume" released by "delete_volume" :: held 1.777s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:46 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c423c66b-eff9-4ca5-b51a-c2c40833d066 tempest-TestStampPattern-410397350 None] Lock "cinder-quobyte-f00cdcbe-6149-45c7-b696-4b521da55dd7-208fb30b-33b5-4e74-98f4-bc6c32f1e596" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c423c66b-eff9-4ca5-b51a-c2c40833d066 tempest-TestStampPattern-410397350 None] Creating volume 208fb30b-33b5-4e74-98f4-bc6c32f1e596 from snapshot f00cdcbe-6149-45c7-b696-4b521da55dd7 {{(pid=86591) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 00:27:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c423c66b-eff9-4ca5-b51a-c2c40833d066 tempest-TestStampPattern-410397350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c423c66b-eff9-4ca5-b51a-c2c40833d066 tempest-TestStampPattern-410397350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c423c66b-eff9-4ca5-b51a-c2c40833d066 tempest-TestStampPattern-410397350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c423c66b-eff9-4ca5-b51a-c2c40833d066 tempest-TestStampPattern-410397350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c423c66b-eff9-4ca5-b51a-c2c40833d066 tempest-TestStampPattern-410397350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c423c66b-eff9-4ca5-b51a-c2c40833d066 tempest-TestStampPattern-410397350 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:27:46 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c423c66b-eff9-4ca5-b51a-c2c40833d066 tempest-TestStampPattern-410397350 None] Acquiring lock "cinder-quobyte-208fb30b-33b5-4e74-98f4-bc6c32f1e596" by "_copy_volume_from_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:46 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c423c66b-eff9-4ca5-b51a-c2c40833d066 tempest-TestStampPattern-410397350 None] Lock "cinder-quobyte-208fb30b-33b5-4e74-98f4-bc6c32f1e596" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c423c66b-eff9-4ca5-b51a-c2c40833d066 tempest-TestStampPattern-410397350 None] snapshot: f00cdcbe-6149-45c7-b696-4b521da55dd7, volume: 208fb30b-33b5-4e74-98f4-bc6c32f1e596, {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:27:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c423c66b-eff9-4ca5-b51a-c2c40833d066 tempest-TestStampPattern-410397350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c423c66b-eff9-4ca5-b51a-c2c40833d066 tempest-TestStampPattern-410397350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c423c66b-eff9-4ca5-b51a-c2c40833d066 tempest-TestStampPattern-410397350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c423c66b-eff9-4ca5-b51a-c2c40833d066 tempest-TestStampPattern-410397350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c423c66b-eff9-4ca5-b51a-c2c40833d066 tempest-TestStampPattern-410397350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:46 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b1ce7d-468b-4217-946b-55957ae97f4a]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c423c66b-eff9-4ca5-b51a-c2c40833d066 tempest-TestStampPattern-410397350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-18830956-febd-4f80-95cb-29c7f36f4da6.f00cdcbe-6149-45c7-b696-4b521da55dd7 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:46 devstack sudo[102974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-18830956-febd-4f80-95cb-29c7f36f4da6.f00cdcbe-6149-45c7-b696-4b521da55dd7 Sep 23 00:27:46 devstack sudo[102974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:46 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-49e430ea-a064-43c7-b594-a81ed90869b9 tempest-VolumesActionsTest-1125789447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:27:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-49e430ea-a064-43c7-b594-a81ed90869b9 tempest-VolumesActionsTest-1125789447 None] Flow 'volume_create_manager' (6e4af141-cd91-401e-afb1-3424b3aa0db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:27:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-49e430ea-a064-43c7-b594-a81ed90869b9 tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67464504-d10e-4301-846a-59cb47a2c385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-49e430ea-a064-43c7-b594-a81ed90869b9 tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67464504-d10e-4301-846a-59cb47a2c385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-446828027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80d99010-0735-4284-b04f-1b8cb8dbbeba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddd891706fd54f54b6ac023a39d90b64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:47Z,use_quota=True,user_id='d987a0f9ce5d4654bb1069f3c7a3cddb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-49e430ea-a064-43c7-b594-a81ed90869b9 tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (624bdf63-3a61-42dd-ae8e-4f2f9fd5f625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-49e430ea-a064-43c7-b594-a81ed90869b9 tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (624bdf63-3a61-42dd-ae8e-4f2f9fd5f625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-49e430ea-a064-43c7-b594-a81ed90869b9 tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cfe0cee-4c14-4252-b48e-ecb7ad38539d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-49e430ea-a064-43c7-b594-a81ed90869b9 tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cfe0cee-4c14-4252-b48e-ecb7ad38539d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80d99010-0735-4284-b04f-1b8cb8dbbeba', 'volume_name': 'volume-80d99010-0735-4284-b04f-1b8cb8dbbeba', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-49e430ea-a064-43c7-b594-a81ed90869b9 tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4cdb300-85bd-4446-a9cb-e0b4ca207e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-49e430ea-a064-43c7-b594-a81ed90869b9 tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4cdb300-85bd-4446-a9cb-e0b4ca207e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-49e430ea-a064-43c7-b594-a81ed90869b9 tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a053266-d0f2-48ab-bec3-ed63ff57493a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:46 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-49e430ea-a064-43c7-b594-a81ed90869b9 tempest-VolumesActionsTest-1125789447 None] Volume 80d99010-0735-4284-b04f-1b8cb8dbbeba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80d99010-0735-4284-b04f-1b8cb8dbbeba', 'volume_size': 1} Sep 23 00:27:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-49e430ea-a064-43c7-b594-a81ed90869b9 tempest-VolumesActionsTest-1125789447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:46 devstack sudo[102974]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c423c66b-eff9-4ca5-b51a-c2c40833d066 tempest-TestStampPattern-410397350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-18830956-febd-4f80-95cb-29c7f36f4da6.f00cdcbe-6149-45c7-b696-4b521da55dd7" returned: 0 in 0.512s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-c423c66b-eff9-4ca5-b51a-c2c40833d066 tempest-TestStampPattern-410397350 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18830956-febd-4f80-95cb-29c7f36f4da6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:27:46 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[039f344e-074b-458f-b4ba-d01bf6741e6f]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c423c66b-eff9-4ca5-b51a-c2c40833d066 tempest-TestStampPattern-410397350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-18830956-febd-4f80-95cb-29c7f36f4da6 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:47 devstack sudo[102979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-18830956-febd-4f80-95cb-29c7f36f4da6 Sep 23 00:27:47 devstack sudo[102979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:47 devstack sudo[102979]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c423c66b-eff9-4ca5-b51a-c2c40833d066 tempest-TestStampPattern-410397350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-18830956-febd-4f80-95cb-29c7f36f4da6" returned: 0 in 0.577s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:47 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c423c66b-eff9-4ca5-b51a-c2c40833d066 tempest-TestStampPattern-410397350 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-18830956-febd-4f80-95cb-29c7f36f4da6 {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:27:47 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c423c66b-eff9-4ca5-b51a-c2c40833d066 tempest-TestStampPattern-410397350 None] Creating direct copy from snapshot {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:27:47 devstack cinder-volume[86591]: DEBUG cinder.utils [None req-c423c66b-eff9-4ca5-b51a-c2c40833d066 tempest-TestStampPattern-410397350 None] Path /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-208fb30b-33b5-4e74-98f4-bc6c32f1e596 not found in is_blk_device check {{(pid=86591) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:27:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c423c66b-eff9-4ca5-b51a-c2c40833d066 tempest-TestStampPattern-410397350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-18830956-febd-4f80-95cb-29c7f36f4da6 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-208fb30b-33b5-4e74-98f4-bc6c32f1e596 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:47 devstack sudo[102988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-18830956-febd-4f80-95cb-29c7f36f4da6 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-208fb30b-33b5-4e74-98f4-bc6c32f1e596 Sep 23 00:27:47 devstack sudo[102988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:56 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=72,cinder:UPDATE=73,cinder:INSERT=15,cinder:DELETE=6 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:27:56 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=75,cinder:UPDATE=62,cinder:DELETE=4,cinder:INSERT=15 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:27:57 devstack sudo[102988]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c423c66b-eff9-4ca5-b51a-c2c40833d066 tempest-TestStampPattern-410397350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-18830956-febd-4f80-95cb-29c7f36f4da6 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-208fb30b-33b5-4e74-98f4-bc6c32f1e596" returned: 0 in 10.328s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:57 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-c423c66b-eff9-4ca5-b51a-c2c40833d066 tempest-TestStampPattern-410397350 None] Image conversion details: src /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-18830956-febd-4f80-95cb-29c7f36f4da6, size 1024.00 MB, duration 10.33 sec, destination /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-208fb30b-33b5-4e74-98f4-bc6c32f1e596 {{(pid=86591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:27:57 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-c423c66b-eff9-4ca5-b51a-c2c40833d066 tempest-TestStampPattern-410397350 None] Converted 1024.00 MB image at 99.14 MB/s Sep 23 00:27:57 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-c423c66b-eff9-4ca5-b51a-c2c40833d066 tempest-TestStampPattern-410397350 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-208fb30b-33b5-4e74-98f4-bc6c32f1e596 is being set with open permissions: ugo+rw Sep 23 00:27:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c423c66b-eff9-4ca5-b51a-c2c40833d066 tempest-TestStampPattern-410397350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-208fb30b-33b5-4e74-98f4-bc6c32f1e596 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:57 devstack sudo[103060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-208fb30b-33b5-4e74-98f4-bc6c32f1e596 Sep 23 00:27:57 devstack sudo[103060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:58 devstack sudo[103060]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c423c66b-eff9-4ca5-b51a-c2c40833d066 tempest-TestStampPattern-410397350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-208fb30b-33b5-4e74-98f4-bc6c32f1e596" returned: 0 in 0.525s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:58 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c423c66b-eff9-4ca5-b51a-c2c40833d066 tempest-TestStampPattern-410397350 None] Lock "cinder-quobyte-208fb30b-33b5-4e74-98f4-bc6c32f1e596" released by "_copy_volume_from_snapshot" :: held 12.105s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:58 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c423c66b-eff9-4ca5-b51a-c2c40833d066 tempest-TestStampPattern-410397350 None] Lock "cinder-quobyte-f00cdcbe-6149-45c7-b696-4b521da55dd7-208fb30b-33b5-4e74-98f4-bc6c32f1e596" released by "_create_volume_from_snapshot" :: held 12.209s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c423c66b-eff9-4ca5-b51a-c2c40833d066 tempest-TestStampPattern-410397350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.242s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-49e430ea-a064-43c7-b594-a81ed90869b9 tempest-VolumesActionsTest-1125789447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.644s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:58 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-49e430ea-a064-43c7-b594-a81ed90869b9 tempest-VolumesActionsTest-1125789447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-446828027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80d99010-0735-4284-b04f-1b8cb8dbbeba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddd891706fd54f54b6ac023a39d90b64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:47Z,use_quota=True,user_id='d987a0f9ce5d4654bb1069f3c7a3cddb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:27:58 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-49e430ea-a064-43c7-b594-a81ed90869b9 tempest-VolumesActionsTest-1125789447 None] Creating volume 80d99010-0735-4284-b04f-1b8cb8dbbeba {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:27:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-49e430ea-a064-43c7-b594-a81ed90869b9 tempest-VolumesActionsTest-1125789447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-49e430ea-a064-43c7-b594-a81ed90869b9 tempest-VolumesActionsTest-1125789447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:58 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-49e430ea-a064-43c7-b594-a81ed90869b9 tempest-VolumesActionsTest-1125789447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:58 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-49e430ea-a064-43c7-b594-a81ed90869b9 tempest-VolumesActionsTest-1125789447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-49e430ea-a064-43c7-b594-a81ed90869b9 tempest-VolumesActionsTest-1125789447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:58 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-49e430ea-a064-43c7-b594-a81ed90869b9 tempest-VolumesActionsTest-1125789447 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:27:58 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-49e430ea-a064-43c7-b594-a81ed90869b9 tempest-VolumesActionsTest-1125789447 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:27:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-49e430ea-a064-43c7-b594-a81ed90869b9 tempest-VolumesActionsTest-1125789447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-80d99010-0735-4284-b04f-1b8cb8dbbeba 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:58 devstack sudo[103076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-80d99010-0735-4284-b04f-1b8cb8dbbeba 1073741824 Sep 23 00:27:58 devstack sudo[103076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c423c66b-eff9-4ca5-b51a-c2c40833d066 tempest-TestStampPattern-410397350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44751286-b08a-48c6-9a52-ed14eb609d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-208fb30b-33b5-4e74-98f4-bc6c32f1e596', 'volume_size': 1, 'snapshot_id': 'f00cdcbe-6149-45c7-b696-4b521da55dd7'}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c423c66b-eff9-4ca5-b51a-c2c40833d066 tempest-TestStampPattern-410397350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fcd36ed-57ff-4bbf-85a9-c948e7532c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:58 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-c423c66b-eff9-4ca5-b51a-c2c40833d066 tempest-TestStampPattern-410397350 None] Volume volume-208fb30b-33b5-4e74-98f4-bc6c32f1e596 (208fb30b-33b5-4e74-98f4-bc6c32f1e596): created successfully Sep 23 00:27:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c423c66b-eff9-4ca5-b51a-c2c40833d066 tempest-TestStampPattern-410397350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fcd36ed-57ff-4bbf-85a9-c948e7532c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c423c66b-eff9-4ca5-b51a-c2c40833d066 tempest-TestStampPattern-410397350 None] Flow 'volume_create_manager' (9790ad8f-1da0-4975-a502-5d8049285fb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:27:58 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-c423c66b-eff9-4ca5-b51a-c2c40833d066 tempest-TestStampPattern-410397350 None] Created volume successfully. Sep 23 00:27:59 devstack sudo[103076]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-49e430ea-a064-43c7-b594-a81ed90869b9 tempest-VolumesActionsTest-1125789447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-80d99010-0735-4284-b04f-1b8cb8dbbeba 1073741824" returned: 0 in 0.667s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-49e430ea-a064-43c7-b594-a81ed90869b9 tempest-VolumesActionsTest-1125789447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-80d99010-0735-4284-b04f-1b8cb8dbbeba {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:59 devstack sudo[103083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-80d99010-0735-4284-b04f-1b8cb8dbbeba Sep 23 00:27:59 devstack sudo[103083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:59 devstack sudo[103083]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-49e430ea-a064-43c7-b594-a81ed90869b9 tempest-VolumesActionsTest-1125789447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-80d99010-0735-4284-b04f-1b8cb8dbbeba" returned: 0 in 0.547s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-49e430ea-a064-43c7-b594-a81ed90869b9 tempest-VolumesActionsTest-1125789447 None] <== create_volume: return (1275ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:27:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-49e430ea-a064-43c7-b594-a81ed90869b9 tempest-VolumesActionsTest-1125789447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.282s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-49e430ea-a064-43c7-b594-a81ed90869b9 tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a053266-d0f2-48ab-bec3-ed63ff57493a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80d99010-0735-4284-b04f-1b8cb8dbbeba', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-49e430ea-a064-43c7-b594-a81ed90869b9 tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (536f1382-3796-4eb2-a5a8-81924d121061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:59 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-49e430ea-a064-43c7-b594-a81ed90869b9 tempest-VolumesActionsTest-1125789447 None] Volume volume-80d99010-0735-4284-b04f-1b8cb8dbbeba (80d99010-0735-4284-b04f-1b8cb8dbbeba): created successfully Sep 23 00:27:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-49e430ea-a064-43c7-b594-a81ed90869b9 tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (536f1382-3796-4eb2-a5a8-81924d121061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-49e430ea-a064-43c7-b594-a81ed90869b9 tempest-VolumesActionsTest-1125789447 None] Flow 'volume_create_manager' (6e4af141-cd91-401e-afb1-3424b3aa0db6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:27:59 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-49e430ea-a064-43c7-b594-a81ed90869b9 tempest-VolumesActionsTest-1125789447 None] Created volume successfully. Sep 23 00:28:00 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7954204-fd5e-418b-a4dd-116501da4228 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:28:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f7954204-fd5e-418b-a4dd-116501da4228 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Flow 'volume_create_manager' (85651b7e-5ec0-463b-b0c6-b0ffaef30f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f7954204-fd5e-418b-a4dd-116501da4228 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fc0b64b-ba80-4c05-b073-e92e1e92e514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f7954204-fd5e-418b-a4dd-116501da4228 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fc0b64b-ba80-4c05-b073-e92e1e92e514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-644153473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ebd44d8-3b2e-4beb-bb98-51e005c75d94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b5aa029186d4c60ad6d274adc4acd7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:00Z,use_quota=True,user_id='330aac1cc8414ba2b533f9de171c48bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f7954204-fd5e-418b-a4dd-116501da4228 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (840a93d0-cec1-428f-b0dd-59c3a8df811d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f7954204-fd5e-418b-a4dd-116501da4228 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (840a93d0-cec1-428f-b0dd-59c3a8df811d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f7954204-fd5e-418b-a4dd-116501da4228 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b498e474-5c5b-4759-bdae-cae7c628534f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f7954204-fd5e-418b-a4dd-116501da4228 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b498e474-5c5b-4759-bdae-cae7c628534f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ebd44d8-3b2e-4beb-bb98-51e005c75d94', 'volume_name': 'volume-9ebd44d8-3b2e-4beb-bb98-51e005c75d94', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f7954204-fd5e-418b-a4dd-116501da4228 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2d7be38-6b07-4d24-b387-dead14fb0041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f7954204-fd5e-418b-a4dd-116501da4228 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2d7be38-6b07-4d24-b387-dead14fb0041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f7954204-fd5e-418b-a4dd-116501da4228 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84b92364-354c-4bb9-b40a-f8e1fef0cd15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:00 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-f7954204-fd5e-418b-a4dd-116501da4228 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Volume 9ebd44d8-3b2e-4beb-bb98-51e005c75d94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ebd44d8-3b2e-4beb-bb98-51e005c75d94', 'volume_size': 1} Sep 23 00:28:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f7954204-fd5e-418b-a4dd-116501da4228 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f7954204-fd5e-418b-a4dd-116501da4228 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:00 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f7954204-fd5e-418b-a4dd-116501da4228 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-644153473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ebd44d8-3b2e-4beb-bb98-51e005c75d94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b5aa029186d4c60ad6d274adc4acd7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:00Z,use_quota=True,user_id='330aac1cc8414ba2b533f9de171c48bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:28:00 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-f7954204-fd5e-418b-a4dd-116501da4228 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Creating volume 9ebd44d8-3b2e-4beb-bb98-51e005c75d94 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:28:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f7954204-fd5e-418b-a4dd-116501da4228 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f7954204-fd5e-418b-a4dd-116501da4228 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:00 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f7954204-fd5e-418b-a4dd-116501da4228 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:00 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f7954204-fd5e-418b-a4dd-116501da4228 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f7954204-fd5e-418b-a4dd-116501da4228 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:00 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f7954204-fd5e-418b-a4dd-116501da4228 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:28:00 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-f7954204-fd5e-418b-a4dd-116501da4228 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:28:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f7954204-fd5e-418b-a4dd-116501da4228 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9ebd44d8-3b2e-4beb-bb98-51e005c75d94 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:00 devstack sudo[103088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9ebd44d8-3b2e-4beb-bb98-51e005c75d94 1073741824 Sep 23 00:28:00 devstack sudo[103088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:00 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-7b22a66f-8bf5-4748-8aa8-0320db173518 tempest-VolumesActionsTest-1863826308 None] Acquiring lock "cinder-80d99010-0735-4284-b04f-1b8cb8dbbeba-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:00 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-7b22a66f-8bf5-4748-8aa8-0320db173518 tempest-VolumesActionsTest-1863826308 None] Lock "cinder-80d99010-0735-4284-b04f-1b8cb8dbbeba-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:00 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-7b22a66f-8bf5-4748-8aa8-0320db173518 tempest-VolumesActionsTest-1863826308 None] Acquiring lock "cinder-quobyte-80d99010-0735-4284-b04f-1b8cb8dbbeba" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:00 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-7b22a66f-8bf5-4748-8aa8-0320db173518 tempest-VolumesActionsTest-1863826308 None] Lock "cinder-quobyte-80d99010-0735-4284-b04f-1b8cb8dbbeba" acquired by "delete_volume" :: waited 0.033s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:00 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[99cfee06-f40e-47fa-a22a-638b247f2d60]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7b22a66f-8bf5-4748-8aa8-0320db173518 tempest-VolumesActionsTest-1863826308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-80d99010-0735-4284-b04f-1b8cb8dbbeba {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:00 devstack sudo[103088]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f7954204-fd5e-418b-a4dd-116501da4228 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9ebd44d8-3b2e-4beb-bb98-51e005c75d94 1073741824" returned: 0 in 0.638s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f7954204-fd5e-418b-a4dd-116501da4228 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9ebd44d8-3b2e-4beb-bb98-51e005c75d94 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:01 devstack sudo[103095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9ebd44d8-3b2e-4beb-bb98-51e005c75d94 Sep 23 00:28:01 devstack sudo[103095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:01 devstack sudo[103094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-80d99010-0735-4284-b04f-1b8cb8dbbeba Sep 23 00:28:01 devstack sudo[103094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:01 devstack sudo[103095]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f7954204-fd5e-418b-a4dd-116501da4228 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9ebd44d8-3b2e-4beb-bb98-51e005c75d94" returned: 0 in 0.348s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f7954204-fd5e-418b-a4dd-116501da4228 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:28:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f7954204-fd5e-418b-a4dd-116501da4228 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f7954204-fd5e-418b-a4dd-116501da4228 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84b92364-354c-4bb9-b40a-f8e1fef0cd15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ebd44d8-3b2e-4beb-bb98-51e005c75d94', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f7954204-fd5e-418b-a4dd-116501da4228 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a09baca9-4618-493b-8a92-731b81d5ab2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:01 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-f7954204-fd5e-418b-a4dd-116501da4228 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Volume volume-9ebd44d8-3b2e-4beb-bb98-51e005c75d94 (9ebd44d8-3b2e-4beb-bb98-51e005c75d94): created successfully Sep 23 00:28:01 devstack sudo[103094]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f7954204-fd5e-418b-a4dd-116501da4228 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a09baca9-4618-493b-8a92-731b81d5ab2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f7954204-fd5e-418b-a4dd-116501da4228 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Flow 'volume_create_manager' (85651b7e-5ec0-463b-b0c6-b0ffaef30f31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7b22a66f-8bf5-4748-8aa8-0320db173518 tempest-VolumesActionsTest-1863826308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-80d99010-0735-4284-b04f-1b8cb8dbbeba" returned: 0 in 0.511s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7b22a66f-8bf5-4748-8aa8-0320db173518 tempest-VolumesActionsTest-1863826308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-80d99010-0735-4284-b04f-1b8cb8dbbeba {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:01 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-f7954204-fd5e-418b-a4dd-116501da4228 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Created volume successfully. Sep 23 00:28:01 devstack sudo[103102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-80d99010-0735-4284-b04f-1b8cb8dbbeba Sep 23 00:28:01 devstack sudo[103102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:01 devstack sudo[103102]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7b22a66f-8bf5-4748-8aa8-0320db173518 tempest-VolumesActionsTest-1863826308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-80d99010-0735-4284-b04f-1b8cb8dbbeba" returned: 0 in 0.339s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:01 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-7b22a66f-8bf5-4748-8aa8-0320db173518 tempest-VolumesActionsTest-1863826308 None] Lock "cinder-quobyte-80d99010-0735-4284-b04f-1b8cb8dbbeba" released by "delete_volume" :: held 0.925s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:01 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-7b22a66f-8bf5-4748-8aa8-0320db173518 tempest-VolumesActionsTest-1863826308 None] Created reservations ['17eaca50-ba02-481a-8db4-9b3c87738ffd', '79c60907-d890-4ded-9097-b5b6cd811d1d', '6e3da85a-3ee4-4534-8782-e537355af54b', '0fd4ac2f-945f-4592-97e8-45e5b26d3ae2'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:28:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7b22a66f-8bf5-4748-8aa8-0320db173518 tempest-VolumesActionsTest-1863826308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7b22a66f-8bf5-4748-8aa8-0320db173518 tempest-VolumesActionsTest-1863826308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:02 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7b22a66f-8bf5-4748-8aa8-0320db173518 tempest-VolumesActionsTest-1863826308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:02 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7b22a66f-8bf5-4748-8aa8-0320db173518 tempest-VolumesActionsTest-1863826308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7b22a66f-8bf5-4748-8aa8-0320db173518 tempest-VolumesActionsTest-1863826308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7b22a66f-8bf5-4748-8aa8-0320db173518 tempest-VolumesActionsTest-1863826308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:02 devstack sudo[103105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:28:02 devstack sudo[103105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:02 devstack sudo[103105]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7b22a66f-8bf5-4748-8aa8-0320db173518 tempest-VolumesActionsTest-1863826308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.541s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:02 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-7b22a66f-8bf5-4748-8aa8-0320db173518 tempest-VolumesActionsTest-1863826308 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:28:02 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-7b22a66f-8bf5-4748-8aa8-0320db173518 tempest-VolumesActionsTest-1863826308 None] Deleted volume successfully. Sep 23 00:28:02 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-7b22a66f-8bf5-4748-8aa8-0320db173518 tempest-VolumesActionsTest-1863826308 None] Lock "cinder-80d99010-0735-4284-b04f-1b8cb8dbbeba-delete_volume" released by "delete_volume" :: held 1.873s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:03 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f0a9fdb-9456-4ab6-8ee5-b82abf3fff55 tempest-VolumesActionsTest-1125789447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:28:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1f0a9fdb-9456-4ab6-8ee5-b82abf3fff55 tempest-VolumesActionsTest-1125789447 None] Flow 'volume_create_manager' (6aee4cce-4bed-4951-843b-d578087d029b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1f0a9fdb-9456-4ab6-8ee5-b82abf3fff55 tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0703cd1-4da2-4440-a46e-ecb68921ec1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1f0a9fdb-9456-4ab6-8ee5-b82abf3fff55 tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0703cd1-4da2-4440-a46e-ecb68921ec1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1572638410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66f3b007-04df-4436-8ecc-de7f668bce8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddd891706fd54f54b6ac023a39d90b64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:03Z,use_quota=True,user_id='d987a0f9ce5d4654bb1069f3c7a3cddb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1f0a9fdb-9456-4ab6-8ee5-b82abf3fff55 tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0bced9b-b4e6-47cc-b260-32aea49ebca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1f0a9fdb-9456-4ab6-8ee5-b82abf3fff55 tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0bced9b-b4e6-47cc-b260-32aea49ebca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1f0a9fdb-9456-4ab6-8ee5-b82abf3fff55 tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1068290d-af0e-40d6-994a-78d37f1efa49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1f0a9fdb-9456-4ab6-8ee5-b82abf3fff55 tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1068290d-af0e-40d6-994a-78d37f1efa49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66f3b007-04df-4436-8ecc-de7f668bce8d', 'volume_name': 'volume-66f3b007-04df-4436-8ecc-de7f668bce8d', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1f0a9fdb-9456-4ab6-8ee5-b82abf3fff55 tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e08a1eed-ba78-4b39-aac4-b61c5d38f235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1f0a9fdb-9456-4ab6-8ee5-b82abf3fff55 tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e08a1eed-ba78-4b39-aac4-b61c5d38f235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:03 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1f0a9fdb-9456-4ab6-8ee5-b82abf3fff55 tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e211862-95b6-4e41-bf40-060cb025d5d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:03 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-1f0a9fdb-9456-4ab6-8ee5-b82abf3fff55 tempest-VolumesActionsTest-1125789447 None] Volume 66f3b007-04df-4436-8ecc-de7f668bce8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66f3b007-04df-4436-8ecc-de7f668bce8d', 'volume_size': 1} Sep 23 00:28:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1f0a9fdb-9456-4ab6-8ee5-b82abf3fff55 tempest-VolumesActionsTest-1125789447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1f0a9fdb-9456-4ab6-8ee5-b82abf3fff55 tempest-VolumesActionsTest-1125789447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:03 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1f0a9fdb-9456-4ab6-8ee5-b82abf3fff55 tempest-VolumesActionsTest-1125789447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1572638410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66f3b007-04df-4436-8ecc-de7f668bce8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddd891706fd54f54b6ac023a39d90b64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:03Z,use_quota=True,user_id='d987a0f9ce5d4654bb1069f3c7a3cddb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:28:03 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-1f0a9fdb-9456-4ab6-8ee5-b82abf3fff55 tempest-VolumesActionsTest-1125789447 None] Creating volume 66f3b007-04df-4436-8ecc-de7f668bce8d {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:28:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1f0a9fdb-9456-4ab6-8ee5-b82abf3fff55 tempest-VolumesActionsTest-1125789447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1f0a9fdb-9456-4ab6-8ee5-b82abf3fff55 tempest-VolumesActionsTest-1125789447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:03 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1f0a9fdb-9456-4ab6-8ee5-b82abf3fff55 tempest-VolumesActionsTest-1125789447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:03 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1f0a9fdb-9456-4ab6-8ee5-b82abf3fff55 tempest-VolumesActionsTest-1125789447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1f0a9fdb-9456-4ab6-8ee5-b82abf3fff55 tempest-VolumesActionsTest-1125789447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:03 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1f0a9fdb-9456-4ab6-8ee5-b82abf3fff55 tempest-VolumesActionsTest-1125789447 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:28:03 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-1f0a9fdb-9456-4ab6-8ee5-b82abf3fff55 tempest-VolumesActionsTest-1125789447 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:28:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1f0a9fdb-9456-4ab6-8ee5-b82abf3fff55 tempest-VolumesActionsTest-1125789447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-66f3b007-04df-4436-8ecc-de7f668bce8d 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:03 devstack sudo[103109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-66f3b007-04df-4436-8ecc-de7f668bce8d 1073741824 Sep 23 00:28:03 devstack sudo[103109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:04 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-6371c406-1c83-4957-bd25-636179a555c7 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:28:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6371c406-1c83-4957-bd25-636179a555c7 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Flow 'volume_create_manager' (d1b55860-fd1b-423a-9ec2-bfbd220c65e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6371c406-1c83-4957-bd25-636179a555c7 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e40e655-0861-4384-a0a1-2d0f92350023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6371c406-1c83-4957-bd25-636179a555c7 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e40e655-0861-4384-a0a1-2d0f92350023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-620245170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b65626b-f8dc-40f5-b924-c53981de9ad6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b5aa029186d4c60ad6d274adc4acd7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:04Z,use_quota=True,user_id='330aac1cc8414ba2b533f9de171c48bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6371c406-1c83-4957-bd25-636179a555c7 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (479fcf14-4154-444f-b93b-9cfcda760bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6371c406-1c83-4957-bd25-636179a555c7 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (479fcf14-4154-444f-b93b-9cfcda760bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6371c406-1c83-4957-bd25-636179a555c7 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (116bc5eb-e115-461f-abb6-26083ee0b22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6371c406-1c83-4957-bd25-636179a555c7 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (116bc5eb-e115-461f-abb6-26083ee0b22c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b65626b-f8dc-40f5-b924-c53981de9ad6', 'volume_name': 'volume-8b65626b-f8dc-40f5-b924-c53981de9ad6', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6371c406-1c83-4957-bd25-636179a555c7 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a8c84f2-b872-4f31-829f-335ca780341c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6371c406-1c83-4957-bd25-636179a555c7 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a8c84f2-b872-4f31-829f-335ca780341c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6371c406-1c83-4957-bd25-636179a555c7 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f23d54b5-a6da-444f-a7d8-6185c9986db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:04 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-6371c406-1c83-4957-bd25-636179a555c7 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Volume 8b65626b-f8dc-40f5-b924-c53981de9ad6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b65626b-f8dc-40f5-b924-c53981de9ad6', 'volume_size': 1} Sep 23 00:28:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6371c406-1c83-4957-bd25-636179a555c7 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:04 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-64140c1d-2c70-4e7c-acd7-3f5cc87c330a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:28:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-64140c1d-2c70-4e7c-acd7-3f5cc87c330a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Flow 'volume_create_manager' (d60aa0b2-4139-4aa7-9ba3-26b8b6a65519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-64140c1d-2c70-4e7c-acd7-3f5cc87c330a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e85fea4e-537a-4446-9c73-933ab2bc6746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-64140c1d-2c70-4e7c-acd7-3f5cc87c330a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e85fea4e-537a-4446-9c73-933ab2bc6746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1289621059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32cff445-6610-4795-8db5-b105ce023213,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b5aa029186d4c60ad6d274adc4acd7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:04Z,use_quota=True,user_id='330aac1cc8414ba2b533f9de171c48bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-64140c1d-2c70-4e7c-acd7-3f5cc87c330a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19d9448e-58c4-4ddc-8816-43eeb4cf3fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-64140c1d-2c70-4e7c-acd7-3f5cc87c330a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19d9448e-58c4-4ddc-8816-43eeb4cf3fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-64140c1d-2c70-4e7c-acd7-3f5cc87c330a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a17553f-0372-4759-8910-6a41561aa4ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-64140c1d-2c70-4e7c-acd7-3f5cc87c330a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a17553f-0372-4759-8910-6a41561aa4ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32cff445-6610-4795-8db5-b105ce023213', 'volume_name': 'volume-32cff445-6610-4795-8db5-b105ce023213', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:04 devstack sudo[103109]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-64140c1d-2c70-4e7c-acd7-3f5cc87c330a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c12713b1-7c3c-431b-a46f-8bc0ba3b33c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-64140c1d-2c70-4e7c-acd7-3f5cc87c330a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c12713b1-7c3c-431b-a46f-8bc0ba3b33c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-64140c1d-2c70-4e7c-acd7-3f5cc87c330a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc989f5f-8030-4b8a-a856-1a66f608ed4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:04 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-64140c1d-2c70-4e7c-acd7-3f5cc87c330a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Volume 32cff445-6610-4795-8db5-b105ce023213: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32cff445-6610-4795-8db5-b105ce023213', 'volume_size': 1} Sep 23 00:28:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-64140c1d-2c70-4e7c-acd7-3f5cc87c330a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1f0a9fdb-9456-4ab6-8ee5-b82abf3fff55 tempest-VolumesActionsTest-1125789447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-66f3b007-04df-4436-8ecc-de7f668bce8d 1073741824" returned: 0 in 0.975s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1f0a9fdb-9456-4ab6-8ee5-b82abf3fff55 tempest-VolumesActionsTest-1125789447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-66f3b007-04df-4436-8ecc-de7f668bce8d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:04 devstack sudo[103116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-66f3b007-04df-4436-8ecc-de7f668bce8d Sep 23 00:28:04 devstack sudo[103116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:04 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-06f1409f-fd22-4988-ba48-121a67c5f70a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:28:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-06f1409f-fd22-4988-ba48-121a67c5f70a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Flow 'volume_create_manager' (61a77398-2601-4b1c-bdec-d0ac812e8e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-06f1409f-fd22-4988-ba48-121a67c5f70a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7035d45-c516-475e-be0f-8f260dd6df58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-06f1409f-fd22-4988-ba48-121a67c5f70a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7035d45-c516-475e-be0f-8f260dd6df58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-945966243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93920dcb-376d-4e21-918b-9cdc29eeb4c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b5aa029186d4c60ad6d274adc4acd7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:05Z,use_quota=True,user_id='330aac1cc8414ba2b533f9de171c48bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-06f1409f-fd22-4988-ba48-121a67c5f70a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74ea7554-bcdf-4319-b97b-b63663b47275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-06f1409f-fd22-4988-ba48-121a67c5f70a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74ea7554-bcdf-4319-b97b-b63663b47275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-06f1409f-fd22-4988-ba48-121a67c5f70a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91495af0-f454-463b-9f85-9963a5c97cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-06f1409f-fd22-4988-ba48-121a67c5f70a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91495af0-f454-463b-9f85-9963a5c97cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93920dcb-376d-4e21-918b-9cdc29eeb4c7', 'volume_name': 'volume-93920dcb-376d-4e21-918b-9cdc29eeb4c7', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-06f1409f-fd22-4988-ba48-121a67c5f70a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02720194-c33f-4e78-a7c1-99f0bfbc6e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-06f1409f-fd22-4988-ba48-121a67c5f70a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02720194-c33f-4e78-a7c1-99f0bfbc6e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:04 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-06f1409f-fd22-4988-ba48-121a67c5f70a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e26c8cb3-83c3-4f4a-b29b-b6b33ef3e39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:04 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-06f1409f-fd22-4988-ba48-121a67c5f70a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Volume 93920dcb-376d-4e21-918b-9cdc29eeb4c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93920dcb-376d-4e21-918b-9cdc29eeb4c7', 'volume_size': 1} Sep 23 00:28:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-06f1409f-fd22-4988-ba48-121a67c5f70a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:04 devstack sudo[103116]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1f0a9fdb-9456-4ab6-8ee5-b82abf3fff55 tempest-VolumesActionsTest-1125789447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-66f3b007-04df-4436-8ecc-de7f668bce8d" returned: 0 in 0.328s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:04 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1f0a9fdb-9456-4ab6-8ee5-b82abf3fff55 tempest-VolumesActionsTest-1125789447 None] <== create_volume: return (1385ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:28:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1f0a9fdb-9456-4ab6-8ee5-b82abf3fff55 tempest-VolumesActionsTest-1125789447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.387s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6371c406-1c83-4957-bd25-636179a555c7 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.618s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:04 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6371c406-1c83-4957-bd25-636179a555c7 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-620245170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b65626b-f8dc-40f5-b924-c53981de9ad6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b5aa029186d4c60ad6d274adc4acd7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:04Z,use_quota=True,user_id='330aac1cc8414ba2b533f9de171c48bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:28:04 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-6371c406-1c83-4957-bd25-636179a555c7 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Creating volume 8b65626b-f8dc-40f5-b924-c53981de9ad6 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:28:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6371c406-1c83-4957-bd25-636179a555c7 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6371c406-1c83-4957-bd25-636179a555c7 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:04 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6371c406-1c83-4957-bd25-636179a555c7 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:04 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6371c406-1c83-4957-bd25-636179a555c7 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6371c406-1c83-4957-bd25-636179a555c7 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:04 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6371c406-1c83-4957-bd25-636179a555c7 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:28:04 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-6371c406-1c83-4957-bd25-636179a555c7 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:28:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6371c406-1c83-4957-bd25-636179a555c7 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8b65626b-f8dc-40f5-b924-c53981de9ad6 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1f0a9fdb-9456-4ab6-8ee5-b82abf3fff55 tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e211862-95b6-4e41-bf40-060cb025d5d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66f3b007-04df-4436-8ecc-de7f668bce8d', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:05 devstack sudo[103119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8b65626b-f8dc-40f5-b924-c53981de9ad6 1073741824 Sep 23 00:28:05 devstack sudo[103119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1f0a9fdb-9456-4ab6-8ee5-b82abf3fff55 tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95b3394f-61c4-4aab-ac84-4281e02d4e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:05 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-1f0a9fdb-9456-4ab6-8ee5-b82abf3fff55 tempest-VolumesActionsTest-1125789447 None] Volume volume-66f3b007-04df-4436-8ecc-de7f668bce8d (66f3b007-04df-4436-8ecc-de7f668bce8d): created successfully Sep 23 00:28:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1f0a9fdb-9456-4ab6-8ee5-b82abf3fff55 tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95b3394f-61c4-4aab-ac84-4281e02d4e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1f0a9fdb-9456-4ab6-8ee5-b82abf3fff55 tempest-VolumesActionsTest-1125789447 None] Flow 'volume_create_manager' (6aee4cce-4bed-4951-843b-d578087d029b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:05 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-1f0a9fdb-9456-4ab6-8ee5-b82abf3fff55 tempest-VolumesActionsTest-1125789447 None] Created volume successfully. Sep 23 00:28:05 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-c12c27d0-a139-4b5f-8a3f-bca5e0dbc18c tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:28:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c12c27d0-a139-4b5f-8a3f-bca5e0dbc18c tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Flow 'volume_create_manager' (e98ecff1-9146-41f7-b07c-0ffc1aec22dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c12c27d0-a139-4b5f-8a3f-bca5e0dbc18c tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75adc9a4-7f68-40b8-b596-5eaeb1301c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c12c27d0-a139-4b5f-8a3f-bca5e0dbc18c tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75adc9a4-7f68-40b8-b596-5eaeb1301c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-527373258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b19ad9b-defb-43fb-b236-acbe013ec556,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b5aa029186d4c60ad6d274adc4acd7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:05Z,use_quota=True,user_id='330aac1cc8414ba2b533f9de171c48bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c12c27d0-a139-4b5f-8a3f-bca5e0dbc18c tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e6a4d2f-bbe4-4b6b-9c5c-c4e0ec5ad294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c12c27d0-a139-4b5f-8a3f-bca5e0dbc18c tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e6a4d2f-bbe4-4b6b-9c5c-c4e0ec5ad294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c12c27d0-a139-4b5f-8a3f-bca5e0dbc18c tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd6b642e-a8e9-46ea-8b29-fae5bf27356c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c12c27d0-a139-4b5f-8a3f-bca5e0dbc18c tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd6b642e-a8e9-46ea-8b29-fae5bf27356c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b19ad9b-defb-43fb-b236-acbe013ec556', 'volume_name': 'volume-7b19ad9b-defb-43fb-b236-acbe013ec556', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c12c27d0-a139-4b5f-8a3f-bca5e0dbc18c tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01eaa087-d827-4776-a1b2-10049b3c5b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c12c27d0-a139-4b5f-8a3f-bca5e0dbc18c tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01eaa087-d827-4776-a1b2-10049b3c5b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c12c27d0-a139-4b5f-8a3f-bca5e0dbc18c tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2a88444-d38a-463b-b408-a3d4eb144d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:05 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-c12c27d0-a139-4b5f-8a3f-bca5e0dbc18c tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Volume 7b19ad9b-defb-43fb-b236-acbe013ec556: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b19ad9b-defb-43fb-b236-acbe013ec556', 'volume_size': 1} Sep 23 00:28:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c12c27d0-a139-4b5f-8a3f-bca5e0dbc18c tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:05 devstack sudo[103119]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6371c406-1c83-4957-bd25-636179a555c7 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8b65626b-f8dc-40f5-b924-c53981de9ad6 1073741824" returned: 0 in 0.868s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6371c406-1c83-4957-bd25-636179a555c7 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8b65626b-f8dc-40f5-b924-c53981de9ad6 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:05 devstack sudo[103126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8b65626b-f8dc-40f5-b924-c53981de9ad6 Sep 23 00:28:05 devstack sudo[103126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:06 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed77bfa6-36a2-4d73-913b-f2fea17f3df4 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:28:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ed77bfa6-36a2-4d73-913b-f2fea17f3df4 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Flow 'volume_create_manager' (9732c4b7-bee5-4f36-9029-623f1ae69dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ed77bfa6-36a2-4d73-913b-f2fea17f3df4 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3329c652-1d0b-4c6f-b32f-b8a3b22dd731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ed77bfa6-36a2-4d73-913b-f2fea17f3df4 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3329c652-1d0b-4c6f-b32f-b8a3b22dd731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-305216948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25bcf6c8-33f5-4fa8-84c6-229b048442ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b5aa029186d4c60ad6d274adc4acd7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:06Z,use_quota=True,user_id='330aac1cc8414ba2b533f9de171c48bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ed77bfa6-36a2-4d73-913b-f2fea17f3df4 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d35e3fb8-a566-4e2b-b71a-affa60126eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ed77bfa6-36a2-4d73-913b-f2fea17f3df4 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d35e3fb8-a566-4e2b-b71a-affa60126eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ed77bfa6-36a2-4d73-913b-f2fea17f3df4 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (186934c8-16ec-442b-af15-3a932a911cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ed77bfa6-36a2-4d73-913b-f2fea17f3df4 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (186934c8-16ec-442b-af15-3a932a911cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25bcf6c8-33f5-4fa8-84c6-229b048442ee', 'volume_name': 'volume-25bcf6c8-33f5-4fa8-84c6-229b048442ee', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ed77bfa6-36a2-4d73-913b-f2fea17f3df4 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09d29ae9-732e-4173-afd1-5c4ac906f37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ed77bfa6-36a2-4d73-913b-f2fea17f3df4 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09d29ae9-732e-4173-afd1-5c4ac906f37e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ed77bfa6-36a2-4d73-913b-f2fea17f3df4 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83bff206-63dc-4e77-b1b1-f6867f7685f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:06 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-ed77bfa6-36a2-4d73-913b-f2fea17f3df4 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Volume 25bcf6c8-33f5-4fa8-84c6-229b048442ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25bcf6c8-33f5-4fa8-84c6-229b048442ee', 'volume_size': 1} Sep 23 00:28:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ed77bfa6-36a2-4d73-913b-f2fea17f3df4 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:06 devstack sudo[103126]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6371c406-1c83-4957-bd25-636179a555c7 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8b65626b-f8dc-40f5-b924-c53981de9ad6" returned: 0 in 0.335s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6371c406-1c83-4957-bd25-636179a555c7 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] <== create_volume: return (1263ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:28:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6371c406-1c83-4957-bd25-636179a555c7 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.268s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-64140c1d-2c70-4e7c-acd7-3f5cc87c330a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.675s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-64140c1d-2c70-4e7c-acd7-3f5cc87c330a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1289621059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32cff445-6610-4795-8db5-b105ce023213,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b5aa029186d4c60ad6d274adc4acd7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:04Z,use_quota=True,user_id='330aac1cc8414ba2b533f9de171c48bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:28:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-64140c1d-2c70-4e7c-acd7-3f5cc87c330a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Creating volume 32cff445-6610-4795-8db5-b105ce023213 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:28:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-64140c1d-2c70-4e7c-acd7-3f5cc87c330a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-64140c1d-2c70-4e7c-acd7-3f5cc87c330a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-64140c1d-2c70-4e7c-acd7-3f5cc87c330a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-64140c1d-2c70-4e7c-acd7-3f5cc87c330a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-64140c1d-2c70-4e7c-acd7-3f5cc87c330a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-64140c1d-2c70-4e7c-acd7-3f5cc87c330a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:28:06 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-64140c1d-2c70-4e7c-acd7-3f5cc87c330a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:28:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-64140c1d-2c70-4e7c-acd7-3f5cc87c330a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-32cff445-6610-4795-8db5-b105ce023213 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6371c406-1c83-4957-bd25-636179a555c7 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f23d54b5-a6da-444f-a7d8-6185c9986db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b65626b-f8dc-40f5-b924-c53981de9ad6', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6371c406-1c83-4957-bd25-636179a555c7 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f72ec76f-02d2-4883-9835-9122a426d24d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:06 devstack sudo[103130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-32cff445-6610-4795-8db5-b105ce023213 1073741824 Sep 23 00:28:06 devstack sudo[103130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:06 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-6371c406-1c83-4957-bd25-636179a555c7 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Volume volume-8b65626b-f8dc-40f5-b924-c53981de9ad6 (8b65626b-f8dc-40f5-b924-c53981de9ad6): created successfully Sep 23 00:28:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6371c406-1c83-4957-bd25-636179a555c7 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f72ec76f-02d2-4883-9835-9122a426d24d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6371c406-1c83-4957-bd25-636179a555c7 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Flow 'volume_create_manager' (d1b55860-fd1b-423a-9ec2-bfbd220c65e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:06 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-6371c406-1c83-4957-bd25-636179a555c7 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Created volume successfully. Sep 23 00:28:06 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ac426156-b944-4e66-8529-1b3ea93d5966 tempest-VolumesActionsTest-1863826308 None] Acquiring lock "cinder-66f3b007-04df-4436-8ecc-de7f668bce8d-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:06 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ac426156-b944-4e66-8529-1b3ea93d5966 tempest-VolumesActionsTest-1863826308 None] Lock "cinder-66f3b007-04df-4436-8ecc-de7f668bce8d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:06 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ac426156-b944-4e66-8529-1b3ea93d5966 tempest-VolumesActionsTest-1863826308 None] Acquiring lock "cinder-quobyte-66f3b007-04df-4436-8ecc-de7f668bce8d" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:06 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ac426156-b944-4e66-8529-1b3ea93d5966 tempest-VolumesActionsTest-1863826308 None] Lock "cinder-quobyte-66f3b007-04df-4436-8ecc-de7f668bce8d" acquired by "delete_volume" :: waited 0.020s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:06 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5323c2e-fb69-4e4e-842c-f1d3a8dbe147]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ac426156-b944-4e66-8529-1b3ea93d5966 tempest-VolumesActionsTest-1863826308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-66f3b007-04df-4436-8ecc-de7f668bce8d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:06 devstack sudo[103130]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-64140c1d-2c70-4e7c-acd7-3f5cc87c330a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-32cff445-6610-4795-8db5-b105ce023213 1073741824" returned: 0 in 0.688s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-64140c1d-2c70-4e7c-acd7-3f5cc87c330a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-32cff445-6610-4795-8db5-b105ce023213 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:07 devstack sudo[103137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-32cff445-6610-4795-8db5-b105ce023213 Sep 23 00:28:07 devstack sudo[103137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:07 devstack sudo[103136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-66f3b007-04df-4436-8ecc-de7f668bce8d Sep 23 00:28:07 devstack sudo[103136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:07 devstack sudo[103137]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-64140c1d-2c70-4e7c-acd7-3f5cc87c330a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-32cff445-6610-4795-8db5-b105ce023213" returned: 0 in 0.272s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:07 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-64140c1d-2c70-4e7c-acd7-3f5cc87c330a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:28:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-64140c1d-2c70-4e7c-acd7-3f5cc87c330a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-06f1409f-fd22-4988-ba48-121a67c5f70a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.352s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:07 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-06f1409f-fd22-4988-ba48-121a67c5f70a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-945966243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93920dcb-376d-4e21-918b-9cdc29eeb4c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b5aa029186d4c60ad6d274adc4acd7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:05Z,use_quota=True,user_id='330aac1cc8414ba2b533f9de171c48bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:28:07 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-06f1409f-fd22-4988-ba48-121a67c5f70a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Creating volume 93920dcb-376d-4e21-918b-9cdc29eeb4c7 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:28:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-06f1409f-fd22-4988-ba48-121a67c5f70a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-06f1409f-fd22-4988-ba48-121a67c5f70a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:07 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-06f1409f-fd22-4988-ba48-121a67c5f70a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:07 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-06f1409f-fd22-4988-ba48-121a67c5f70a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-06f1409f-fd22-4988-ba48-121a67c5f70a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:07 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-06f1409f-fd22-4988-ba48-121a67c5f70a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:28:07 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-06f1409f-fd22-4988-ba48-121a67c5f70a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:28:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-06f1409f-fd22-4988-ba48-121a67c5f70a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-93920dcb-376d-4e21-918b-9cdc29eeb4c7 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-64140c1d-2c70-4e7c-acd7-3f5cc87c330a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc989f5f-8030-4b8a-a856-1a66f608ed4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32cff445-6610-4795-8db5-b105ce023213', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:07 devstack sudo[103136]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-64140c1d-2c70-4e7c-acd7-3f5cc87c330a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56311e0c-22d6-46f2-b8cb-5505ad6d9675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:07 devstack sudo[103145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-93920dcb-376d-4e21-918b-9cdc29eeb4c7 1073741824 Sep 23 00:28:07 devstack sudo[103145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ac426156-b944-4e66-8529-1b3ea93d5966 tempest-VolumesActionsTest-1863826308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-66f3b007-04df-4436-8ecc-de7f668bce8d" returned: 0 in 0.491s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ac426156-b944-4e66-8529-1b3ea93d5966 tempest-VolumesActionsTest-1863826308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-66f3b007-04df-4436-8ecc-de7f668bce8d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:07 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-64140c1d-2c70-4e7c-acd7-3f5cc87c330a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Volume volume-32cff445-6610-4795-8db5-b105ce023213 (32cff445-6610-4795-8db5-b105ce023213): created successfully Sep 23 00:28:07 devstack sudo[103147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-66f3b007-04df-4436-8ecc-de7f668bce8d Sep 23 00:28:07 devstack sudo[103147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-64140c1d-2c70-4e7c-acd7-3f5cc87c330a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56311e0c-22d6-46f2-b8cb-5505ad6d9675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-64140c1d-2c70-4e7c-acd7-3f5cc87c330a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Flow 'volume_create_manager' (d60aa0b2-4139-4aa7-9ba3-26b8b6a65519) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:07 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-64140c1d-2c70-4e7c-acd7-3f5cc87c330a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Created volume successfully. Sep 23 00:28:07 devstack sudo[103147]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ac426156-b944-4e66-8529-1b3ea93d5966 tempest-VolumesActionsTest-1863826308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-66f3b007-04df-4436-8ecc-de7f668bce8d" returned: 0 in 0.288s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:07 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ac426156-b944-4e66-8529-1b3ea93d5966 tempest-VolumesActionsTest-1863826308 None] Lock "cinder-quobyte-66f3b007-04df-4436-8ecc-de7f668bce8d" released by "delete_volume" :: held 0.837s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:07 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-ac426156-b944-4e66-8529-1b3ea93d5966 tempest-VolumesActionsTest-1863826308 None] Created reservations ['f0571014-91bc-452f-8170-99cb3ef53077', '41c8ba92-fcff-46a5-9316-29071b641383', '3ea8d472-bca9-467e-a89c-1b37e88b761e', 'fe17f952-2b24-4f71-92db-a87d55e6e861'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:28:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ac426156-b944-4e66-8529-1b3ea93d5966 tempest-VolumesActionsTest-1863826308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ac426156-b944-4e66-8529-1b3ea93d5966 tempest-VolumesActionsTest-1863826308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:07 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ac426156-b944-4e66-8529-1b3ea93d5966 tempest-VolumesActionsTest-1863826308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:07 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ac426156-b944-4e66-8529-1b3ea93d5966 tempest-VolumesActionsTest-1863826308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ac426156-b944-4e66-8529-1b3ea93d5966 tempest-VolumesActionsTest-1863826308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ac426156-b944-4e66-8529-1b3ea93d5966 tempest-VolumesActionsTest-1863826308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:07 devstack sudo[103145]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:07 devstack sudo[103154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:28:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-06f1409f-fd22-4988-ba48-121a67c5f70a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-93920dcb-376d-4e21-918b-9cdc29eeb4c7 1073741824" returned: 0 in 0.574s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:07 devstack sudo[103154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-06f1409f-fd22-4988-ba48-121a67c5f70a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-93920dcb-376d-4e21-918b-9cdc29eeb4c7 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:07 devstack sudo[103156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-93920dcb-376d-4e21-918b-9cdc29eeb4c7 Sep 23 00:28:07 devstack sudo[103156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:08 devstack sudo[103154]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ac426156-b944-4e66-8529-1b3ea93d5966 tempest-VolumesActionsTest-1863826308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.423s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:08 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-ac426156-b944-4e66-8529-1b3ea93d5966 tempest-VolumesActionsTest-1863826308 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:28:08 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-ac426156-b944-4e66-8529-1b3ea93d5966 tempest-VolumesActionsTest-1863826308 None] Deleted volume successfully. Sep 23 00:28:08 devstack sudo[103156]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-06f1409f-fd22-4988-ba48-121a67c5f70a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-93920dcb-376d-4e21-918b-9cdc29eeb4c7" returned: 0 in 0.362s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:08 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-06f1409f-fd22-4988-ba48-121a67c5f70a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:28:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-06f1409f-fd22-4988-ba48-121a67c5f70a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c12c27d0-a139-4b5f-8a3f-bca5e0dbc18c tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.671s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:08 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c12c27d0-a139-4b5f-8a3f-bca5e0dbc18c tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-527373258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b19ad9b-defb-43fb-b236-acbe013ec556,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b5aa029186d4c60ad6d274adc4acd7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:05Z,use_quota=True,user_id='330aac1cc8414ba2b533f9de171c48bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:28:08 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-c12c27d0-a139-4b5f-8a3f-bca5e0dbc18c tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Creating volume 7b19ad9b-defb-43fb-b236-acbe013ec556 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:28:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c12c27d0-a139-4b5f-8a3f-bca5e0dbc18c tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c12c27d0-a139-4b5f-8a3f-bca5e0dbc18c tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:08 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c12c27d0-a139-4b5f-8a3f-bca5e0dbc18c tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:08 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c12c27d0-a139-4b5f-8a3f-bca5e0dbc18c tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c12c27d0-a139-4b5f-8a3f-bca5e0dbc18c tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:08 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c12c27d0-a139-4b5f-8a3f-bca5e0dbc18c tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:28:08 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-c12c27d0-a139-4b5f-8a3f-bca5e0dbc18c tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:28:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c12c27d0-a139-4b5f-8a3f-bca5e0dbc18c tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7b19ad9b-defb-43fb-b236-acbe013ec556 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:08 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ac426156-b944-4e66-8529-1b3ea93d5966 tempest-VolumesActionsTest-1863826308 None] Lock "cinder-66f3b007-04df-4436-8ecc-de7f668bce8d-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:08 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-06f1409f-fd22-4988-ba48-121a67c5f70a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e26c8cb3-83c3-4f4a-b29b-b6b33ef3e39b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93920dcb-376d-4e21-918b-9cdc29eeb4c7', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:08 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-06f1409f-fd22-4988-ba48-121a67c5f70a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77a535e4-bf09-413d-b9c5-3c311c7010e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:08 devstack sudo[103160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7b19ad9b-defb-43fb-b236-acbe013ec556 1073741824 Sep 23 00:28:08 devstack sudo[103160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:08 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-06f1409f-fd22-4988-ba48-121a67c5f70a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Volume volume-93920dcb-376d-4e21-918b-9cdc29eeb4c7 (93920dcb-376d-4e21-918b-9cdc29eeb4c7): created successfully Sep 23 00:28:08 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-06f1409f-fd22-4988-ba48-121a67c5f70a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77a535e4-bf09-413d-b9c5-3c311c7010e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:08 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-06f1409f-fd22-4988-ba48-121a67c5f70a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Flow 'volume_create_manager' (61a77398-2601-4b1c-bdec-d0ac812e8e80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:08 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-06f1409f-fd22-4988-ba48-121a67c5f70a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Created volume successfully. Sep 23 00:28:08 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-da9bd6a9-f252-4822-ac5b-2fec00a2d3b5 tempest-VolumesActionsTest-1125789447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:28:08 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-da9bd6a9-f252-4822-ac5b-2fec00a2d3b5 tempest-VolumesActionsTest-1125789447 None] Flow 'volume_create_manager' (5c4807c7-3629-44cd-9f66-440428cb3a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:08 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-da9bd6a9-f252-4822-ac5b-2fec00a2d3b5 tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60af2adb-1f54-4b1b-8aec-dcee03ecdfd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:08 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-da9bd6a9-f252-4822-ac5b-2fec00a2d3b5 tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60af2adb-1f54-4b1b-8aec-dcee03ecdfd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1416797237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20cc9429-e9b3-4088-903d-badce487e1da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddd891706fd54f54b6ac023a39d90b64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:09Z,use_quota=True,user_id='d987a0f9ce5d4654bb1069f3c7a3cddb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:08 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-da9bd6a9-f252-4822-ac5b-2fec00a2d3b5 tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a0a8724-1f5e-43da-9157-beb5b9c6cd89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:08 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-da9bd6a9-f252-4822-ac5b-2fec00a2d3b5 tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a0a8724-1f5e-43da-9157-beb5b9c6cd89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:08 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-da9bd6a9-f252-4822-ac5b-2fec00a2d3b5 tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b9907ec-9ff9-4f47-a2b5-c5976cd2ae70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:08 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-da9bd6a9-f252-4822-ac5b-2fec00a2d3b5 tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b9907ec-9ff9-4f47-a2b5-c5976cd2ae70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20cc9429-e9b3-4088-903d-badce487e1da', 'volume_name': 'volume-20cc9429-e9b3-4088-903d-badce487e1da', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:08 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-da9bd6a9-f252-4822-ac5b-2fec00a2d3b5 tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a81c384-a60e-4e5d-8e53-c5e57f90416b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:08 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-da9bd6a9-f252-4822-ac5b-2fec00a2d3b5 tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a81c384-a60e-4e5d-8e53-c5e57f90416b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:08 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-da9bd6a9-f252-4822-ac5b-2fec00a2d3b5 tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (690ccede-5eec-4e8d-a226-a7b0949bb893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:08 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-da9bd6a9-f252-4822-ac5b-2fec00a2d3b5 tempest-VolumesActionsTest-1125789447 None] Volume 20cc9429-e9b3-4088-903d-badce487e1da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20cc9429-e9b3-4088-903d-badce487e1da', 'volume_size': 1} Sep 23 00:28:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-da9bd6a9-f252-4822-ac5b-2fec00a2d3b5 tempest-VolumesActionsTest-1125789447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:09 devstack sudo[103160]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c12c27d0-a139-4b5f-8a3f-bca5e0dbc18c tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7b19ad9b-defb-43fb-b236-acbe013ec556 1073741824" returned: 0 in 0.700s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c12c27d0-a139-4b5f-8a3f-bca5e0dbc18c tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7b19ad9b-defb-43fb-b236-acbe013ec556 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:09 devstack sudo[103166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7b19ad9b-defb-43fb-b236-acbe013ec556 Sep 23 00:28:09 devstack sudo[103166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:09 devstack sudo[103166]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c12c27d0-a139-4b5f-8a3f-bca5e0dbc18c tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7b19ad9b-defb-43fb-b236-acbe013ec556" returned: 0 in 0.253s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:09 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c12c27d0-a139-4b5f-8a3f-bca5e0dbc18c tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:28:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c12c27d0-a139-4b5f-8a3f-bca5e0dbc18c tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ed77bfa6-36a2-4d73-913b-f2fea17f3df4 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.154s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:09 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ed77bfa6-36a2-4d73-913b-f2fea17f3df4 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-305216948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25bcf6c8-33f5-4fa8-84c6-229b048442ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b5aa029186d4c60ad6d274adc4acd7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:06Z,use_quota=True,user_id='330aac1cc8414ba2b533f9de171c48bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:28:09 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-ed77bfa6-36a2-4d73-913b-f2fea17f3df4 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Creating volume 25bcf6c8-33f5-4fa8-84c6-229b048442ee {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:28:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ed77bfa6-36a2-4d73-913b-f2fea17f3df4 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ed77bfa6-36a2-4d73-913b-f2fea17f3df4 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:09 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ed77bfa6-36a2-4d73-913b-f2fea17f3df4 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:09 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ed77bfa6-36a2-4d73-913b-f2fea17f3df4 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ed77bfa6-36a2-4d73-913b-f2fea17f3df4 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:09 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ed77bfa6-36a2-4d73-913b-f2fea17f3df4 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:28:09 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-ed77bfa6-36a2-4d73-913b-f2fea17f3df4 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:28:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ed77bfa6-36a2-4d73-913b-f2fea17f3df4 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-25bcf6c8-33f5-4fa8-84c6-229b048442ee 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c12c27d0-a139-4b5f-8a3f-bca5e0dbc18c tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2a88444-d38a-463b-b408-a3d4eb144d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b19ad9b-defb-43fb-b236-acbe013ec556', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:09 devstack sudo[103169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-25bcf6c8-33f5-4fa8-84c6-229b048442ee 1073741824 Sep 23 00:28:09 devstack sudo[103169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c12c27d0-a139-4b5f-8a3f-bca5e0dbc18c tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fcb9cca-3860-46b8-98f1-0dd98842829f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:09 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-c12c27d0-a139-4b5f-8a3f-bca5e0dbc18c tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Volume volume-7b19ad9b-defb-43fb-b236-acbe013ec556 (7b19ad9b-defb-43fb-b236-acbe013ec556): created successfully Sep 23 00:28:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c12c27d0-a139-4b5f-8a3f-bca5e0dbc18c tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fcb9cca-3860-46b8-98f1-0dd98842829f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c12c27d0-a139-4b5f-8a3f-bca5e0dbc18c tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Flow 'volume_create_manager' (e98ecff1-9146-41f7-b07c-0ffc1aec22dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:09 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-c12c27d0-a139-4b5f-8a3f-bca5e0dbc18c tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Created volume successfully. Sep 23 00:28:09 devstack sudo[103169]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ed77bfa6-36a2-4d73-913b-f2fea17f3df4 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-25bcf6c8-33f5-4fa8-84c6-229b048442ee 1073741824" returned: 0 in 0.516s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ed77bfa6-36a2-4d73-913b-f2fea17f3df4 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-25bcf6c8-33f5-4fa8-84c6-229b048442ee {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:09 devstack sudo[103175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-25bcf6c8-33f5-4fa8-84c6-229b048442ee Sep 23 00:28:09 devstack sudo[103175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:10 devstack sudo[103175]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ed77bfa6-36a2-4d73-913b-f2fea17f3df4 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-25bcf6c8-33f5-4fa8-84c6-229b048442ee" returned: 0 in 0.269s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:10 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ed77bfa6-36a2-4d73-913b-f2fea17f3df4 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:28:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ed77bfa6-36a2-4d73-913b-f2fea17f3df4 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-da9bd6a9-f252-4822-ac5b-2fec00a2d3b5 tempest-VolumesActionsTest-1125789447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.193s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:10 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-da9bd6a9-f252-4822-ac5b-2fec00a2d3b5 tempest-VolumesActionsTest-1125789447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1416797237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20cc9429-e9b3-4088-903d-badce487e1da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddd891706fd54f54b6ac023a39d90b64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:09Z,use_quota=True,user_id='d987a0f9ce5d4654bb1069f3c7a3cddb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:28:10 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-da9bd6a9-f252-4822-ac5b-2fec00a2d3b5 tempest-VolumesActionsTest-1125789447 None] Creating volume 20cc9429-e9b3-4088-903d-badce487e1da {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:28:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-da9bd6a9-f252-4822-ac5b-2fec00a2d3b5 tempest-VolumesActionsTest-1125789447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-da9bd6a9-f252-4822-ac5b-2fec00a2d3b5 tempest-VolumesActionsTest-1125789447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:10 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-da9bd6a9-f252-4822-ac5b-2fec00a2d3b5 tempest-VolumesActionsTest-1125789447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:10 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-da9bd6a9-f252-4822-ac5b-2fec00a2d3b5 tempest-VolumesActionsTest-1125789447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-da9bd6a9-f252-4822-ac5b-2fec00a2d3b5 tempest-VolumesActionsTest-1125789447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:10 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-da9bd6a9-f252-4822-ac5b-2fec00a2d3b5 tempest-VolumesActionsTest-1125789447 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:28:10 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-da9bd6a9-f252-4822-ac5b-2fec00a2d3b5 tempest-VolumesActionsTest-1125789447 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:28:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-da9bd6a9-f252-4822-ac5b-2fec00a2d3b5 tempest-VolumesActionsTest-1125789447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-20cc9429-e9b3-4088-903d-badce487e1da 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:10 devstack sudo[103178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-20cc9429-e9b3-4088-903d-badce487e1da 1073741824 Sep 23 00:28:10 devstack sudo[103178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ed77bfa6-36a2-4d73-913b-f2fea17f3df4 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83bff206-63dc-4e77-b1b1-f6867f7685f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25bcf6c8-33f5-4fa8-84c6-229b048442ee', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ed77bfa6-36a2-4d73-913b-f2fea17f3df4 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e87d21de-518d-4a1f-9d61-c1828514a301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:10 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-ed77bfa6-36a2-4d73-913b-f2fea17f3df4 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Volume volume-25bcf6c8-33f5-4fa8-84c6-229b048442ee (25bcf6c8-33f5-4fa8-84c6-229b048442ee): created successfully Sep 23 00:28:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ed77bfa6-36a2-4d73-913b-f2fea17f3df4 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e87d21de-518d-4a1f-9d61-c1828514a301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ed77bfa6-36a2-4d73-913b-f2fea17f3df4 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Flow 'volume_create_manager' (9732c4b7-bee5-4f36-9029-623f1ae69dc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:10 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-ed77bfa6-36a2-4d73-913b-f2fea17f3df4 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Created volume successfully. Sep 23 00:28:10 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6d708bb3-d069-440d-a10e-b906596fc12f tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Acquiring lock "cinder-25bcf6c8-33f5-4fa8-84c6-229b048442ee-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:10 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6d708bb3-d069-440d-a10e-b906596fc12f tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Lock "cinder-25bcf6c8-33f5-4fa8-84c6-229b048442ee-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:10 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6d708bb3-d069-440d-a10e-b906596fc12f tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Acquiring lock "cinder-quobyte-25bcf6c8-33f5-4fa8-84c6-229b048442ee" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:10 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6d708bb3-d069-440d-a10e-b906596fc12f tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Lock "cinder-quobyte-25bcf6c8-33f5-4fa8-84c6-229b048442ee" acquired by "delete_volume" :: waited 0.026s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:10 devstack sudo[103178]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-da9bd6a9-f252-4822-ac5b-2fec00a2d3b5 tempest-VolumesActionsTest-1125789447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-20cc9429-e9b3-4088-903d-badce487e1da 1073741824" returned: 0 in 0.641s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:10 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40fd273-ed33-44ce-94d2-22cd2b553f03]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6d708bb3-d069-440d-a10e-b906596fc12f tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-25bcf6c8-33f5-4fa8-84c6-229b048442ee {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-da9bd6a9-f252-4822-ac5b-2fec00a2d3b5 tempest-VolumesActionsTest-1125789447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-20cc9429-e9b3-4088-903d-badce487e1da {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:10 devstack sudo[103191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-20cc9429-e9b3-4088-903d-badce487e1da Sep 23 00:28:10 devstack sudo[103191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:11 devstack sudo[103190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-25bcf6c8-33f5-4fa8-84c6-229b048442ee Sep 23 00:28:11 devstack sudo[103190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:11 devstack sudo[103191]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-da9bd6a9-f252-4822-ac5b-2fec00a2d3b5 tempest-VolumesActionsTest-1125789447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-20cc9429-e9b3-4088-903d-badce487e1da" returned: 0 in 0.298s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:11 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-da9bd6a9-f252-4822-ac5b-2fec00a2d3b5 tempest-VolumesActionsTest-1125789447 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:28:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-da9bd6a9-f252-4822-ac5b-2fec00a2d3b5 tempest-VolumesActionsTest-1125789447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:11 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-da9bd6a9-f252-4822-ac5b-2fec00a2d3b5 tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (690ccede-5eec-4e8d-a226-a7b0949bb893) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20cc9429-e9b3-4088-903d-badce487e1da', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:11 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-da9bd6a9-f252-4822-ac5b-2fec00a2d3b5 tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae9d03f2-987f-4466-88d7-493e31d8c73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:11 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-da9bd6a9-f252-4822-ac5b-2fec00a2d3b5 tempest-VolumesActionsTest-1125789447 None] Volume volume-20cc9429-e9b3-4088-903d-badce487e1da (20cc9429-e9b3-4088-903d-badce487e1da): created successfully Sep 23 00:28:11 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-da9bd6a9-f252-4822-ac5b-2fec00a2d3b5 tempest-VolumesActionsTest-1125789447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae9d03f2-987f-4466-88d7-493e31d8c73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:11 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-da9bd6a9-f252-4822-ac5b-2fec00a2d3b5 tempest-VolumesActionsTest-1125789447 None] Flow 'volume_create_manager' (5c4807c7-3629-44cd-9f66-440428cb3a5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:11 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-da9bd6a9-f252-4822-ac5b-2fec00a2d3b5 tempest-VolumesActionsTest-1125789447 None] Created volume successfully. Sep 23 00:28:11 devstack sudo[103190]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6d708bb3-d069-440d-a10e-b906596fc12f tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-25bcf6c8-33f5-4fa8-84c6-229b048442ee" returned: 0 in 0.472s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6d708bb3-d069-440d-a10e-b906596fc12f tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-25bcf6c8-33f5-4fa8-84c6-229b048442ee {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:11 devstack sudo[103198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-25bcf6c8-33f5-4fa8-84c6-229b048442ee Sep 23 00:28:11 devstack sudo[103198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:11 devstack sudo[103198]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6d708bb3-d069-440d-a10e-b906596fc12f tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-25bcf6c8-33f5-4fa8-84c6-229b048442ee" returned: 0 in 0.283s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:11 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6d708bb3-d069-440d-a10e-b906596fc12f tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Lock "cinder-quobyte-25bcf6c8-33f5-4fa8-84c6-229b048442ee" released by "delete_volume" :: held 0.837s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:11 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-6d708bb3-d069-440d-a10e-b906596fc12f tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Created reservations ['4c95c926-27d6-4252-b43c-9b3e07df9151', '09fd79ff-976f-4370-b0df-6a5a778323dd', '658b165e-0c5a-4522-b03b-98bcd25d527e', '67f551a6-b74e-4e83-895d-151242518568'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:28:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6d708bb3-d069-440d-a10e-b906596fc12f tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6d708bb3-d069-440d-a10e-b906596fc12f tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:11 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6d708bb3-d069-440d-a10e-b906596fc12f tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:11 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6d708bb3-d069-440d-a10e-b906596fc12f tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6d708bb3-d069-440d-a10e-b906596fc12f tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6d708bb3-d069-440d-a10e-b906596fc12f tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:11 devstack sudo[103201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:28:11 devstack sudo[103201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:12 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-bc37e517-3b6c-4a52-ac51-2e7e80e0c12f tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Acquiring lock "cinder-7b19ad9b-defb-43fb-b236-acbe013ec556-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:12 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-bc37e517-3b6c-4a52-ac51-2e7e80e0c12f tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Lock "cinder-7b19ad9b-defb-43fb-b236-acbe013ec556-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:12 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-bc37e517-3b6c-4a52-ac51-2e7e80e0c12f tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Acquiring lock "cinder-quobyte-7b19ad9b-defb-43fb-b236-acbe013ec556" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:12 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-bc37e517-3b6c-4a52-ac51-2e7e80e0c12f tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Lock "cinder-quobyte-7b19ad9b-defb-43fb-b236-acbe013ec556" acquired by "delete_volume" :: waited 0.045s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:12 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[88fa684f-f8c3-42ff-88d5-dd28d29c9832]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bc37e517-3b6c-4a52-ac51-2e7e80e0c12f tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7b19ad9b-defb-43fb-b236-acbe013ec556 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:12 devstack sudo[103201]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6d708bb3-d069-440d-a10e-b906596fc12f tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.550s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:12 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-6d708bb3-d069-440d-a10e-b906596fc12f tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:28:12 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-6d708bb3-d069-440d-a10e-b906596fc12f tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Deleted volume successfully. Sep 23 00:28:12 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6d708bb3-d069-440d-a10e-b906596fc12f tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Lock "cinder-25bcf6c8-33f5-4fa8-84c6-229b048442ee-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:12 devstack sudo[103205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7b19ad9b-defb-43fb-b236-acbe013ec556 Sep 23 00:28:12 devstack sudo[103205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:12 devstack sudo[103205]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bc37e517-3b6c-4a52-ac51-2e7e80e0c12f tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7b19ad9b-defb-43fb-b236-acbe013ec556" returned: 0 in 0.652s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bc37e517-3b6c-4a52-ac51-2e7e80e0c12f tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7b19ad9b-defb-43fb-b236-acbe013ec556 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:12 devstack sudo[103220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7b19ad9b-defb-43fb-b236-acbe013ec556 Sep 23 00:28:12 devstack sudo[103220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:13 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f8e0fe87-c466-4348-877f-18222f661532 tempest-VolumesActionsTest-1125789447 None] Acquiring lock "cinder-20cc9429-e9b3-4088-903d-badce487e1da-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:13 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f8e0fe87-c466-4348-877f-18222f661532 tempest-VolumesActionsTest-1125789447 None] Lock "cinder-20cc9429-e9b3-4088-903d-badce487e1da-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:13 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f8e0fe87-c466-4348-877f-18222f661532 tempest-VolumesActionsTest-1125789447 None] Acquiring lock "cinder-quobyte-20cc9429-e9b3-4088-903d-badce487e1da" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:13 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f8e0fe87-c466-4348-877f-18222f661532 tempest-VolumesActionsTest-1125789447 None] Lock "cinder-quobyte-20cc9429-e9b3-4088-903d-badce487e1da" acquired by "delete_volume" :: waited 0.021s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:13 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[89345bdb-c5a7-428c-b501-63c6b9bb8485]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f8e0fe87-c466-4348-877f-18222f661532 tempest-VolumesActionsTest-1125789447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-20cc9429-e9b3-4088-903d-badce487e1da {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:13 devstack sudo[103220]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bc37e517-3b6c-4a52-ac51-2e7e80e0c12f tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7b19ad9b-defb-43fb-b236-acbe013ec556" returned: 0 in 0.550s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:13 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-bc37e517-3b6c-4a52-ac51-2e7e80e0c12f tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Lock "cinder-quobyte-7b19ad9b-defb-43fb-b236-acbe013ec556" released by "delete_volume" :: held 1.292s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:13 devstack sudo[103245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-20cc9429-e9b3-4088-903d-badce487e1da Sep 23 00:28:13 devstack sudo[103245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:13 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-bc37e517-3b6c-4a52-ac51-2e7e80e0c12f tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Created reservations ['9162125d-2b51-4c26-b714-c3c0b1547fe8', 'ddc9d844-eb23-492e-8ea2-729103066ca1', '3735cb8a-f839-4897-bb98-0bd6f9ca0409', '7bb710a0-ad23-46cd-b1de-716eb579c086'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:28:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-bc37e517-3b6c-4a52-ac51-2e7e80e0c12f tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-bc37e517-3b6c-4a52-ac51-2e7e80e0c12f tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:13 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-bc37e517-3b6c-4a52-ac51-2e7e80e0c12f tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:13 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-bc37e517-3b6c-4a52-ac51-2e7e80e0c12f tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-bc37e517-3b6c-4a52-ac51-2e7e80e0c12f tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bc37e517-3b6c-4a52-ac51-2e7e80e0c12f tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:13 devstack sudo[103248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:28:13 devstack sudo[103248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:13 devstack sudo[103245]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f8e0fe87-c466-4348-877f-18222f661532 tempest-VolumesActionsTest-1125789447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-20cc9429-e9b3-4088-903d-badce487e1da" returned: 0 in 0.537s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f8e0fe87-c466-4348-877f-18222f661532 tempest-VolumesActionsTest-1125789447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-20cc9429-e9b3-4088-903d-badce487e1da {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:13 devstack sudo[103253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-20cc9429-e9b3-4088-903d-badce487e1da Sep 23 00:28:13 devstack sudo[103253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:13 devstack sudo[103248]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bc37e517-3b6c-4a52-ac51-2e7e80e0c12f tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.285s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:14 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-bc37e517-3b6c-4a52-ac51-2e7e80e0c12f tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:28:14 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-bc37e517-3b6c-4a52-ac51-2e7e80e0c12f tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Deleted volume successfully. Sep 23 00:28:14 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-bc37e517-3b6c-4a52-ac51-2e7e80e0c12f tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Lock "cinder-7b19ad9b-defb-43fb-b236-acbe013ec556-delete_volume" released by "delete_volume" :: held 1.956s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:14 devstack sudo[103253]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f8e0fe87-c466-4348-877f-18222f661532 tempest-VolumesActionsTest-1125789447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-20cc9429-e9b3-4088-903d-badce487e1da" returned: 0 in 0.291s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:14 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f8e0fe87-c466-4348-877f-18222f661532 tempest-VolumesActionsTest-1125789447 None] Lock "cinder-quobyte-20cc9429-e9b3-4088-903d-badce487e1da" released by "delete_volume" :: held 0.901s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:14 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-f8e0fe87-c466-4348-877f-18222f661532 tempest-VolumesActionsTest-1125789447 None] Created reservations ['ccf0baec-c4e7-4c32-8cb9-b71bc0f26013', 'b9c2a594-91a2-47fa-a6a5-8d60ca5d418a', 'd7c92ec9-735f-453f-a303-f81370bb2146', '1caa6c59-a92c-44a5-9a0b-c8ba0109ff7c'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:28:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f8e0fe87-c466-4348-877f-18222f661532 tempest-VolumesActionsTest-1125789447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f8e0fe87-c466-4348-877f-18222f661532 tempest-VolumesActionsTest-1125789447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:14 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f8e0fe87-c466-4348-877f-18222f661532 tempest-VolumesActionsTest-1125789447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:14 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f8e0fe87-c466-4348-877f-18222f661532 tempest-VolumesActionsTest-1125789447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f8e0fe87-c466-4348-877f-18222f661532 tempest-VolumesActionsTest-1125789447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f8e0fe87-c466-4348-877f-18222f661532 tempest-VolumesActionsTest-1125789447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:14 devstack sudo[103257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:28:14 devstack sudo[103257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:14 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b6951075-0468-422f-9de1-20712dd4d0c9 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Acquiring lock "cinder-93920dcb-376d-4e21-918b-9cdc29eeb4c7-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:14 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b6951075-0468-422f-9de1-20712dd4d0c9 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Lock "cinder-93920dcb-376d-4e21-918b-9cdc29eeb4c7-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:14 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b6951075-0468-422f-9de1-20712dd4d0c9 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Acquiring lock "cinder-quobyte-93920dcb-376d-4e21-918b-9cdc29eeb4c7" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:14 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b6951075-0468-422f-9de1-20712dd4d0c9 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Lock "cinder-quobyte-93920dcb-376d-4e21-918b-9cdc29eeb4c7" acquired by "delete_volume" :: waited 0.029s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:14 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[380ddfd4-2be6-40b3-8481-598a5daf9946]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b6951075-0468-422f-9de1-20712dd4d0c9 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-93920dcb-376d-4e21-918b-9cdc29eeb4c7 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:14 devstack sudo[103257]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f8e0fe87-c466-4348-877f-18222f661532 tempest-VolumesActionsTest-1125789447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.328s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:14 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-f8e0fe87-c466-4348-877f-18222f661532 tempest-VolumesActionsTest-1125789447 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:28:14 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-f8e0fe87-c466-4348-877f-18222f661532 tempest-VolumesActionsTest-1125789447 None] Deleted volume successfully. Sep 23 00:28:14 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f8e0fe87-c466-4348-877f-18222f661532 tempest-VolumesActionsTest-1125789447 None] Lock "cinder-20cc9429-e9b3-4088-903d-badce487e1da-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:14 devstack sudo[103259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-93920dcb-376d-4e21-918b-9cdc29eeb4c7 Sep 23 00:28:14 devstack sudo[103259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:15 devstack sudo[103259]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b6951075-0468-422f-9de1-20712dd4d0c9 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-93920dcb-376d-4e21-918b-9cdc29eeb4c7" returned: 0 in 0.415s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b6951075-0468-422f-9de1-20712dd4d0c9 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-93920dcb-376d-4e21-918b-9cdc29eeb4c7 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:15 devstack sudo[103265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-93920dcb-376d-4e21-918b-9cdc29eeb4c7 Sep 23 00:28:15 devstack sudo[103265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:15 devstack sudo[103265]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b6951075-0468-422f-9de1-20712dd4d0c9 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-93920dcb-376d-4e21-918b-9cdc29eeb4c7" returned: 0 in 0.279s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b6951075-0468-422f-9de1-20712dd4d0c9 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Lock "cinder-quobyte-93920dcb-376d-4e21-918b-9cdc29eeb4c7" released by "delete_volume" :: held 0.768s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:15 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-b6951075-0468-422f-9de1-20712dd4d0c9 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Created reservations ['e735f5b4-192e-4edc-8d63-12a9146de342', '227109a0-e6d5-43bd-8b9c-b442222982d8', '267e0e11-f089-4fbb-9454-0bf747012424', '0057bca7-6b70-43c8-908c-2fd94758ecf8'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:28:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b6951075-0468-422f-9de1-20712dd4d0c9 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b6951075-0468-422f-9de1-20712dd4d0c9 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:15 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b6951075-0468-422f-9de1-20712dd4d0c9 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:15 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b6951075-0468-422f-9de1-20712dd4d0c9 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b6951075-0468-422f-9de1-20712dd4d0c9 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b6951075-0468-422f-9de1-20712dd4d0c9 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:15 devstack sudo[103302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:28:15 devstack sudo[103302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-521f028c-f91f-4e1b-adfa-ff1c3601611c tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Acquiring lock "cinder-32cff445-6610-4795-8db5-b105ce023213-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-521f028c-f91f-4e1b-adfa-ff1c3601611c tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Lock "cinder-32cff445-6610-4795-8db5-b105ce023213-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-521f028c-f91f-4e1b-adfa-ff1c3601611c tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Acquiring lock "cinder-quobyte-32cff445-6610-4795-8db5-b105ce023213" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-521f028c-f91f-4e1b-adfa-ff1c3601611c tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Lock "cinder-quobyte-32cff445-6610-4795-8db5-b105ce023213" acquired by "delete_volume" :: waited 0.025s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:15 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb672fa6-3203-4579-9954-be521b372fc1]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-521f028c-f91f-4e1b-adfa-ff1c3601611c tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-32cff445-6610-4795-8db5-b105ce023213 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:15 devstack sudo[103302]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b6951075-0468-422f-9de1-20712dd4d0c9 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.371s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:15 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-b6951075-0468-422f-9de1-20712dd4d0c9 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:28:15 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-b6951075-0468-422f-9de1-20712dd4d0c9 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Deleted volume successfully. Sep 23 00:28:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b6951075-0468-422f-9de1-20712dd4d0c9 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Lock "cinder-93920dcb-376d-4e21-918b-9cdc29eeb4c7-delete_volume" released by "delete_volume" :: held 1.496s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:15 devstack sudo[103305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-32cff445-6610-4795-8db5-b105ce023213 Sep 23 00:28:15 devstack sudo[103305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:16 devstack sudo[103305]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-521f028c-f91f-4e1b-adfa-ff1c3601611c tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-32cff445-6610-4795-8db5-b105ce023213" returned: 0 in 0.463s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-521f028c-f91f-4e1b-adfa-ff1c3601611c tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-32cff445-6610-4795-8db5-b105ce023213 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:16 devstack sudo[103313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-32cff445-6610-4795-8db5-b105ce023213 Sep 23 00:28:16 devstack sudo[103313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:16 devstack sudo[103313]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-521f028c-f91f-4e1b-adfa-ff1c3601611c tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-32cff445-6610-4795-8db5-b105ce023213" returned: 0 in 0.289s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:16 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-521f028c-f91f-4e1b-adfa-ff1c3601611c tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Lock "cinder-quobyte-32cff445-6610-4795-8db5-b105ce023213" released by "delete_volume" :: held 0.801s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:16 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-521f028c-f91f-4e1b-adfa-ff1c3601611c tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Created reservations ['55284165-7a62-441a-89ef-89beef4db038', '77537f56-eefb-4e42-9326-7a4c15164835', '11e937a0-91d5-4d81-b3e9-94c623da156f', '0acf1a1c-6fd7-4af7-9c54-1e6f4e3c01fa'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:28:16 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:28:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:16 devstack sudo[103317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:28:16 devstack sudo[103317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-521f028c-f91f-4e1b-adfa-ff1c3601611c tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-521f028c-f91f-4e1b-adfa-ff1c3601611c tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-521f028c-f91f-4e1b-adfa-ff1c3601611c tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-521f028c-f91f-4e1b-adfa-ff1c3601611c tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-521f028c-f91f-4e1b-adfa-ff1c3601611c tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-521f028c-f91f-4e1b-adfa-ff1c3601611c tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:16 devstack sudo[103319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:28:16 devstack sudo[103319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:16 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-41dd2f81-4241-4390-86ac-c46c9ca8953a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Acquiring lock "cinder-8b65626b-f8dc-40f5-b924-c53981de9ad6-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:16 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-41dd2f81-4241-4390-86ac-c46c9ca8953a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Lock "cinder-8b65626b-f8dc-40f5-b924-c53981de9ad6-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-41dd2f81-4241-4390-86ac-c46c9ca8953a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Acquiring lock "cinder-quobyte-8b65626b-f8dc-40f5-b924-c53981de9ad6" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-41dd2f81-4241-4390-86ac-c46c9ca8953a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Lock "cinder-quobyte-8b65626b-f8dc-40f5-b924-c53981de9ad6" acquired by "delete_volume" :: waited 0.019s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:17 devstack sudo[103317]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.388s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:17 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:28:17 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running periodic task VolumeManager._thread_info {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:28:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] thread count: 29 {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:28:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] thread info: [<_MainThread(MainThread, started 135440660459648)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:28:17 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[22fe52e0-349c-402e-b9ee-47ec4180d279]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-41dd2f81-4241-4390-86ac-c46c9ca8953a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8b65626b-f8dc-40f5-b924-c53981de9ad6 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:17 devstack sudo[103319]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-521f028c-f91f-4e1b-adfa-ff1c3601611c tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.336s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:17 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-521f028c-f91f-4e1b-adfa-ff1c3601611c tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:28:17 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-521f028c-f91f-4e1b-adfa-ff1c3601611c tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Deleted volume successfully. Sep 23 00:28:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-521f028c-f91f-4e1b-adfa-ff1c3601611c tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Lock "cinder-32cff445-6610-4795-8db5-b105ce023213-delete_volume" released by "delete_volume" :: held 1.437s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:17 devstack sudo[103323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8b65626b-f8dc-40f5-b924-c53981de9ad6 Sep 23 00:28:17 devstack sudo[103323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:17 devstack sudo[103323]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-41dd2f81-4241-4390-86ac-c46c9ca8953a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8b65626b-f8dc-40f5-b924-c53981de9ad6" returned: 0 in 0.426s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-41dd2f81-4241-4390-86ac-c46c9ca8953a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8b65626b-f8dc-40f5-b924-c53981de9ad6 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:17 devstack sudo[103329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8b65626b-f8dc-40f5-b924-c53981de9ad6 Sep 23 00:28:17 devstack sudo[103329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:17 devstack sudo[103329]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-41dd2f81-4241-4390-86ac-c46c9ca8953a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8b65626b-f8dc-40f5-b924-c53981de9ad6" returned: 0 in 0.343s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-41dd2f81-4241-4390-86ac-c46c9ca8953a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Lock "cinder-quobyte-8b65626b-f8dc-40f5-b924-c53981de9ad6" released by "delete_volume" :: held 0.826s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:17 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-41dd2f81-4241-4390-86ac-c46c9ca8953a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Created reservations ['083a0d0b-fcc9-4768-9394-6a788553606f', 'e96167ee-6c38-4606-94b3-527809a3183c', '3f9ab06d-e111-4f0b-91bb-4642ea7947af', '982c58bd-3da3-455a-898f-9c2d7bf7468e'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:28:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-41dd2f81-4241-4390-86ac-c46c9ca8953a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-41dd2f81-4241-4390-86ac-c46c9ca8953a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:18 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-41dd2f81-4241-4390-86ac-c46c9ca8953a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:18 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-41dd2f81-4241-4390-86ac-c46c9ca8953a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-41dd2f81-4241-4390-86ac-c46c9ca8953a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-41dd2f81-4241-4390-86ac-c46c9ca8953a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:18 devstack sudo[103332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:28:18 devstack sudo[103332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d6e864bb-3885-4e8d-9918-4f6b09eda864 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Acquiring lock "cinder-9ebd44d8-3b2e-4beb-bb98-51e005c75d94-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d6e864bb-3885-4e8d-9918-4f6b09eda864 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Lock "cinder-9ebd44d8-3b2e-4beb-bb98-51e005c75d94-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d6e864bb-3885-4e8d-9918-4f6b09eda864 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Acquiring lock "cinder-quobyte-9ebd44d8-3b2e-4beb-bb98-51e005c75d94" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d6e864bb-3885-4e8d-9918-4f6b09eda864 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Lock "cinder-quobyte-9ebd44d8-3b2e-4beb-bb98-51e005c75d94" acquired by "delete_volume" :: waited 0.019s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:18 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52e110f-87cd-4f5f-8707-2535825ada49]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d6e864bb-3885-4e8d-9918-4f6b09eda864 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9ebd44d8-3b2e-4beb-bb98-51e005c75d94 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:18 devstack sudo[103332]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-41dd2f81-4241-4390-86ac-c46c9ca8953a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.321s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:18 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-41dd2f81-4241-4390-86ac-c46c9ca8953a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:28:18 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-41dd2f81-4241-4390-86ac-c46c9ca8953a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Deleted volume successfully. Sep 23 00:28:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-41dd2f81-4241-4390-86ac-c46c9ca8953a tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Lock "cinder-8b65626b-f8dc-40f5-b924-c53981de9ad6-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:18 devstack sudo[103334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9ebd44d8-3b2e-4beb-bb98-51e005c75d94 Sep 23 00:28:18 devstack sudo[103334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:18 devstack sudo[103334]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d6e864bb-3885-4e8d-9918-4f6b09eda864 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9ebd44d8-3b2e-4beb-bb98-51e005c75d94" returned: 0 in 0.447s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d6e864bb-3885-4e8d-9918-4f6b09eda864 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9ebd44d8-3b2e-4beb-bb98-51e005c75d94 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:18 devstack sudo[103340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9ebd44d8-3b2e-4beb-bb98-51e005c75d94 Sep 23 00:28:18 devstack sudo[103340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:19 devstack sudo[103340]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d6e864bb-3885-4e8d-9918-4f6b09eda864 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9ebd44d8-3b2e-4beb-bb98-51e005c75d94" returned: 0 in 0.366s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d6e864bb-3885-4e8d-9918-4f6b09eda864 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Lock "cinder-quobyte-9ebd44d8-3b2e-4beb-bb98-51e005c75d94" released by "delete_volume" :: held 0.865s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:19 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-d6e864bb-3885-4e8d-9918-4f6b09eda864 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Created reservations ['d36c50ef-d55e-4832-a838-32d126c8ddc5', 'c91ffa74-ba82-4243-96c0-6f0414f93857', 'fa3c64ed-6ffa-4ff6-883a-9bbb23b940d0', '6395964d-5e4c-405c-a8cd-34bc523ea6b0'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:28:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d6e864bb-3885-4e8d-9918-4f6b09eda864 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d6e864bb-3885-4e8d-9918-4f6b09eda864 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:19 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d6e864bb-3885-4e8d-9918-4f6b09eda864 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:19 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d6e864bb-3885-4e8d-9918-4f6b09eda864 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d6e864bb-3885-4e8d-9918-4f6b09eda864 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d6e864bb-3885-4e8d-9918-4f6b09eda864 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:19 devstack sudo[103343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:28:19 devstack sudo[103343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:19 devstack sudo[103343]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d6e864bb-3885-4e8d-9918-4f6b09eda864 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.338s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:19 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-d6e864bb-3885-4e8d-9918-4f6b09eda864 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:28:19 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-d6e864bb-3885-4e8d-9918-4f6b09eda864 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Deleted volume successfully. Sep 23 00:28:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d6e864bb-3885-4e8d-9918-4f6b09eda864 tempest-CreateVolumesFromSourceVolumeTest-2109036399 None] Lock "cinder-9ebd44d8-3b2e-4beb-bb98-51e005c75d94-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:23 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-744ff552-b7e3-4357-b216-158a41c5190f tempest-VolumeDependencyTests-1617217841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:28:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-744ff552-b7e3-4357-b216-158a41c5190f tempest-VolumeDependencyTests-1617217841 None] Flow 'volume_create_manager' (f764adab-6761-49a4-bf14-f57d148d8c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-744ff552-b7e3-4357-b216-158a41c5190f tempest-VolumeDependencyTests-1617217841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e367d962-c6aa-4c9a-a06e-4b925183be8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-744ff552-b7e3-4357-b216-158a41c5190f tempest-VolumeDependencyTests-1617217841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e367d962-c6aa-4c9a-a06e-4b925183be8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1054942118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f99fb4a7-25af-4029-8bc7-8706a033c952,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22556574a12d42d6b8c55b0841160638',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:23Z,use_quota=True,user_id='73297de614c44c6a9b39ba82bf26ecd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-744ff552-b7e3-4357-b216-158a41c5190f tempest-VolumeDependencyTests-1617217841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53f6530a-6010-4129-aff1-9a167e98b015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-744ff552-b7e3-4357-b216-158a41c5190f tempest-VolumeDependencyTests-1617217841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53f6530a-6010-4129-aff1-9a167e98b015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-744ff552-b7e3-4357-b216-158a41c5190f tempest-VolumeDependencyTests-1617217841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07f37661-76eb-485f-9352-592f96f0001e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-744ff552-b7e3-4357-b216-158a41c5190f tempest-VolumeDependencyTests-1617217841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07f37661-76eb-485f-9352-592f96f0001e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f99fb4a7-25af-4029-8bc7-8706a033c952', 'volume_name': 'volume-f99fb4a7-25af-4029-8bc7-8706a033c952', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-744ff552-b7e3-4357-b216-158a41c5190f tempest-VolumeDependencyTests-1617217841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e742e791-d3d7-4cbd-afdb-44382c09e317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-744ff552-b7e3-4357-b216-158a41c5190f tempest-VolumeDependencyTests-1617217841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e742e791-d3d7-4cbd-afdb-44382c09e317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-744ff552-b7e3-4357-b216-158a41c5190f tempest-VolumeDependencyTests-1617217841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07dc1788-44e7-4a9f-865e-e05c3f80f3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:23 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-744ff552-b7e3-4357-b216-158a41c5190f tempest-VolumeDependencyTests-1617217841 None] Volume f99fb4a7-25af-4029-8bc7-8706a033c952: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f99fb4a7-25af-4029-8bc7-8706a033c952', 'volume_size': 1} Sep 23 00:28:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-744ff552-b7e3-4357-b216-158a41c5190f tempest-VolumeDependencyTests-1617217841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-744ff552-b7e3-4357-b216-158a41c5190f tempest-VolumeDependencyTests-1617217841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:23 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-744ff552-b7e3-4357-b216-158a41c5190f tempest-VolumeDependencyTests-1617217841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1054942118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f99fb4a7-25af-4029-8bc7-8706a033c952,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22556574a12d42d6b8c55b0841160638',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:23Z,use_quota=True,user_id='73297de614c44c6a9b39ba82bf26ecd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:28:23 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-744ff552-b7e3-4357-b216-158a41c5190f tempest-VolumeDependencyTests-1617217841 None] Creating volume f99fb4a7-25af-4029-8bc7-8706a033c952 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:28:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-744ff552-b7e3-4357-b216-158a41c5190f tempest-VolumeDependencyTests-1617217841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-744ff552-b7e3-4357-b216-158a41c5190f tempest-VolumeDependencyTests-1617217841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:23 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-744ff552-b7e3-4357-b216-158a41c5190f tempest-VolumeDependencyTests-1617217841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:23 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-744ff552-b7e3-4357-b216-158a41c5190f tempest-VolumeDependencyTests-1617217841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-744ff552-b7e3-4357-b216-158a41c5190f tempest-VolumeDependencyTests-1617217841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:23 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-744ff552-b7e3-4357-b216-158a41c5190f tempest-VolumeDependencyTests-1617217841 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:28:23 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-744ff552-b7e3-4357-b216-158a41c5190f tempest-VolumeDependencyTests-1617217841 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:28:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-744ff552-b7e3-4357-b216-158a41c5190f tempest-VolumeDependencyTests-1617217841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f99fb4a7-25af-4029-8bc7-8706a033c952 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:23 devstack sudo[103348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f99fb4a7-25af-4029-8bc7-8706a033c952 1073741824 Sep 23 00:28:23 devstack sudo[103348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:23 devstack sudo[103348]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-744ff552-b7e3-4357-b216-158a41c5190f tempest-VolumeDependencyTests-1617217841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f99fb4a7-25af-4029-8bc7-8706a033c952 1073741824" returned: 0 in 0.402s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-744ff552-b7e3-4357-b216-158a41c5190f tempest-VolumeDependencyTests-1617217841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f99fb4a7-25af-4029-8bc7-8706a033c952 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:23 devstack sudo[103354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f99fb4a7-25af-4029-8bc7-8706a033c952 Sep 23 00:28:23 devstack sudo[103354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:24 devstack sudo[103354]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-744ff552-b7e3-4357-b216-158a41c5190f tempest-VolumeDependencyTests-1617217841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f99fb4a7-25af-4029-8bc7-8706a033c952" returned: 0 in 0.287s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:24 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-744ff552-b7e3-4357-b216-158a41c5190f tempest-VolumeDependencyTests-1617217841 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:28:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-744ff552-b7e3-4357-b216-158a41c5190f tempest-VolumeDependencyTests-1617217841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-744ff552-b7e3-4357-b216-158a41c5190f tempest-VolumeDependencyTests-1617217841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07dc1788-44e7-4a9f-865e-e05c3f80f3a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f99fb4a7-25af-4029-8bc7-8706a033c952', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-744ff552-b7e3-4357-b216-158a41c5190f tempest-VolumeDependencyTests-1617217841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7792b21-aaf5-4630-a9e4-9962051a848d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:24 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-744ff552-b7e3-4357-b216-158a41c5190f tempest-VolumeDependencyTests-1617217841 None] Volume volume-f99fb4a7-25af-4029-8bc7-8706a033c952 (f99fb4a7-25af-4029-8bc7-8706a033c952): created successfully Sep 23 00:28:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-744ff552-b7e3-4357-b216-158a41c5190f tempest-VolumeDependencyTests-1617217841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7792b21-aaf5-4630-a9e4-9962051a848d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-744ff552-b7e3-4357-b216-158a41c5190f tempest-VolumeDependencyTests-1617217841 None] Flow 'volume_create_manager' (f764adab-6761-49a4-bf14-f57d148d8c88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:24 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-744ff552-b7e3-4357-b216-158a41c5190f tempest-VolumeDependencyTests-1617217841 None] Created volume successfully. Sep 23 00:28:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-89ebd482-7e7d-4e65-adb5-f54c83a5578b tempest-VolumeDependencyTests-1617217841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-89ebd482-7e7d-4e65-adb5-f54c83a5578b tempest-VolumeDependencyTests-1617217841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:24 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-89ebd482-7e7d-4e65-adb5-f54c83a5578b tempest-VolumeDependencyTests-1617217841 None] Creating offline snapshot a5189869-1b54-4ea6-89f7-f3e75f890ae6 of volume f99fb4a7-25af-4029-8bc7-8706a033c952 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:28:24 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47d2e4b-f530-40c5-96c7-c52c7cb605b1]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-89ebd482-7e7d-4e65-adb5-f54c83a5578b tempest-VolumeDependencyTests-1617217841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f99fb4a7-25af-4029-8bc7-8706a033c952 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:24 devstack sudo[103357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f99fb4a7-25af-4029-8bc7-8706a033c952 Sep 23 00:28:24 devstack sudo[103357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:25 devstack sudo[103357]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-89ebd482-7e7d-4e65-adb5-f54c83a5578b tempest-VolumeDependencyTests-1617217841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f99fb4a7-25af-4029-8bc7-8706a033c952" returned: 0 in 0.422s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-89ebd482-7e7d-4e65-adb5-f54c83a5578b tempest-VolumeDependencyTests-1617217841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f99fb4a7-25af-4029-8bc7-8706a033c952,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f99fb4a7-25af-4029-8bc7-8706a033c952.a5189869-1b54-4ea6-89f7-f3e75f890ae6 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:25 devstack sudo[103362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f99fb4a7-25af-4029-8bc7-8706a033c952,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f99fb4a7-25af-4029-8bc7-8706a033c952.a5189869-1b54-4ea6-89f7-f3e75f890ae6 1G Sep 23 00:28:25 devstack sudo[103362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:25 devstack sudo[103362]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-89ebd482-7e7d-4e65-adb5-f54c83a5578b tempest-VolumeDependencyTests-1617217841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f99fb4a7-25af-4029-8bc7-8706a033c952,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f99fb4a7-25af-4029-8bc7-8706a033c952.a5189869-1b54-4ea6-89f7-f3e75f890ae6 1G" returned: 0 in 0.560s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-89ebd482-7e7d-4e65-adb5-f54c83a5578b tempest-VolumeDependencyTests-1617217841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f99fb4a7-25af-4029-8bc7-8706a033c952 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f99fb4a7-25af-4029-8bc7-8706a033c952.a5189869-1b54-4ea6-89f7-f3e75f890ae6 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:25 devstack sudo[103370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f99fb4a7-25af-4029-8bc7-8706a033c952 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f99fb4a7-25af-4029-8bc7-8706a033c952.a5189869-1b54-4ea6-89f7-f3e75f890ae6 Sep 23 00:28:25 devstack sudo[103370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:26 devstack sudo[103370]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-89ebd482-7e7d-4e65-adb5-f54c83a5578b tempest-VolumeDependencyTests-1617217841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f99fb4a7-25af-4029-8bc7-8706a033c952 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f99fb4a7-25af-4029-8bc7-8706a033c952.a5189869-1b54-4ea6-89f7-f3e75f890ae6" returned: 0 in 0.405s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:26 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-89ebd482-7e7d-4e65-adb5-f54c83a5578b tempest-VolumeDependencyTests-1617217841 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f99fb4a7-25af-4029-8bc7-8706a033c952.a5189869-1b54-4ea6-89f7-f3e75f890ae6 is being set with open permissions: ugo+rw Sep 23 00:28:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-89ebd482-7e7d-4e65-adb5-f54c83a5578b tempest-VolumeDependencyTests-1617217841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f99fb4a7-25af-4029-8bc7-8706a033c952.a5189869-1b54-4ea6-89f7-f3e75f890ae6 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:26 devstack sudo[103375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f99fb4a7-25af-4029-8bc7-8706a033c952.a5189869-1b54-4ea6-89f7-f3e75f890ae6 Sep 23 00:28:26 devstack sudo[103375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:26 devstack sudo[103375]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-89ebd482-7e7d-4e65-adb5-f54c83a5578b tempest-VolumeDependencyTests-1617217841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f99fb4a7-25af-4029-8bc7-8706a033c952.a5189869-1b54-4ea6-89f7-f3e75f890ae6" returned: 0 in 0.304s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-89ebd482-7e7d-4e65-adb5-f54c83a5578b tempest-VolumeDependencyTests-1617217841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f99fb4a7-25af-4029-8bc7-8706a033c952.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:26 devstack sudo[103378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f99fb4a7-25af-4029-8bc7-8706a033c952.info Sep 23 00:28:26 devstack sudo[103378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:26 devstack sudo[103378]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-89ebd482-7e7d-4e65-adb5-f54c83a5578b tempest-VolumeDependencyTests-1617217841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f99fb4a7-25af-4029-8bc7-8706a033c952.info" returned: 0 in 0.439s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:26 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-89ebd482-7e7d-4e65-adb5-f54c83a5578b tempest-VolumeDependencyTests-1617217841 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f99fb4a7-25af-4029-8bc7-8706a033c952.info is being set with open permissions: ugo+rw Sep 23 00:28:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-89ebd482-7e7d-4e65-adb5-f54c83a5578b tempest-VolumeDependencyTests-1617217841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f99fb4a7-25af-4029-8bc7-8706a033c952.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:26 devstack sudo[103381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f99fb4a7-25af-4029-8bc7-8706a033c952.info Sep 23 00:28:26 devstack sudo[103381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:27 devstack sudo[103381]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-89ebd482-7e7d-4e65-adb5-f54c83a5578b tempest-VolumeDependencyTests-1617217841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f99fb4a7-25af-4029-8bc7-8706a033c952.info" returned: 0 in 0.309s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-89ebd482-7e7d-4e65-adb5-f54c83a5578b tempest-VolumeDependencyTests-1617217841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.569s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:27 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-89ebd482-7e7d-4e65-adb5-f54c83a5578b tempest-VolumeDependencyTests-1617217841 None] Create snapshot completed successfully Sep 23 00:28:28 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdfd3e62-a67c-4f05-8667-8e77bb3de6d3 tempest-VolumeDependencyTests-1617217841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:28:28 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fdfd3e62-a67c-4f05-8667-8e77bb3de6d3 tempest-VolumeDependencyTests-1617217841 None] Flow 'volume_create_manager' (e1b99723-ba87-40e5-92ff-8176d3847eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:28 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fdfd3e62-a67c-4f05-8667-8e77bb3de6d3 tempest-VolumeDependencyTests-1617217841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac2e0c8b-6625-46b9-add3-6302b897035d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:28 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fdfd3e62-a67c-4f05-8667-8e77bb3de6d3 tempest-VolumeDependencyTests-1617217841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac2e0c8b-6625-46b9-add3-6302b897035d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1703582287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c08275c-3fda-4858-8b5c-322da63e4b09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22556574a12d42d6b8c55b0841160638',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a5189869-1b54-4ea6-89f7-f3e75f890ae6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:29Z,use_quota=True,user_id='73297de614c44c6a9b39ba82bf26ecd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:28 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fdfd3e62-a67c-4f05-8667-8e77bb3de6d3 tempest-VolumeDependencyTests-1617217841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8fcfd9b-1bd2-4bea-877a-7427e461e113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:28 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fdfd3e62-a67c-4f05-8667-8e77bb3de6d3 tempest-VolumeDependencyTests-1617217841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8fcfd9b-1bd2-4bea-877a-7427e461e113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:28 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fdfd3e62-a67c-4f05-8667-8e77bb3de6d3 tempest-VolumeDependencyTests-1617217841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e9ae0b1-509f-4a17-bc49-a70838fb4c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:28 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fdfd3e62-a67c-4f05-8667-8e77bb3de6d3 tempest-VolumeDependencyTests-1617217841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e9ae0b1-509f-4a17-bc49-a70838fb4c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3c08275c-3fda-4858-8b5c-322da63e4b09', 'volume_name': 'volume-3c08275c-3fda-4858-8b5c-322da63e4b09', 'volume_size': 1, 'snapshot_id': 'a5189869-1b54-4ea6-89f7-f3e75f890ae6'}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:28 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fdfd3e62-a67c-4f05-8667-8e77bb3de6d3 tempest-VolumeDependencyTests-1617217841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (185d6635-ab21-4b2b-9bda-8ed8220f1830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:28 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fdfd3e62-a67c-4f05-8667-8e77bb3de6d3 tempest-VolumeDependencyTests-1617217841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (185d6635-ab21-4b2b-9bda-8ed8220f1830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:28 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fdfd3e62-a67c-4f05-8667-8e77bb3de6d3 tempest-VolumeDependencyTests-1617217841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (128adf3b-0bd6-4061-960d-5debe0c48d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:28 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-fdfd3e62-a67c-4f05-8667-8e77bb3de6d3 tempest-VolumeDependencyTests-1617217841 None] Volume 3c08275c-3fda-4858-8b5c-322da63e4b09: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3c08275c-3fda-4858-8b5c-322da63e4b09', 'volume_size': 1, 'snapshot_id': 'a5189869-1b54-4ea6-89f7-f3e75f890ae6'} Sep 23 00:28:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-fdfd3e62-a67c-4f05-8667-8e77bb3de6d3 tempest-VolumeDependencyTests-1617217841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-fdfd3e62-a67c-4f05-8667-8e77bb3de6d3 tempest-VolumeDependencyTests-1617217841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:28 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-fdfd3e62-a67c-4f05-8667-8e77bb3de6d3 tempest-VolumeDependencyTests-1617217841 None] Acquiring lock "cinder-quobyte-a5189869-1b54-4ea6-89f7-f3e75f890ae6-3c08275c-3fda-4858-8b5c-322da63e4b09" by "_create_volume_from_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:28 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-fdfd3e62-a67c-4f05-8667-8e77bb3de6d3 tempest-VolumeDependencyTests-1617217841 None] Lock "cinder-quobyte-a5189869-1b54-4ea6-89f7-f3e75f890ae6-3c08275c-3fda-4858-8b5c-322da63e4b09" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:28 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-fdfd3e62-a67c-4f05-8667-8e77bb3de6d3 tempest-VolumeDependencyTests-1617217841 None] Creating volume 3c08275c-3fda-4858-8b5c-322da63e4b09 from snapshot a5189869-1b54-4ea6-89f7-f3e75f890ae6 {{(pid=86591) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 00:28:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-fdfd3e62-a67c-4f05-8667-8e77bb3de6d3 tempest-VolumeDependencyTests-1617217841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-fdfd3e62-a67c-4f05-8667-8e77bb3de6d3 tempest-VolumeDependencyTests-1617217841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:28 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-fdfd3e62-a67c-4f05-8667-8e77bb3de6d3 tempest-VolumeDependencyTests-1617217841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:28 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-fdfd3e62-a67c-4f05-8667-8e77bb3de6d3 tempest-VolumeDependencyTests-1617217841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-fdfd3e62-a67c-4f05-8667-8e77bb3de6d3 tempest-VolumeDependencyTests-1617217841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:28 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-fdfd3e62-a67c-4f05-8667-8e77bb3de6d3 tempest-VolumeDependencyTests-1617217841 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:28:28 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-fdfd3e62-a67c-4f05-8667-8e77bb3de6d3 tempest-VolumeDependencyTests-1617217841 None] Acquiring lock "cinder-quobyte-3c08275c-3fda-4858-8b5c-322da63e4b09" by "_copy_volume_from_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:28 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-fdfd3e62-a67c-4f05-8667-8e77bb3de6d3 tempest-VolumeDependencyTests-1617217841 None] Lock "cinder-quobyte-3c08275c-3fda-4858-8b5c-322da63e4b09" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:28 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-fdfd3e62-a67c-4f05-8667-8e77bb3de6d3 tempest-VolumeDependencyTests-1617217841 None] snapshot: a5189869-1b54-4ea6-89f7-f3e75f890ae6, volume: 3c08275c-3fda-4858-8b5c-322da63e4b09, {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:28:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-fdfd3e62-a67c-4f05-8667-8e77bb3de6d3 tempest-VolumeDependencyTests-1617217841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-fdfd3e62-a67c-4f05-8667-8e77bb3de6d3 tempest-VolumeDependencyTests-1617217841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:28 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-fdfd3e62-a67c-4f05-8667-8e77bb3de6d3 tempest-VolumeDependencyTests-1617217841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:28 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-fdfd3e62-a67c-4f05-8667-8e77bb3de6d3 tempest-VolumeDependencyTests-1617217841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-fdfd3e62-a67c-4f05-8667-8e77bb3de6d3 tempest-VolumeDependencyTests-1617217841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:28 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[23136753-2579-4d8b-ab81-bf53f1a8bed1]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fdfd3e62-a67c-4f05-8667-8e77bb3de6d3 tempest-VolumeDependencyTests-1617217841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f99fb4a7-25af-4029-8bc7-8706a033c952.a5189869-1b54-4ea6-89f7-f3e75f890ae6 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:28 devstack sudo[103387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f99fb4a7-25af-4029-8bc7-8706a033c952.a5189869-1b54-4ea6-89f7-f3e75f890ae6 Sep 23 00:28:28 devstack sudo[103387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:29 devstack sudo[103387]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fdfd3e62-a67c-4f05-8667-8e77bb3de6d3 tempest-VolumeDependencyTests-1617217841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f99fb4a7-25af-4029-8bc7-8706a033c952.a5189869-1b54-4ea6-89f7-f3e75f890ae6" returned: 0 in 0.440s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:29 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-fdfd3e62-a67c-4f05-8667-8e77bb3de6d3 tempest-VolumeDependencyTests-1617217841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f99fb4a7-25af-4029-8bc7-8706a033c952(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:28:29 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[d370d44a-c57b-47b6-aeee-05e55c1818b8]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fdfd3e62-a67c-4f05-8667-8e77bb3de6d3 tempest-VolumeDependencyTests-1617217841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f99fb4a7-25af-4029-8bc7-8706a033c952 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:29 devstack sudo[103392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f99fb4a7-25af-4029-8bc7-8706a033c952 Sep 23 00:28:29 devstack sudo[103392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:29 devstack sudo[103392]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fdfd3e62-a67c-4f05-8667-8e77bb3de6d3 tempest-VolumeDependencyTests-1617217841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f99fb4a7-25af-4029-8bc7-8706a033c952" returned: 0 in 0.432s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:29 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-fdfd3e62-a67c-4f05-8667-8e77bb3de6d3 tempest-VolumeDependencyTests-1617217841 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f99fb4a7-25af-4029-8bc7-8706a033c952 {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:28:29 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-fdfd3e62-a67c-4f05-8667-8e77bb3de6d3 tempest-VolumeDependencyTests-1617217841 None] Creating direct copy from snapshot {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:28:29 devstack cinder-volume[86591]: DEBUG cinder.utils [None req-fdfd3e62-a67c-4f05-8667-8e77bb3de6d3 tempest-VolumeDependencyTests-1617217841 None] Path /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3c08275c-3fda-4858-8b5c-322da63e4b09 not found in is_blk_device check {{(pid=86591) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:28:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fdfd3e62-a67c-4f05-8667-8e77bb3de6d3 tempest-VolumeDependencyTests-1617217841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f99fb4a7-25af-4029-8bc7-8706a033c952 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3c08275c-3fda-4858-8b5c-322da63e4b09 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:29 devstack sudo[103397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f99fb4a7-25af-4029-8bc7-8706a033c952 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3c08275c-3fda-4858-8b5c-322da63e4b09 Sep 23 00:28:29 devstack sudo[103397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:36 devstack sudo[103397]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fdfd3e62-a67c-4f05-8667-8e77bb3de6d3 tempest-VolumeDependencyTests-1617217841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f99fb4a7-25af-4029-8bc7-8706a033c952 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3c08275c-3fda-4858-8b5c-322da63e4b09" returned: 0 in 7.062s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:36 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-fdfd3e62-a67c-4f05-8667-8e77bb3de6d3 tempest-VolumeDependencyTests-1617217841 None] Image conversion details: src /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f99fb4a7-25af-4029-8bc7-8706a033c952, size 1024.00 MB, duration 7.06 sec, destination /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3c08275c-3fda-4858-8b5c-322da63e4b09 {{(pid=86591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:28:36 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-fdfd3e62-a67c-4f05-8667-8e77bb3de6d3 tempest-VolumeDependencyTests-1617217841 None] Converted 1024.00 MB image at 144.96 MB/s Sep 23 00:28:36 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-fdfd3e62-a67c-4f05-8667-8e77bb3de6d3 tempest-VolumeDependencyTests-1617217841 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3c08275c-3fda-4858-8b5c-322da63e4b09 is being set with open permissions: ugo+rw Sep 23 00:28:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fdfd3e62-a67c-4f05-8667-8e77bb3de6d3 tempest-VolumeDependencyTests-1617217841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3c08275c-3fda-4858-8b5c-322da63e4b09 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:36 devstack sudo[103410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3c08275c-3fda-4858-8b5c-322da63e4b09 Sep 23 00:28:36 devstack sudo[103410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:37 devstack sudo[103410]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fdfd3e62-a67c-4f05-8667-8e77bb3de6d3 tempest-VolumeDependencyTests-1617217841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3c08275c-3fda-4858-8b5c-322da63e4b09" returned: 0 in 0.295s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:37 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-fdfd3e62-a67c-4f05-8667-8e77bb3de6d3 tempest-VolumeDependencyTests-1617217841 None] Lock "cinder-quobyte-3c08275c-3fda-4858-8b5c-322da63e4b09" released by "_copy_volume_from_snapshot" :: held 8.344s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:37 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-fdfd3e62-a67c-4f05-8667-8e77bb3de6d3 tempest-VolumeDependencyTests-1617217841 None] Lock "cinder-quobyte-a5189869-1b54-4ea6-89f7-f3e75f890ae6-3c08275c-3fda-4858-8b5c-322da63e4b09" released by "_create_volume_from_snapshot" :: held 8.413s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-fdfd3e62-a67c-4f05-8667-8e77bb3de6d3 tempest-VolumeDependencyTests-1617217841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.431s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fdfd3e62-a67c-4f05-8667-8e77bb3de6d3 tempest-VolumeDependencyTests-1617217841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (128adf3b-0bd6-4061-960d-5debe0c48d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c08275c-3fda-4858-8b5c-322da63e4b09', 'volume_size': 1, 'snapshot_id': 'a5189869-1b54-4ea6-89f7-f3e75f890ae6'}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fdfd3e62-a67c-4f05-8667-8e77bb3de6d3 tempest-VolumeDependencyTests-1617217841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8956e64c-8f9a-486c-8b08-7f5c268b702e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:37 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-fdfd3e62-a67c-4f05-8667-8e77bb3de6d3 tempest-VolumeDependencyTests-1617217841 None] Volume volume-3c08275c-3fda-4858-8b5c-322da63e4b09 (3c08275c-3fda-4858-8b5c-322da63e4b09): created successfully Sep 23 00:28:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fdfd3e62-a67c-4f05-8667-8e77bb3de6d3 tempest-VolumeDependencyTests-1617217841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8956e64c-8f9a-486c-8b08-7f5c268b702e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fdfd3e62-a67c-4f05-8667-8e77bb3de6d3 tempest-VolumeDependencyTests-1617217841 None] Flow 'volume_create_manager' (e1b99723-ba87-40e5-92ff-8176d3847eee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:37 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-fdfd3e62-a67c-4f05-8667-8e77bb3de6d3 tempest-VolumeDependencyTests-1617217841 None] Created volume successfully. Sep 23 00:28:37 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-01d513f4-ba51-4d60-acef-e016ef251dbe tempest-VolumeDependencyTests-1617217841 None] Acquiring lock "cinder-a5189869-1b54-4ea6-89f7-f3e75f890ae6-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:37 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-01d513f4-ba51-4d60-acef-e016ef251dbe tempest-VolumeDependencyTests-1617217841 None] Lock "cinder-a5189869-1b54-4ea6-89f7-f3e75f890ae6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:37 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-01d513f4-ba51-4d60-acef-e016ef251dbe tempest-VolumeDependencyTests-1617217841 None] Acquiring lock "cinder-quobyte-f99fb4a7-25af-4029-8bc7-8706a033c952" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:37 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-01d513f4-ba51-4d60-acef-e016ef251dbe tempest-VolumeDependencyTests-1617217841 None] Lock "cinder-quobyte-f99fb4a7-25af-4029-8bc7-8706a033c952" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:37 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-01d513f4-ba51-4d60-acef-e016ef251dbe tempest-VolumeDependencyTests-1617217841 None] Acquiring lock "cinder-quobyte-a5189869-1b54-4ea6-89f7-f3e75f890ae6" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:37 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-01d513f4-ba51-4d60-acef-e016ef251dbe tempest-VolumeDependencyTests-1617217841 None] Lock "cinder-quobyte-a5189869-1b54-4ea6-89f7-f3e75f890ae6" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-01d513f4-ba51-4d60-acef-e016ef251dbe tempest-VolumeDependencyTests-1617217841 None] Deleting offline snapshot a5189869-1b54-4ea6-89f7-f3e75f890ae6 of volume f99fb4a7-25af-4029-8bc7-8706a033c952 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:28:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-01d513f4-ba51-4d60-acef-e016ef251dbe tempest-VolumeDependencyTests-1617217841 None] snapshot_file for this snap is: volume-f99fb4a7-25af-4029-8bc7-8706a033c952.a5189869-1b54-4ea6-89f7-f3e75f890ae6 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:28:37 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b83f79c-57e4-46f4-b282-5f60c95f21f7]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-01d513f4-ba51-4d60-acef-e016ef251dbe tempest-VolumeDependencyTests-1617217841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f99fb4a7-25af-4029-8bc7-8706a033c952.a5189869-1b54-4ea6-89f7-f3e75f890ae6 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:37 devstack sudo[103414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f99fb4a7-25af-4029-8bc7-8706a033c952.a5189869-1b54-4ea6-89f7-f3e75f890ae6 Sep 23 00:28:37 devstack sudo[103414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:38 devstack sudo[103414]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-01d513f4-ba51-4d60-acef-e016ef251dbe tempest-VolumeDependencyTests-1617217841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f99fb4a7-25af-4029-8bc7-8706a033c952.a5189869-1b54-4ea6-89f7-f3e75f890ae6" returned: 0 in 0.412s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:38 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-01d513f4-ba51-4d60-acef-e016ef251dbe tempest-VolumeDependencyTests-1617217841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f99fb4a7-25af-4029-8bc7-8706a033c952(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:28:38 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35b8727-6d44-4e00-9976-6053d8d7e760]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-01d513f4-ba51-4d60-acef-e016ef251dbe tempest-VolumeDependencyTests-1617217841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f99fb4a7-25af-4029-8bc7-8706a033c952 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:38 devstack sudo[103419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f99fb4a7-25af-4029-8bc7-8706a033c952 Sep 23 00:28:38 devstack sudo[103419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:38 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe1a2311-103a-4ddd-8e06-24a974037440 tempest-VolumesTransfersV355Test-41891552 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:28:38 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fe1a2311-103a-4ddd-8e06-24a974037440 tempest-VolumesTransfersV355Test-41891552 None] Flow 'volume_create_manager' (b532df9c-51ff-4667-9ed7-272ee2dd476b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:38 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fe1a2311-103a-4ddd-8e06-24a974037440 tempest-VolumesTransfersV355Test-41891552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4118894-32f7-4964-b3d4-b4ee5361849d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:38 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fe1a2311-103a-4ddd-8e06-24a974037440 tempest-VolumesTransfersV355Test-41891552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4118894-32f7-4964-b3d4-b4ee5361849d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-675787510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4837a0b-2005-4494-a2f7-9b3270bcbe1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4967e209ce346738633c8d00c16f489',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:39Z,use_quota=True,user_id='308e2ce06fd44cedb2a48f76c55d4624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:38 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fe1a2311-103a-4ddd-8e06-24a974037440 tempest-VolumesTransfersV355Test-41891552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4d9e14b-846e-462e-a874-dd1de7a33558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:38 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fe1a2311-103a-4ddd-8e06-24a974037440 tempest-VolumesTransfersV355Test-41891552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4d9e14b-846e-462e-a874-dd1de7a33558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:38 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fe1a2311-103a-4ddd-8e06-24a974037440 tempest-VolumesTransfersV355Test-41891552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28ed6a8b-e69b-4a7a-bf27-fdfc3e640af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:38 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fe1a2311-103a-4ddd-8e06-24a974037440 tempest-VolumesTransfersV355Test-41891552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28ed6a8b-e69b-4a7a-bf27-fdfc3e640af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4837a0b-2005-4494-a2f7-9b3270bcbe1b', 'volume_name': 'volume-e4837a0b-2005-4494-a2f7-9b3270bcbe1b', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:38 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fe1a2311-103a-4ddd-8e06-24a974037440 tempest-VolumesTransfersV355Test-41891552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8bd8d43-df04-4cf4-9066-e40a801d96ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:38 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fe1a2311-103a-4ddd-8e06-24a974037440 tempest-VolumesTransfersV355Test-41891552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8bd8d43-df04-4cf4-9066-e40a801d96ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:38 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fe1a2311-103a-4ddd-8e06-24a974037440 tempest-VolumesTransfersV355Test-41891552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08f1ff25-bd0a-465c-90ae-c540a01d81a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:38 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-fe1a2311-103a-4ddd-8e06-24a974037440 tempest-VolumesTransfersV355Test-41891552 None] Volume e4837a0b-2005-4494-a2f7-9b3270bcbe1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4837a0b-2005-4494-a2f7-9b3270bcbe1b', 'volume_size': 1} Sep 23 00:28:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-fe1a2311-103a-4ddd-8e06-24a974037440 tempest-VolumesTransfersV355Test-41891552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-fe1a2311-103a-4ddd-8e06-24a974037440 tempest-VolumesTransfersV355Test-41891552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:38 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-fe1a2311-103a-4ddd-8e06-24a974037440 tempest-VolumesTransfersV355Test-41891552 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-675787510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4837a0b-2005-4494-a2f7-9b3270bcbe1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4967e209ce346738633c8d00c16f489',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:39Z,use_quota=True,user_id='308e2ce06fd44cedb2a48f76c55d4624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:28:38 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-fe1a2311-103a-4ddd-8e06-24a974037440 tempest-VolumesTransfersV355Test-41891552 None] Creating volume e4837a0b-2005-4494-a2f7-9b3270bcbe1b {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:28:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-fe1a2311-103a-4ddd-8e06-24a974037440 tempest-VolumesTransfersV355Test-41891552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-fe1a2311-103a-4ddd-8e06-24a974037440 tempest-VolumesTransfersV355Test-41891552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:38 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-fe1a2311-103a-4ddd-8e06-24a974037440 tempest-VolumesTransfersV355Test-41891552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:38 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-fe1a2311-103a-4ddd-8e06-24a974037440 tempest-VolumesTransfersV355Test-41891552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-fe1a2311-103a-4ddd-8e06-24a974037440 tempest-VolumesTransfersV355Test-41891552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:38 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-fe1a2311-103a-4ddd-8e06-24a974037440 tempest-VolumesTransfersV355Test-41891552 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:28:38 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-fe1a2311-103a-4ddd-8e06-24a974037440 tempest-VolumesTransfersV355Test-41891552 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:28:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fe1a2311-103a-4ddd-8e06-24a974037440 tempest-VolumesTransfersV355Test-41891552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e4837a0b-2005-4494-a2f7-9b3270bcbe1b 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:38 devstack sudo[103423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e4837a0b-2005-4494-a2f7-9b3270bcbe1b 1073741824 Sep 23 00:28:38 devstack sudo[103423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:38 devstack sudo[103419]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-01d513f4-ba51-4d60-acef-e016ef251dbe tempest-VolumeDependencyTests-1617217841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f99fb4a7-25af-4029-8bc7-8706a033c952" returned: 0 in 0.607s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-01d513f4-ba51-4d60-acef-e016ef251dbe tempest-VolumeDependencyTests-1617217841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f99fb4a7-25af-4029-8bc7-8706a033c952.a5189869-1b54-4ea6-89f7-f3e75f890ae6 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:38 devstack sudo[103427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f99fb4a7-25af-4029-8bc7-8706a033c952.a5189869-1b54-4ea6-89f7-f3e75f890ae6 Sep 23 00:28:38 devstack sudo[103427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:39 devstack sudo[103427]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-01d513f4-ba51-4d60-acef-e016ef251dbe tempest-VolumeDependencyTests-1617217841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f99fb4a7-25af-4029-8bc7-8706a033c952.a5189869-1b54-4ea6-89f7-f3e75f890ae6" returned: 0 in 0.337s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-01d513f4-ba51-4d60-acef-e016ef251dbe tempest-VolumeDependencyTests-1617217841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f99fb4a7-25af-4029-8bc7-8706a033c952.a5189869-1b54-4ea6-89f7-f3e75f890ae6 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:39 devstack sudo[103423]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fe1a2311-103a-4ddd-8e06-24a974037440 tempest-VolumesTransfersV355Test-41891552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e4837a0b-2005-4494-a2f7-9b3270bcbe1b 1073741824" returned: 0 in 0.447s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:39 devstack sudo[103436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f99fb4a7-25af-4029-8bc7-8706a033c952.a5189869-1b54-4ea6-89f7-f3e75f890ae6 Sep 23 00:28:39 devstack sudo[103436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fe1a2311-103a-4ddd-8e06-24a974037440 tempest-VolumesTransfersV355Test-41891552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e4837a0b-2005-4494-a2f7-9b3270bcbe1b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:39 devstack sudo[103438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e4837a0b-2005-4494-a2f7-9b3270bcbe1b Sep 23 00:28:39 devstack sudo[103438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:39 devstack sudo[103436]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-01d513f4-ba51-4d60-acef-e016ef251dbe tempest-VolumeDependencyTests-1617217841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f99fb4a7-25af-4029-8bc7-8706a033c952.a5189869-1b54-4ea6-89f7-f3e75f890ae6" returned: 0 in 0.275s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:39 devstack sudo[103438]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fe1a2311-103a-4ddd-8e06-24a974037440 tempest-VolumesTransfersV355Test-41891552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e4837a0b-2005-4494-a2f7-9b3270bcbe1b" returned: 0 in 0.254s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:39 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-fe1a2311-103a-4ddd-8e06-24a974037440 tempest-VolumesTransfersV355Test-41891552 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:28:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-fe1a2311-103a-4ddd-8e06-24a974037440 tempest-VolumesTransfersV355Test-41891552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:39 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-01d513f4-ba51-4d60-acef-e016ef251dbe tempest-VolumeDependencyTests-1617217841 None] Lock "cinder-quobyte-a5189869-1b54-4ea6-89f7-f3e75f890ae6" released by "_delete_snapshot" :: held 1.757s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:39 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-01d513f4-ba51-4d60-acef-e016ef251dbe tempest-VolumeDependencyTests-1617217841 None] Lock "cinder-quobyte-f99fb4a7-25af-4029-8bc7-8706a033c952" released by "delete_snapshot" :: held 1.781s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fe1a2311-103a-4ddd-8e06-24a974037440 tempest-VolumesTransfersV355Test-41891552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08f1ff25-bd0a-465c-90ae-c540a01d81a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4837a0b-2005-4494-a2f7-9b3270bcbe1b', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fe1a2311-103a-4ddd-8e06-24a974037440 tempest-VolumesTransfersV355Test-41891552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeb1d9bb-4563-4952-98c2-4942c3ab077e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:39 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-fe1a2311-103a-4ddd-8e06-24a974037440 tempest-VolumesTransfersV355Test-41891552 None] Volume volume-e4837a0b-2005-4494-a2f7-9b3270bcbe1b (e4837a0b-2005-4494-a2f7-9b3270bcbe1b): created successfully Sep 23 00:28:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fe1a2311-103a-4ddd-8e06-24a974037440 tempest-VolumesTransfersV355Test-41891552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeb1d9bb-4563-4952-98c2-4942c3ab077e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fe1a2311-103a-4ddd-8e06-24a974037440 tempest-VolumesTransfersV355Test-41891552 None] Flow 'volume_create_manager' (b532df9c-51ff-4667-9ed7-272ee2dd476b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:39 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-fe1a2311-103a-4ddd-8e06-24a974037440 tempest-VolumesTransfersV355Test-41891552 None] Created volume successfully. Sep 23 00:28:39 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-01d513f4-ba51-4d60-acef-e016ef251dbe tempest-VolumeDependencyTests-1617217841 None] Created reservations ['ecaaf38b-332d-4e3b-9b05-fd266cd2335c', '2e4f92d7-58ed-4ed9-9fb5-70d073f1a33c', 'cb483dd3-6a12-4754-805d-97eee70e983c', 'fea2d706-e9c8-49b4-bf7b-10a43c9ab37f'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:28:39 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-01d513f4-ba51-4d60-acef-e016ef251dbe tempest-VolumeDependencyTests-1617217841 None] Delete snapshot completed successfully. Sep 23 00:28:39 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-01d513f4-ba51-4d60-acef-e016ef251dbe tempest-VolumeDependencyTests-1617217841 None] Lock "cinder-a5189869-1b54-4ea6-89f7-f3e75f890ae6-delete_snapshot" released by "delete_snapshot" :: held 1.970s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:39 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c1508c2a-5dfd-4244-be73-d51ee64ec4a9 tempest-VolumeDependencyTests-1617217841 None] Acquiring lock "cinder-f99fb4a7-25af-4029-8bc7-8706a033c952-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:39 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c1508c2a-5dfd-4244-be73-d51ee64ec4a9 tempest-VolumeDependencyTests-1617217841 None] Lock "cinder-f99fb4a7-25af-4029-8bc7-8706a033c952-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:39 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c1508c2a-5dfd-4244-be73-d51ee64ec4a9 tempest-VolumeDependencyTests-1617217841 None] Acquiring lock "cinder-quobyte-f99fb4a7-25af-4029-8bc7-8706a033c952" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:39 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c1508c2a-5dfd-4244-be73-d51ee64ec4a9 tempest-VolumeDependencyTests-1617217841 None] Lock "cinder-quobyte-f99fb4a7-25af-4029-8bc7-8706a033c952" acquired by "delete_volume" :: waited 0.013s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:39 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e8ab94-1180-434f-8967-3608a3b828a8]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1508c2a-5dfd-4244-be73-d51ee64ec4a9 tempest-VolumeDependencyTests-1617217841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f99fb4a7-25af-4029-8bc7-8706a033c952 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:40 devstack sudo[103442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f99fb4a7-25af-4029-8bc7-8706a033c952 Sep 23 00:28:40 devstack sudo[103442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:40 devstack sudo[103442]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1508c2a-5dfd-4244-be73-d51ee64ec4a9 tempest-VolumeDependencyTests-1617217841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f99fb4a7-25af-4029-8bc7-8706a033c952" returned: 0 in 0.388s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1508c2a-5dfd-4244-be73-d51ee64ec4a9 tempest-VolumeDependencyTests-1617217841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f99fb4a7-25af-4029-8bc7-8706a033c952 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:40 devstack sudo[103447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f99fb4a7-25af-4029-8bc7-8706a033c952 Sep 23 00:28:40 devstack sudo[103447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:40 devstack sudo[103447]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1508c2a-5dfd-4244-be73-d51ee64ec4a9 tempest-VolumeDependencyTests-1617217841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f99fb4a7-25af-4029-8bc7-8706a033c952" returned: 0 in 0.278s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:40 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c1508c2a-5dfd-4244-be73-d51ee64ec4a9 tempest-VolumeDependencyTests-1617217841 None] Lock "cinder-quobyte-f99fb4a7-25af-4029-8bc7-8706a033c952" released by "delete_volume" :: held 0.733s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:40 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-c1508c2a-5dfd-4244-be73-d51ee64ec4a9 tempest-VolumeDependencyTests-1617217841 None] Created reservations ['9ecb073d-7f62-4a26-b440-006ecebe7b7a', '54451786-a886-4ac5-acc4-3bd2dd890cb3', 'c7a66784-7944-4798-b83c-590a51a15157', 'c583a7f2-a936-4c1c-8e4a-29004d9d4502'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:28:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c1508c2a-5dfd-4244-be73-d51ee64ec4a9 tempest-VolumeDependencyTests-1617217841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c1508c2a-5dfd-4244-be73-d51ee64ec4a9 tempest-VolumeDependencyTests-1617217841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:40 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c1508c2a-5dfd-4244-be73-d51ee64ec4a9 tempest-VolumeDependencyTests-1617217841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:40 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c1508c2a-5dfd-4244-be73-d51ee64ec4a9 tempest-VolumeDependencyTests-1617217841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c1508c2a-5dfd-4244-be73-d51ee64ec4a9 tempest-VolumeDependencyTests-1617217841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1508c2a-5dfd-4244-be73-d51ee64ec4a9 tempest-VolumeDependencyTests-1617217841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:40 devstack sudo[103450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:28:40 devstack sudo[103450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:40 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-cc4ba8eb-1a0f-4b55-add8-a9c7e4de1cb1 tempest-VolumeDependencyTests-1617217841 None] Acquiring lock "cinder-3c08275c-3fda-4858-8b5c-322da63e4b09-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:41 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-cc4ba8eb-1a0f-4b55-add8-a9c7e4de1cb1 tempest-VolumeDependencyTests-1617217841 None] Lock "cinder-3c08275c-3fda-4858-8b5c-322da63e4b09-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:41 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-cc4ba8eb-1a0f-4b55-add8-a9c7e4de1cb1 tempest-VolumeDependencyTests-1617217841 None] Acquiring lock "cinder-quobyte-3c08275c-3fda-4858-8b5c-322da63e4b09" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:41 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-cc4ba8eb-1a0f-4b55-add8-a9c7e4de1cb1 tempest-VolumeDependencyTests-1617217841 None] Lock "cinder-quobyte-3c08275c-3fda-4858-8b5c-322da63e4b09" acquired by "delete_volume" :: waited 0.017s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:41 devstack sudo[103450]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c1508c2a-5dfd-4244-be73-d51ee64ec4a9 tempest-VolumeDependencyTests-1617217841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.343s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:41 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-c1508c2a-5dfd-4244-be73-d51ee64ec4a9 tempest-VolumeDependencyTests-1617217841 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:28:41 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-c1508c2a-5dfd-4244-be73-d51ee64ec4a9 tempest-VolumeDependencyTests-1617217841 None] Deleted volume successfully. Sep 23 00:28:41 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[730f90ef-de47-4df5-b0a1-9adeff7610c4]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cc4ba8eb-1a0f-4b55-add8-a9c7e4de1cb1 tempest-VolumeDependencyTests-1617217841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3c08275c-3fda-4858-8b5c-322da63e4b09 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:41 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c1508c2a-5dfd-4244-be73-d51ee64ec4a9 tempest-VolumeDependencyTests-1617217841 None] Lock "cinder-f99fb4a7-25af-4029-8bc7-8706a033c952-delete_volume" released by "delete_volume" :: held 1.327s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:41 devstack sudo[103453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3c08275c-3fda-4858-8b5c-322da63e4b09 Sep 23 00:28:41 devstack sudo[103453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:41 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-a54171d0-6d9b-4190-8656-239f534e2c3a tempest-VolumesTransfersV355Test-266767142 None] Transfer volume completed successfully. Sep 23 00:28:41 devstack sudo[103453]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cc4ba8eb-1a0f-4b55-add8-a9c7e4de1cb1 tempest-VolumeDependencyTests-1617217841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3c08275c-3fda-4858-8b5c-322da63e4b09" returned: 0 in 0.447s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cc4ba8eb-1a0f-4b55-add8-a9c7e4de1cb1 tempest-VolumeDependencyTests-1617217841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3c08275c-3fda-4858-8b5c-322da63e4b09 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:41 devstack sudo[103458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3c08275c-3fda-4858-8b5c-322da63e4b09 Sep 23 00:28:41 devstack sudo[103458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:41 devstack sudo[103458]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cc4ba8eb-1a0f-4b55-add8-a9c7e4de1cb1 tempest-VolumeDependencyTests-1617217841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3c08275c-3fda-4858-8b5c-322da63e4b09" returned: 0 in 0.342s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:41 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-cc4ba8eb-1a0f-4b55-add8-a9c7e4de1cb1 tempest-VolumeDependencyTests-1617217841 None] Lock "cinder-quobyte-3c08275c-3fda-4858-8b5c-322da63e4b09" released by "delete_volume" :: held 0.855s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:42 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-cc4ba8eb-1a0f-4b55-add8-a9c7e4de1cb1 tempest-VolumeDependencyTests-1617217841 None] Created reservations ['f6f84cde-1385-48d7-877b-e61c6289afeb', '6360067f-76a3-4083-ad67-1d4faf447057', 'b9aa7c17-7324-40b0-9a7e-30e010ced852', 'dfc0dfdc-e468-4bbf-8a1c-277d65acc480'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:28:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-cc4ba8eb-1a0f-4b55-add8-a9c7e4de1cb1 tempest-VolumeDependencyTests-1617217841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-cc4ba8eb-1a0f-4b55-add8-a9c7e4de1cb1 tempest-VolumeDependencyTests-1617217841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-cc4ba8eb-1a0f-4b55-add8-a9c7e4de1cb1 tempest-VolumeDependencyTests-1617217841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-cc4ba8eb-1a0f-4b55-add8-a9c7e4de1cb1 tempest-VolumeDependencyTests-1617217841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-cc4ba8eb-1a0f-4b55-add8-a9c7e4de1cb1 tempest-VolumeDependencyTests-1617217841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cc4ba8eb-1a0f-4b55-add8-a9c7e4de1cb1 tempest-VolumeDependencyTests-1617217841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:42 devstack sudo[103463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:28:42 devstack sudo[103463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:42 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5d1a587a-e6f0-4231-9d05-9cf0c4b27101 tempest-VolumesTransfersV355Test-1748912274 None] Acquiring lock "cinder-e4837a0b-2005-4494-a2f7-9b3270bcbe1b-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:42 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5d1a587a-e6f0-4231-9d05-9cf0c4b27101 tempest-VolumesTransfersV355Test-1748912274 None] Lock "cinder-e4837a0b-2005-4494-a2f7-9b3270bcbe1b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:42 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5d1a587a-e6f0-4231-9d05-9cf0c4b27101 tempest-VolumesTransfersV355Test-1748912274 None] Acquiring lock "cinder-quobyte-e4837a0b-2005-4494-a2f7-9b3270bcbe1b" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:42 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5d1a587a-e6f0-4231-9d05-9cf0c4b27101 tempest-VolumesTransfersV355Test-1748912274 None] Lock "cinder-quobyte-e4837a0b-2005-4494-a2f7-9b3270bcbe1b" acquired by "delete_volume" :: waited 0.019s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:42 devstack sudo[103463]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cc4ba8eb-1a0f-4b55-add8-a9c7e4de1cb1 tempest-VolumeDependencyTests-1617217841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.353s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:42 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-cc4ba8eb-1a0f-4b55-add8-a9c7e4de1cb1 tempest-VolumeDependencyTests-1617217841 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:28:42 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-cc4ba8eb-1a0f-4b55-add8-a9c7e4de1cb1 tempest-VolumeDependencyTests-1617217841 None] Deleted volume successfully. Sep 23 00:28:42 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5306ac4-41df-479a-a97c-397c08a1a85d]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5d1a587a-e6f0-4231-9d05-9cf0c4b27101 tempest-VolumesTransfersV355Test-1748912274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e4837a0b-2005-4494-a2f7-9b3270bcbe1b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:42 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-cc4ba8eb-1a0f-4b55-add8-a9c7e4de1cb1 tempest-VolumeDependencyTests-1617217841 None] Lock "cinder-3c08275c-3fda-4858-8b5c-322da63e4b09-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:42 devstack sudo[103468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e4837a0b-2005-4494-a2f7-9b3270bcbe1b Sep 23 00:28:42 devstack sudo[103468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:42 devstack sudo[103468]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5d1a587a-e6f0-4231-9d05-9cf0c4b27101 tempest-VolumesTransfersV355Test-1748912274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e4837a0b-2005-4494-a2f7-9b3270bcbe1b" returned: 0 in 0.498s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5d1a587a-e6f0-4231-9d05-9cf0c4b27101 tempest-VolumesTransfersV355Test-1748912274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e4837a0b-2005-4494-a2f7-9b3270bcbe1b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:43 devstack sudo[103476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e4837a0b-2005-4494-a2f7-9b3270bcbe1b Sep 23 00:28:43 devstack sudo[103476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:43 devstack sudo[103476]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5d1a587a-e6f0-4231-9d05-9cf0c4b27101 tempest-VolumesTransfersV355Test-1748912274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e4837a0b-2005-4494-a2f7-9b3270bcbe1b" returned: 0 in 0.374s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:43 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5d1a587a-e6f0-4231-9d05-9cf0c4b27101 tempest-VolumesTransfersV355Test-1748912274 None] Lock "cinder-quobyte-e4837a0b-2005-4494-a2f7-9b3270bcbe1b" released by "delete_volume" :: held 0.972s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-a844e7b7-17ba-4aec-be4a-1c1fb625d1b2 req-3018cfc5-3b0b-4869-89e4-cd01f2b4867d tempest-TestStampPattern-410397350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-a844e7b7-17ba-4aec-be4a-1c1fb625d1b2 req-3018cfc5-3b0b-4869-89e4-cd01f2b4867d tempest-TestStampPattern-410397350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [req-a844e7b7-17ba-4aec-be4a-1c1fb625d1b2 req-3018cfc5-3b0b-4869-89e4-cd01f2b4867d tempest-TestStampPattern-410397350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:43 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-a844e7b7-17ba-4aec-be4a-1c1fb625d1b2 req-3018cfc5-3b0b-4869-89e4-cd01f2b4867d tempest-TestStampPattern-410397350 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974', 'name': 'volume-208fb30b-33b5-4e74-98f4-bc6c32f1e596', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b92004f1-6946-4e10-8a8d-44d2a9fa86dc', 'enforce_multipath': True} {{(pid=86591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:28:43 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-5d1a587a-e6f0-4231-9d05-9cf0c4b27101 tempest-VolumesTransfersV355Test-1748912274 None] Created reservations ['03fc6f75-4b29-45b3-9d69-38e91925ed39', '700a4a11-dc3b-453e-9cec-792357be0c4c', '1f797ab8-012c-489b-b972-e09381a2c2af', '84bac2e0-d0be-405e-9f0a-973bf76eb636'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:28:43 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-a844e7b7-17ba-4aec-be4a-1c1fb625d1b2 req-3018cfc5-3b0b-4869-89e4-cd01f2b4867d tempest-TestStampPattern-410397350 None] attachment_update completed successfully. Sep 23 00:28:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5d1a587a-e6f0-4231-9d05-9cf0c4b27101 tempest-VolumesTransfersV355Test-1748912274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5d1a587a-e6f0-4231-9d05-9cf0c4b27101 tempest-VolumesTransfersV355Test-1748912274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:43 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5d1a587a-e6f0-4231-9d05-9cf0c4b27101 tempest-VolumesTransfersV355Test-1748912274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:43 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5d1a587a-e6f0-4231-9d05-9cf0c4b27101 tempest-VolumesTransfersV355Test-1748912274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5d1a587a-e6f0-4231-9d05-9cf0c4b27101 tempest-VolumesTransfersV355Test-1748912274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5d1a587a-e6f0-4231-9d05-9cf0c4b27101 tempest-VolumesTransfersV355Test-1748912274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:43 devstack sudo[103488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:28:43 devstack sudo[103488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:44 devstack sudo[103488]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5d1a587a-e6f0-4231-9d05-9cf0c4b27101 tempest-VolumesTransfersV355Test-1748912274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.342s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:44 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-5d1a587a-e6f0-4231-9d05-9cf0c4b27101 tempest-VolumesTransfersV355Test-1748912274 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:28:44 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-5d1a587a-e6f0-4231-9d05-9cf0c4b27101 tempest-VolumesTransfersV355Test-1748912274 None] Deleted volume successfully. Sep 23 00:28:44 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5d1a587a-e6f0-4231-9d05-9cf0c4b27101 tempest-VolumesTransfersV355Test-1748912274 None] Lock "cinder-e4837a0b-2005-4494-a2f7-9b3270bcbe1b-delete_volume" released by "delete_volume" :: held 1.810s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:45 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-1467ec61-df23-4751-9250-e2e6103d2888 tempest-VolumesTransfersV355Test-41891552 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:28:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1467ec61-df23-4751-9250-e2e6103d2888 tempest-VolumesTransfersV355Test-41891552 None] Flow 'volume_create_manager' (92994bb7-0f32-4c35-9c9e-cca67efe1c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1467ec61-df23-4751-9250-e2e6103d2888 tempest-VolumesTransfersV355Test-41891552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (decf619b-266d-448d-be91-c867930021bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1467ec61-df23-4751-9250-e2e6103d2888 tempest-VolumesTransfersV355Test-41891552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (decf619b-266d-448d-be91-c867930021bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-634862291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63f6d684-443b-49f8-8c4d-baabd8f0a0b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4967e209ce346738633c8d00c16f489',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:45Z,use_quota=True,user_id='308e2ce06fd44cedb2a48f76c55d4624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1467ec61-df23-4751-9250-e2e6103d2888 tempest-VolumesTransfersV355Test-41891552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc39347a-88f0-418a-bb4d-07e74593e770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1467ec61-df23-4751-9250-e2e6103d2888 tempest-VolumesTransfersV355Test-41891552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc39347a-88f0-418a-bb4d-07e74593e770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1467ec61-df23-4751-9250-e2e6103d2888 tempest-VolumesTransfersV355Test-41891552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfd6fcd6-4a21-48ff-8ff0-e0662008ce06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1467ec61-df23-4751-9250-e2e6103d2888 tempest-VolumesTransfersV355Test-41891552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfd6fcd6-4a21-48ff-8ff0-e0662008ce06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63f6d684-443b-49f8-8c4d-baabd8f0a0b3', 'volume_name': 'volume-63f6d684-443b-49f8-8c4d-baabd8f0a0b3', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1467ec61-df23-4751-9250-e2e6103d2888 tempest-VolumesTransfersV355Test-41891552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (594b4934-1a69-48f8-9e3f-219d3b5d3740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1467ec61-df23-4751-9250-e2e6103d2888 tempest-VolumesTransfersV355Test-41891552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (594b4934-1a69-48f8-9e3f-219d3b5d3740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1467ec61-df23-4751-9250-e2e6103d2888 tempest-VolumesTransfersV355Test-41891552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04bc1629-8275-436e-8b53-889b66932c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:45 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-1467ec61-df23-4751-9250-e2e6103d2888 tempest-VolumesTransfersV355Test-41891552 None] Volume 63f6d684-443b-49f8-8c4d-baabd8f0a0b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63f6d684-443b-49f8-8c4d-baabd8f0a0b3', 'volume_size': 1} Sep 23 00:28:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1467ec61-df23-4751-9250-e2e6103d2888 tempest-VolumesTransfersV355Test-41891552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1467ec61-df23-4751-9250-e2e6103d2888 tempest-VolumesTransfersV355Test-41891552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:45 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1467ec61-df23-4751-9250-e2e6103d2888 tempest-VolumesTransfersV355Test-41891552 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-634862291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63f6d684-443b-49f8-8c4d-baabd8f0a0b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4967e209ce346738633c8d00c16f489',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:45Z,use_quota=True,user_id='308e2ce06fd44cedb2a48f76c55d4624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:28:45 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-1467ec61-df23-4751-9250-e2e6103d2888 tempest-VolumesTransfersV355Test-41891552 None] Creating volume 63f6d684-443b-49f8-8c4d-baabd8f0a0b3 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:28:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1467ec61-df23-4751-9250-e2e6103d2888 tempest-VolumesTransfersV355Test-41891552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1467ec61-df23-4751-9250-e2e6103d2888 tempest-VolumesTransfersV355Test-41891552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:45 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1467ec61-df23-4751-9250-e2e6103d2888 tempest-VolumesTransfersV355Test-41891552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:45 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1467ec61-df23-4751-9250-e2e6103d2888 tempest-VolumesTransfersV355Test-41891552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1467ec61-df23-4751-9250-e2e6103d2888 tempest-VolumesTransfersV355Test-41891552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:45 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1467ec61-df23-4751-9250-e2e6103d2888 tempest-VolumesTransfersV355Test-41891552 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:28:45 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-1467ec61-df23-4751-9250-e2e6103d2888 tempest-VolumesTransfersV355Test-41891552 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:28:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1467ec61-df23-4751-9250-e2e6103d2888 tempest-VolumesTransfersV355Test-41891552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-63f6d684-443b-49f8-8c4d-baabd8f0a0b3 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:45 devstack sudo[103902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-63f6d684-443b-49f8-8c4d-baabd8f0a0b3 1073741824 Sep 23 00:28:45 devstack sudo[103902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:45 devstack sudo[103902]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1467ec61-df23-4751-9250-e2e6103d2888 tempest-VolumesTransfersV355Test-41891552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-63f6d684-443b-49f8-8c4d-baabd8f0a0b3 1073741824" returned: 0 in 0.566s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1467ec61-df23-4751-9250-e2e6103d2888 tempest-VolumesTransfersV355Test-41891552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-63f6d684-443b-49f8-8c4d-baabd8f0a0b3 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:46 devstack sudo[103920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-63f6d684-443b-49f8-8c4d-baabd8f0a0b3 Sep 23 00:28:46 devstack sudo[103920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:46 devstack sudo[103920]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1467ec61-df23-4751-9250-e2e6103d2888 tempest-VolumesTransfersV355Test-41891552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-63f6d684-443b-49f8-8c4d-baabd8f0a0b3" returned: 0 in 0.358s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1467ec61-df23-4751-9250-e2e6103d2888 tempest-VolumesTransfersV355Test-41891552 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:28:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1467ec61-df23-4751-9250-e2e6103d2888 tempest-VolumesTransfersV355Test-41891552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1467ec61-df23-4751-9250-e2e6103d2888 tempest-VolumesTransfersV355Test-41891552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04bc1629-8275-436e-8b53-889b66932c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63f6d684-443b-49f8-8c4d-baabd8f0a0b3', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1467ec61-df23-4751-9250-e2e6103d2888 tempest-VolumesTransfersV355Test-41891552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fd87cd3-8800-4790-8a01-9650ff3806eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:46 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-1467ec61-df23-4751-9250-e2e6103d2888 tempest-VolumesTransfersV355Test-41891552 None] Volume volume-63f6d684-443b-49f8-8c4d-baabd8f0a0b3 (63f6d684-443b-49f8-8c4d-baabd8f0a0b3): created successfully Sep 23 00:28:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1467ec61-df23-4751-9250-e2e6103d2888 tempest-VolumesTransfersV355Test-41891552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fd87cd3-8800-4790-8a01-9650ff3806eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1467ec61-df23-4751-9250-e2e6103d2888 tempest-VolumesTransfersV355Test-41891552 None] Flow 'volume_create_manager' (92994bb7-0f32-4c35-9c9e-cca67efe1c96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:46 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-1467ec61-df23-4751-9250-e2e6103d2888 tempest-VolumesTransfersV355Test-41891552 None] Created volume successfully. Sep 23 00:28:47 devstack cinder-volume[86591]: INFO cinder.volume.manager [req-872995d8-8b3b-4fea-a058-28a740fce8c7 req-ed6a05af-05c7-46db-b385-781daf0f2d2f tempest-TestStampPattern-410397350 None] Terminate volume connection completed successfully. Sep 23 00:28:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [req-872995d8-8b3b-4fea-a058-28a740fce8c7 req-ed6a05af-05c7-46db-b385-781daf0f2d2f tempest-TestStampPattern-410397350 None] Deleting attachment b92004f1-6946-4e10-8a8d-44d2a9fa86dc. {{(pid=86591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:28:47 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-17c7f03e-6bfb-430a-8aec-09ffec08ee1d tempest-ProjectReaderTests-116725566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:28:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-17c7f03e-6bfb-430a-8aec-09ffec08ee1d tempest-ProjectReaderTests-116725566 None] Flow 'volume_create_manager' (d880b0a4-726a-4df3-8502-3edb004b97dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-17c7f03e-6bfb-430a-8aec-09ffec08ee1d tempest-ProjectReaderTests-116725566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (054d662e-38f4-4143-9d4b-b33a2ea94741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-17c7f03e-6bfb-430a-8aec-09ffec08ee1d tempest-ProjectReaderTests-116725566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (054d662e-38f4-4143-9d4b-b33a2ea94741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-328612465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d97cee2-3662-4685-b903-e393ba6d2a94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='131f0bdfd60148d690442b5d1f1c3c1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:47Z,use_quota=True,user_id='99425be03c834298ae931d2126b117a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-17c7f03e-6bfb-430a-8aec-09ffec08ee1d tempest-ProjectReaderTests-116725566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3a20169-7608-48b2-87a2-42bc7731d190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-17c7f03e-6bfb-430a-8aec-09ffec08ee1d tempest-ProjectReaderTests-116725566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3a20169-7608-48b2-87a2-42bc7731d190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-17c7f03e-6bfb-430a-8aec-09ffec08ee1d tempest-ProjectReaderTests-116725566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (954f9ea9-0a6c-4b59-9b96-13d61b6ffff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-17c7f03e-6bfb-430a-8aec-09ffec08ee1d tempest-ProjectReaderTests-116725566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (954f9ea9-0a6c-4b59-9b96-13d61b6ffff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d97cee2-3662-4685-b903-e393ba6d2a94', 'volume_name': 'volume-2d97cee2-3662-4685-b903-e393ba6d2a94', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-17c7f03e-6bfb-430a-8aec-09ffec08ee1d tempest-ProjectReaderTests-116725566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc3e7caf-a4c8-496f-89f0-8c7f94d51b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-17c7f03e-6bfb-430a-8aec-09ffec08ee1d tempest-ProjectReaderTests-116725566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc3e7caf-a4c8-496f-89f0-8c7f94d51b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-17c7f03e-6bfb-430a-8aec-09ffec08ee1d tempest-ProjectReaderTests-116725566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b90ecf98-0461-45a2-833e-b3cea6eece1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:47 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-17c7f03e-6bfb-430a-8aec-09ffec08ee1d tempest-ProjectReaderTests-116725566 None] Volume 2d97cee2-3662-4685-b903-e393ba6d2a94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d97cee2-3662-4685-b903-e393ba6d2a94', 'volume_size': 1} Sep 23 00:28:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-17c7f03e-6bfb-430a-8aec-09ffec08ee1d tempest-ProjectReaderTests-116725566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-17c7f03e-6bfb-430a-8aec-09ffec08ee1d tempest-ProjectReaderTests-116725566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:47 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-17c7f03e-6bfb-430a-8aec-09ffec08ee1d tempest-ProjectReaderTests-116725566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-328612465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d97cee2-3662-4685-b903-e393ba6d2a94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='131f0bdfd60148d690442b5d1f1c3c1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:47Z,use_quota=True,user_id='99425be03c834298ae931d2126b117a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:28:47 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-17c7f03e-6bfb-430a-8aec-09ffec08ee1d tempest-ProjectReaderTests-116725566 None] Creating volume 2d97cee2-3662-4685-b903-e393ba6d2a94 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:28:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-17c7f03e-6bfb-430a-8aec-09ffec08ee1d tempest-ProjectReaderTests-116725566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-17c7f03e-6bfb-430a-8aec-09ffec08ee1d tempest-ProjectReaderTests-116725566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:47 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-17c7f03e-6bfb-430a-8aec-09ffec08ee1d tempest-ProjectReaderTests-116725566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:47 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-17c7f03e-6bfb-430a-8aec-09ffec08ee1d tempest-ProjectReaderTests-116725566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-17c7f03e-6bfb-430a-8aec-09ffec08ee1d tempest-ProjectReaderTests-116725566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:47 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-17c7f03e-6bfb-430a-8aec-09ffec08ee1d tempest-ProjectReaderTests-116725566 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:28:47 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-17c7f03e-6bfb-430a-8aec-09ffec08ee1d tempest-ProjectReaderTests-116725566 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:28:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-17c7f03e-6bfb-430a-8aec-09ffec08ee1d tempest-ProjectReaderTests-116725566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2d97cee2-3662-4685-b903-e393ba6d2a94 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:47 devstack sudo[103955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2d97cee2-3662-4685-b903-e393ba6d2a94 1073741824 Sep 23 00:28:47 devstack sudo[103955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:47 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-849c674f-0355-4bad-ba1f-ec74393f4b7f tempest-VolumesTransfersV355Test-1748912274 None] Acquiring lock "cinder-63f6d684-443b-49f8-8c4d-baabd8f0a0b3-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:47 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-849c674f-0355-4bad-ba1f-ec74393f4b7f tempest-VolumesTransfersV355Test-1748912274 None] Lock "cinder-63f6d684-443b-49f8-8c4d-baabd8f0a0b3-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:47 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-849c674f-0355-4bad-ba1f-ec74393f4b7f tempest-VolumesTransfersV355Test-1748912274 None] Acquiring lock "cinder-quobyte-63f6d684-443b-49f8-8c4d-baabd8f0a0b3" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:47 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-849c674f-0355-4bad-ba1f-ec74393f4b7f tempest-VolumesTransfersV355Test-1748912274 None] Lock "cinder-quobyte-63f6d684-443b-49f8-8c4d-baabd8f0a0b3" acquired by "delete_volume" :: waited 0.022s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:47 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[d038f089-47d9-40ec-a152-bdde59b11998]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-849c674f-0355-4bad-ba1f-ec74393f4b7f tempest-VolumesTransfersV355Test-1748912274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-63f6d684-443b-49f8-8c4d-baabd8f0a0b3 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:48 devstack sudo[103960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-63f6d684-443b-49f8-8c4d-baabd8f0a0b3 Sep 23 00:28:48 devstack sudo[103960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:48 devstack sudo[103955]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-17c7f03e-6bfb-430a-8aec-09ffec08ee1d tempest-ProjectReaderTests-116725566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2d97cee2-3662-4685-b903-e393ba6d2a94 1073741824" returned: 0 in 0.592s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-17c7f03e-6bfb-430a-8aec-09ffec08ee1d tempest-ProjectReaderTests-116725566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2d97cee2-3662-4685-b903-e393ba6d2a94 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:48 devstack sudo[103963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2d97cee2-3662-4685-b903-e393ba6d2a94 Sep 23 00:28:48 devstack sudo[103963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:48 devstack sudo[103960]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-849c674f-0355-4bad-ba1f-ec74393f4b7f tempest-VolumesTransfersV355Test-1748912274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-63f6d684-443b-49f8-8c4d-baabd8f0a0b3" returned: 0 in 0.502s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-849c674f-0355-4bad-ba1f-ec74393f4b7f tempest-VolumesTransfersV355Test-1748912274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-63f6d684-443b-49f8-8c4d-baabd8f0a0b3 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:48 devstack sudo[103969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-63f6d684-443b-49f8-8c4d-baabd8f0a0b3 Sep 23 00:28:48 devstack sudo[103969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:48 devstack sudo[103963]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-17c7f03e-6bfb-430a-8aec-09ffec08ee1d tempest-ProjectReaderTests-116725566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2d97cee2-3662-4685-b903-e393ba6d2a94" returned: 0 in 0.320s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:48 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-17c7f03e-6bfb-430a-8aec-09ffec08ee1d tempest-ProjectReaderTests-116725566 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:28:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-17c7f03e-6bfb-430a-8aec-09ffec08ee1d tempest-ProjectReaderTests-116725566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:48 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-17c7f03e-6bfb-430a-8aec-09ffec08ee1d tempest-ProjectReaderTests-116725566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b90ecf98-0461-45a2-833e-b3cea6eece1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d97cee2-3662-4685-b903-e393ba6d2a94', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:48 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-17c7f03e-6bfb-430a-8aec-09ffec08ee1d tempest-ProjectReaderTests-116725566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d6205c1-3b84-44a2-9988-d71cf80e462f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:48 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-17c7f03e-6bfb-430a-8aec-09ffec08ee1d tempest-ProjectReaderTests-116725566 None] Volume volume-2d97cee2-3662-4685-b903-e393ba6d2a94 (2d97cee2-3662-4685-b903-e393ba6d2a94): created successfully Sep 23 00:28:48 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-17c7f03e-6bfb-430a-8aec-09ffec08ee1d tempest-ProjectReaderTests-116725566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d6205c1-3b84-44a2-9988-d71cf80e462f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:48 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-17c7f03e-6bfb-430a-8aec-09ffec08ee1d tempest-ProjectReaderTests-116725566 None] Flow 'volume_create_manager' (d880b0a4-726a-4df3-8502-3edb004b97dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:48 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-17c7f03e-6bfb-430a-8aec-09ffec08ee1d tempest-ProjectReaderTests-116725566 None] Created volume successfully. Sep 23 00:28:48 devstack sudo[103969]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-849c674f-0355-4bad-ba1f-ec74393f4b7f tempest-VolumesTransfersV355Test-1748912274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-63f6d684-443b-49f8-8c4d-baabd8f0a0b3" returned: 0 in 0.381s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:48 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-849c674f-0355-4bad-ba1f-ec74393f4b7f tempest-VolumesTransfersV355Test-1748912274 None] Lock "cinder-quobyte-63f6d684-443b-49f8-8c4d-baabd8f0a0b3" released by "delete_volume" :: held 0.936s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:48 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-849c674f-0355-4bad-ba1f-ec74393f4b7f tempest-VolumesTransfersV355Test-1748912274 None] Created reservations ['4a18def1-5420-4e92-a40d-7d9bd4f96c37', '1a59fb87-677d-45bb-8dc5-5f32901489ba', 'b02b666c-699d-40f9-86ee-ba12e692d060', 'ae725ae7-a0a1-48a9-96d8-fc55ba0f965b'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:28:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-849c674f-0355-4bad-ba1f-ec74393f4b7f tempest-VolumesTransfersV355Test-1748912274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-849c674f-0355-4bad-ba1f-ec74393f4b7f tempest-VolumesTransfersV355Test-1748912274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:48 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-849c674f-0355-4bad-ba1f-ec74393f4b7f tempest-VolumesTransfersV355Test-1748912274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:48 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-849c674f-0355-4bad-ba1f-ec74393f4b7f tempest-VolumesTransfersV355Test-1748912274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-849c674f-0355-4bad-ba1f-ec74393f4b7f tempest-VolumesTransfersV355Test-1748912274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-849c674f-0355-4bad-ba1f-ec74393f4b7f tempest-VolumesTransfersV355Test-1748912274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:49 devstack sudo[103974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:28:49 devstack sudo[103974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:49 devstack sudo[103974]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-849c674f-0355-4bad-ba1f-ec74393f4b7f tempest-VolumesTransfersV355Test-1748912274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.557s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:49 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-849c674f-0355-4bad-ba1f-ec74393f4b7f tempest-VolumesTransfersV355Test-1748912274 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:28:49 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-849c674f-0355-4bad-ba1f-ec74393f4b7f tempest-VolumesTransfersV355Test-1748912274 None] Deleted volume successfully. Sep 23 00:28:49 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-849c674f-0355-4bad-ba1f-ec74393f4b7f tempest-VolumesTransfersV355Test-1748912274 None] Lock "cinder-63f6d684-443b-49f8-8c4d-baabd8f0a0b3-delete_volume" released by "delete_volume" :: held 1.811s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:50 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b71180a4-622a-42ee-bb65-0847772333f2 tempest-ProjectReaderTests-116725566 None] Acquiring lock "cinder-2d97cee2-3662-4685-b903-e393ba6d2a94-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:50 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b71180a4-622a-42ee-bb65-0847772333f2 tempest-ProjectReaderTests-116725566 None] Lock "cinder-2d97cee2-3662-4685-b903-e393ba6d2a94-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:50 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b71180a4-622a-42ee-bb65-0847772333f2 tempest-ProjectReaderTests-116725566 None] Acquiring lock "cinder-quobyte-2d97cee2-3662-4685-b903-e393ba6d2a94" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:50 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b71180a4-622a-42ee-bb65-0847772333f2 tempest-ProjectReaderTests-116725566 None] Lock "cinder-quobyte-2d97cee2-3662-4685-b903-e393ba6d2a94" acquired by "delete_volume" :: waited 0.019s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:50 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[6646f21d-d8a2-421f-b15c-abac78beb3c1]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b71180a4-622a-42ee-bb65-0847772333f2 tempest-ProjectReaderTests-116725566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2d97cee2-3662-4685-b903-e393ba6d2a94 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:50 devstack sudo[104001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2d97cee2-3662-4685-b903-e393ba6d2a94 Sep 23 00:28:50 devstack sudo[104001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:51 devstack sudo[104001]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b71180a4-622a-42ee-bb65-0847772333f2 tempest-ProjectReaderTests-116725566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2d97cee2-3662-4685-b903-e393ba6d2a94" returned: 0 in 0.685s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b71180a4-622a-42ee-bb65-0847772333f2 tempest-ProjectReaderTests-116725566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2d97cee2-3662-4685-b903-e393ba6d2a94 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:51 devstack sudo[104007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2d97cee2-3662-4685-b903-e393ba6d2a94 Sep 23 00:28:51 devstack sudo[104007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:51 devstack sudo[104007]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b71180a4-622a-42ee-bb65-0847772333f2 tempest-ProjectReaderTests-116725566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2d97cee2-3662-4685-b903-e393ba6d2a94" returned: 0 in 0.494s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:51 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b71180a4-622a-42ee-bb65-0847772333f2 tempest-ProjectReaderTests-116725566 None] Lock "cinder-quobyte-2d97cee2-3662-4685-b903-e393ba6d2a94" released by "delete_volume" :: held 1.246s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:51 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-b71180a4-622a-42ee-bb65-0847772333f2 tempest-ProjectReaderTests-116725566 None] Created reservations ['f030136c-5703-47e3-b65a-30b5af8340c8', 'cb80d3c5-a417-41ce-b884-9dc429bd1a0c', 'c6fc43fe-ef38-4a41-84de-1826ba476d55', '787003b3-4248-4e87-9624-0c073d1c4766'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:28:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b71180a4-622a-42ee-bb65-0847772333f2 tempest-ProjectReaderTests-116725566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b71180a4-622a-42ee-bb65-0847772333f2 tempest-ProjectReaderTests-116725566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:51 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b71180a4-622a-42ee-bb65-0847772333f2 tempest-ProjectReaderTests-116725566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:51 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b71180a4-622a-42ee-bb65-0847772333f2 tempest-ProjectReaderTests-116725566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b71180a4-622a-42ee-bb65-0847772333f2 tempest-ProjectReaderTests-116725566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b71180a4-622a-42ee-bb65-0847772333f2 tempest-ProjectReaderTests-116725566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:51 devstack sudo[104011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:28:51 devstack sudo[104011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:52 devstack sudo[104011]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b71180a4-622a-42ee-bb65-0847772333f2 tempest-ProjectReaderTests-116725566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.335s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:52 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-b71180a4-622a-42ee-bb65-0847772333f2 tempest-ProjectReaderTests-116725566 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:28:52 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-b71180a4-622a-42ee-bb65-0847772333f2 tempest-ProjectReaderTests-116725566 None] Deleted volume successfully. Sep 23 00:28:52 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b71180a4-622a-42ee-bb65-0847772333f2 tempest-ProjectReaderTests-116725566 None] Lock "cinder-2d97cee2-3662-4685-b903-e393ba6d2a94-delete_volume" released by "delete_volume" :: held 1.861s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:52 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-286b111f-26b5-4179-8d11-4ab087c7f096 tempest-TestStampPattern-410397350 None] Acquiring lock "cinder-208fb30b-33b5-4e74-98f4-bc6c32f1e596-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:52 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-286b111f-26b5-4179-8d11-4ab087c7f096 tempest-TestStampPattern-410397350 None] Lock "cinder-208fb30b-33b5-4e74-98f4-bc6c32f1e596-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:52 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-286b111f-26b5-4179-8d11-4ab087c7f096 tempest-TestStampPattern-410397350 None] Acquiring lock "cinder-quobyte-208fb30b-33b5-4e74-98f4-bc6c32f1e596" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:52 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-286b111f-26b5-4179-8d11-4ab087c7f096 tempest-TestStampPattern-410397350 None] Lock "cinder-quobyte-208fb30b-33b5-4e74-98f4-bc6c32f1e596" acquired by "delete_volume" :: waited 0.039s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:52 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[d559fb01-a808-4b2b-9529-373f825a936f]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-286b111f-26b5-4179-8d11-4ab087c7f096 tempest-TestStampPattern-410397350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-208fb30b-33b5-4e74-98f4-bc6c32f1e596 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:52 devstack sudo[104014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-208fb30b-33b5-4e74-98f4-bc6c32f1e596 Sep 23 00:28:52 devstack sudo[104014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:53 devstack sudo[104014]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-286b111f-26b5-4179-8d11-4ab087c7f096 tempest-TestStampPattern-410397350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-208fb30b-33b5-4e74-98f4-bc6c32f1e596" returned: 0 in 0.607s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-286b111f-26b5-4179-8d11-4ab087c7f096 tempest-TestStampPattern-410397350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-208fb30b-33b5-4e74-98f4-bc6c32f1e596 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:53 devstack sudo[104019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-208fb30b-33b5-4e74-98f4-bc6c32f1e596 Sep 23 00:28:53 devstack sudo[104019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:53 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1baf9c6-8cd7-4296-b4b6-7f25ccee823b tempest-ProjectReaderTests-116725566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:28:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f1baf9c6-8cd7-4296-b4b6-7f25ccee823b tempest-ProjectReaderTests-116725566 None] Flow 'volume_create_manager' (dcf62b80-5416-411f-a03f-96b688b68cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f1baf9c6-8cd7-4296-b4b6-7f25ccee823b tempest-ProjectReaderTests-116725566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c63c188-8828-4faa-ba14-b03cabae478f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f1baf9c6-8cd7-4296-b4b6-7f25ccee823b tempest-ProjectReaderTests-116725566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c63c188-8828-4faa-ba14-b03cabae478f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-890574821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11f18871-05e6-49e3-a49e-d25e7cde7b7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='131f0bdfd60148d690442b5d1f1c3c1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:53Z,use_quota=True,user_id='99425be03c834298ae931d2126b117a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f1baf9c6-8cd7-4296-b4b6-7f25ccee823b tempest-ProjectReaderTests-116725566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64b4e0cb-3cec-4a34-91e8-b043c95cb58f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f1baf9c6-8cd7-4296-b4b6-7f25ccee823b tempest-ProjectReaderTests-116725566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64b4e0cb-3cec-4a34-91e8-b043c95cb58f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f1baf9c6-8cd7-4296-b4b6-7f25ccee823b tempest-ProjectReaderTests-116725566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (788fd0ce-0ec5-44a4-9fd9-6ef438ba90c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f1baf9c6-8cd7-4296-b4b6-7f25ccee823b tempest-ProjectReaderTests-116725566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (788fd0ce-0ec5-44a4-9fd9-6ef438ba90c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11f18871-05e6-49e3-a49e-d25e7cde7b7e', 'volume_name': 'volume-11f18871-05e6-49e3-a49e-d25e7cde7b7e', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f1baf9c6-8cd7-4296-b4b6-7f25ccee823b tempest-ProjectReaderTests-116725566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b4f4342-6793-4df8-a9b8-0f0dce55b8ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f1baf9c6-8cd7-4296-b4b6-7f25ccee823b tempest-ProjectReaderTests-116725566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b4f4342-6793-4df8-a9b8-0f0dce55b8ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:53 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f1baf9c6-8cd7-4296-b4b6-7f25ccee823b tempest-ProjectReaderTests-116725566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75ac0d41-e22d-4084-b9e5-ff26b8ad8eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:53 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-f1baf9c6-8cd7-4296-b4b6-7f25ccee823b tempest-ProjectReaderTests-116725566 None] Volume 11f18871-05e6-49e3-a49e-d25e7cde7b7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11f18871-05e6-49e3-a49e-d25e7cde7b7e', 'volume_size': 1} Sep 23 00:28:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f1baf9c6-8cd7-4296-b4b6-7f25ccee823b tempest-ProjectReaderTests-116725566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f1baf9c6-8cd7-4296-b4b6-7f25ccee823b tempest-ProjectReaderTests-116725566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:53 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f1baf9c6-8cd7-4296-b4b6-7f25ccee823b tempest-ProjectReaderTests-116725566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-890574821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11f18871-05e6-49e3-a49e-d25e7cde7b7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='131f0bdfd60148d690442b5d1f1c3c1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:53Z,use_quota=True,user_id='99425be03c834298ae931d2126b117a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:28:53 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-f1baf9c6-8cd7-4296-b4b6-7f25ccee823b tempest-ProjectReaderTests-116725566 None] Creating volume 11f18871-05e6-49e3-a49e-d25e7cde7b7e {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:28:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f1baf9c6-8cd7-4296-b4b6-7f25ccee823b tempest-ProjectReaderTests-116725566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f1baf9c6-8cd7-4296-b4b6-7f25ccee823b tempest-ProjectReaderTests-116725566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:53 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f1baf9c6-8cd7-4296-b4b6-7f25ccee823b tempest-ProjectReaderTests-116725566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:53 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f1baf9c6-8cd7-4296-b4b6-7f25ccee823b tempest-ProjectReaderTests-116725566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f1baf9c6-8cd7-4296-b4b6-7f25ccee823b tempest-ProjectReaderTests-116725566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:53 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f1baf9c6-8cd7-4296-b4b6-7f25ccee823b tempest-ProjectReaderTests-116725566 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:28:53 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-f1baf9c6-8cd7-4296-b4b6-7f25ccee823b tempest-ProjectReaderTests-116725566 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:28:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f1baf9c6-8cd7-4296-b4b6-7f25ccee823b tempest-ProjectReaderTests-116725566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-11f18871-05e6-49e3-a49e-d25e7cde7b7e 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:53 devstack sudo[104021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-11f18871-05e6-49e3-a49e-d25e7cde7b7e 1073741824 Sep 23 00:28:53 devstack sudo[104021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:53 devstack sudo[104019]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-286b111f-26b5-4179-8d11-4ab087c7f096 tempest-TestStampPattern-410397350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-208fb30b-33b5-4e74-98f4-bc6c32f1e596" returned: 0 in 0.416s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:53 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-286b111f-26b5-4179-8d11-4ab087c7f096 tempest-TestStampPattern-410397350 None] Lock "cinder-quobyte-208fb30b-33b5-4e74-98f4-bc6c32f1e596" released by "delete_volume" :: held 1.130s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:53 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-286b111f-26b5-4179-8d11-4ab087c7f096 tempest-TestStampPattern-410397350 None] Created reservations ['9c94ce6d-615e-41f1-81ce-192bdefc0c96', '3b7a1535-5e21-430e-982c-29b898aa7545', '83221a2d-fe66-49c6-af77-4be64dbcc135', 'd4aff9b2-eb49-476e-b8ab-81cd1da51439'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:28:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-286b111f-26b5-4179-8d11-4ab087c7f096 tempest-TestStampPattern-410397350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-286b111f-26b5-4179-8d11-4ab087c7f096 tempest-TestStampPattern-410397350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:53 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-286b111f-26b5-4179-8d11-4ab087c7f096 tempest-TestStampPattern-410397350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:53 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-286b111f-26b5-4179-8d11-4ab087c7f096 tempest-TestStampPattern-410397350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-286b111f-26b5-4179-8d11-4ab087c7f096 tempest-TestStampPattern-410397350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-286b111f-26b5-4179-8d11-4ab087c7f096 tempest-TestStampPattern-410397350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:53 devstack sudo[104027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:28:53 devstack sudo[104027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:54 devstack sudo[104021]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f1baf9c6-8cd7-4296-b4b6-7f25ccee823b tempest-ProjectReaderTests-116725566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-11f18871-05e6-49e3-a49e-d25e7cde7b7e 1073741824" returned: 0 in 0.603s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f1baf9c6-8cd7-4296-b4b6-7f25ccee823b tempest-ProjectReaderTests-116725566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-11f18871-05e6-49e3-a49e-d25e7cde7b7e {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:54 devstack sudo[104031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-11f18871-05e6-49e3-a49e-d25e7cde7b7e Sep 23 00:28:54 devstack sudo[104031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:54 devstack sudo[104027]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-286b111f-26b5-4179-8d11-4ab087c7f096 tempest-TestStampPattern-410397350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.323s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:54 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-286b111f-26b5-4179-8d11-4ab087c7f096 tempest-TestStampPattern-410397350 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:28:54 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-286b111f-26b5-4179-8d11-4ab087c7f096 tempest-TestStampPattern-410397350 None] Deleted volume successfully. Sep 23 00:28:54 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-286b111f-26b5-4179-8d11-4ab087c7f096 tempest-TestStampPattern-410397350 None] Lock "cinder-208fb30b-33b5-4e74-98f4-bc6c32f1e596-delete_volume" released by "delete_volume" :: held 1.815s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:54 devstack sudo[104031]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f1baf9c6-8cd7-4296-b4b6-7f25ccee823b tempest-ProjectReaderTests-116725566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-11f18871-05e6-49e3-a49e-d25e7cde7b7e" returned: 0 in 0.296s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f1baf9c6-8cd7-4296-b4b6-7f25ccee823b tempest-ProjectReaderTests-116725566 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:28:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f1baf9c6-8cd7-4296-b4b6-7f25ccee823b tempest-ProjectReaderTests-116725566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f1baf9c6-8cd7-4296-b4b6-7f25ccee823b tempest-ProjectReaderTests-116725566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75ac0d41-e22d-4084-b9e5-ff26b8ad8eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11f18871-05e6-49e3-a49e-d25e7cde7b7e', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f1baf9c6-8cd7-4296-b4b6-7f25ccee823b tempest-ProjectReaderTests-116725566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (155ed6d4-b5d8-409c-961f-c493106dcd7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:54 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-f1baf9c6-8cd7-4296-b4b6-7f25ccee823b tempest-ProjectReaderTests-116725566 None] Volume volume-11f18871-05e6-49e3-a49e-d25e7cde7b7e (11f18871-05e6-49e3-a49e-d25e7cde7b7e): created successfully Sep 23 00:28:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f1baf9c6-8cd7-4296-b4b6-7f25ccee823b tempest-ProjectReaderTests-116725566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (155ed6d4-b5d8-409c-961f-c493106dcd7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f1baf9c6-8cd7-4296-b4b6-7f25ccee823b tempest-ProjectReaderTests-116725566 None] Flow 'volume_create_manager' (dcf62b80-5416-411f-a03f-96b688b68cb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:54 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-f1baf9c6-8cd7-4296-b4b6-7f25ccee823b tempest-ProjectReaderTests-116725566 None] Created volume successfully. Sep 23 00:28:55 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9423e5fd-fbc4-4256-b8ab-02a0d044bf86 tempest-TestStampPattern-410397350 None] Acquiring lock "cinder-f00cdcbe-6149-45c7-b696-4b521da55dd7-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:55 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9423e5fd-fbc4-4256-b8ab-02a0d044bf86 tempest-TestStampPattern-410397350 None] Lock "cinder-f00cdcbe-6149-45c7-b696-4b521da55dd7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:55 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9423e5fd-fbc4-4256-b8ab-02a0d044bf86 tempest-TestStampPattern-410397350 None] Acquiring lock "cinder-quobyte-18830956-febd-4f80-95cb-29c7f36f4da6" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:55 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9423e5fd-fbc4-4256-b8ab-02a0d044bf86 tempest-TestStampPattern-410397350 None] Lock "cinder-quobyte-18830956-febd-4f80-95cb-29c7f36f4da6" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:55 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9423e5fd-fbc4-4256-b8ab-02a0d044bf86 tempest-TestStampPattern-410397350 None] Acquiring lock "cinder-quobyte-f00cdcbe-6149-45c7-b696-4b521da55dd7" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:55 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9423e5fd-fbc4-4256-b8ab-02a0d044bf86 tempest-TestStampPattern-410397350 None] Lock "cinder-quobyte-f00cdcbe-6149-45c7-b696-4b521da55dd7" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:55 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-9423e5fd-fbc4-4256-b8ab-02a0d044bf86 tempest-TestStampPattern-410397350 None] Deleting offline snapshot f00cdcbe-6149-45c7-b696-4b521da55dd7 of volume 18830956-febd-4f80-95cb-29c7f36f4da6 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:28:55 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-9423e5fd-fbc4-4256-b8ab-02a0d044bf86 tempest-TestStampPattern-410397350 None] snapshot_file for this snap is: volume-18830956-febd-4f80-95cb-29c7f36f4da6.f00cdcbe-6149-45c7-b696-4b521da55dd7 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:28:55 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf296ef-44fc-4398-8b33-fb221b43e7de]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9423e5fd-fbc4-4256-b8ab-02a0d044bf86 tempest-TestStampPattern-410397350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-18830956-febd-4f80-95cb-29c7f36f4da6.f00cdcbe-6149-45c7-b696-4b521da55dd7 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:55 devstack sudo[104034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-18830956-febd-4f80-95cb-29c7f36f4da6.f00cdcbe-6149-45c7-b696-4b521da55dd7 Sep 23 00:28:55 devstack sudo[104034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:55 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a2918ecd-45d9-4421-b658-67902a181e5e tempest-ProjectReaderTests-116725566 None] Acquiring lock "cinder-11f18871-05e6-49e3-a49e-d25e7cde7b7e-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:55 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a2918ecd-45d9-4421-b658-67902a181e5e tempest-ProjectReaderTests-116725566 None] Lock "cinder-11f18871-05e6-49e3-a49e-d25e7cde7b7e-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:55 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a2918ecd-45d9-4421-b658-67902a181e5e tempest-ProjectReaderTests-116725566 None] Acquiring lock "cinder-quobyte-11f18871-05e6-49e3-a49e-d25e7cde7b7e" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:55 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a2918ecd-45d9-4421-b658-67902a181e5e tempest-ProjectReaderTests-116725566 None] Lock "cinder-quobyte-11f18871-05e6-49e3-a49e-d25e7cde7b7e" acquired by "delete_volume" :: waited 0.023s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:55 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0287f18-c569-445e-b2fb-2dc08a9be45d]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a2918ecd-45d9-4421-b658-67902a181e5e tempest-ProjectReaderTests-116725566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-11f18871-05e6-49e3-a49e-d25e7cde7b7e {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:55 devstack sudo[104034]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9423e5fd-fbc4-4256-b8ab-02a0d044bf86 tempest-TestStampPattern-410397350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-18830956-febd-4f80-95cb-29c7f36f4da6.f00cdcbe-6149-45c7-b696-4b521da55dd7" returned: 0 in 0.528s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:55 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-9423e5fd-fbc4-4256-b8ab-02a0d044bf86 tempest-TestStampPattern-410397350 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18830956-febd-4f80-95cb-29c7f36f4da6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:28:55 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[538ca04b-a271-407c-b15f-74699c1c819a]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9423e5fd-fbc4-4256-b8ab-02a0d044bf86 tempest-TestStampPattern-410397350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-18830956-febd-4f80-95cb-29c7f36f4da6 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:55 devstack sudo[104039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-11f18871-05e6-49e3-a49e-d25e7cde7b7e Sep 23 00:28:55 devstack sudo[104039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:56 devstack sudo[104040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-18830956-febd-4f80-95cb-29c7f36f4da6 Sep 23 00:28:56 devstack sudo[104040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:56 devstack sudo[104039]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a2918ecd-45d9-4421-b658-67902a181e5e tempest-ProjectReaderTests-116725566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-11f18871-05e6-49e3-a49e-d25e7cde7b7e" returned: 0 in 0.499s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a2918ecd-45d9-4421-b658-67902a181e5e tempest-ProjectReaderTests-116725566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-11f18871-05e6-49e3-a49e-d25e7cde7b7e {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:56 devstack sudo[104046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-11f18871-05e6-49e3-a49e-d25e7cde7b7e Sep 23 00:28:56 devstack sudo[104046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:56 devstack sudo[104046]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a2918ecd-45d9-4421-b658-67902a181e5e tempest-ProjectReaderTests-116725566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-11f18871-05e6-49e3-a49e-d25e7cde7b7e" returned: 0 in 0.329s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:56 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a2918ecd-45d9-4421-b658-67902a181e5e tempest-ProjectReaderTests-116725566 None] Lock "cinder-quobyte-11f18871-05e6-49e3-a49e-d25e7cde7b7e" released by "delete_volume" :: held 0.887s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:56 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-a2918ecd-45d9-4421-b658-67902a181e5e tempest-ProjectReaderTests-116725566 None] Created reservations ['af8f39be-0d1e-4d30-89c0-be37c5d2f42a', 'bae7e261-180a-41e8-9476-dfed2641d275', '0a489478-0b4a-41cb-9fce-c9f138190a7c', '3f23dfba-8320-40a3-8cca-fe3b68bec56b'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:28:56 devstack sudo[104040]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9423e5fd-fbc4-4256-b8ab-02a0d044bf86 tempest-TestStampPattern-410397350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-18830956-febd-4f80-95cb-29c7f36f4da6" returned: 0 in 0.771s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9423e5fd-fbc4-4256-b8ab-02a0d044bf86 tempest-TestStampPattern-410397350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-18830956-febd-4f80-95cb-29c7f36f4da6.f00cdcbe-6149-45c7-b696-4b521da55dd7 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:56 devstack sudo[104052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-18830956-febd-4f80-95cb-29c7f36f4da6.f00cdcbe-6149-45c7-b696-4b521da55dd7 Sep 23 00:28:56 devstack sudo[104052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a2918ecd-45d9-4421-b658-67902a181e5e tempest-ProjectReaderTests-116725566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a2918ecd-45d9-4421-b658-67902a181e5e tempest-ProjectReaderTests-116725566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:56 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a2918ecd-45d9-4421-b658-67902a181e5e tempest-ProjectReaderTests-116725566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:56 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a2918ecd-45d9-4421-b658-67902a181e5e tempest-ProjectReaderTests-116725566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a2918ecd-45d9-4421-b658-67902a181e5e tempest-ProjectReaderTests-116725566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a2918ecd-45d9-4421-b658-67902a181e5e tempest-ProjectReaderTests-116725566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:56 devstack sudo[104054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:28:56 devstack sudo[104054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:57 devstack sudo[104054]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a2918ecd-45d9-4421-b658-67902a181e5e tempest-ProjectReaderTests-116725566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.276s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:57 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-a2918ecd-45d9-4421-b658-67902a181e5e tempest-ProjectReaderTests-116725566 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:28:57 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-a2918ecd-45d9-4421-b658-67902a181e5e tempest-ProjectReaderTests-116725566 None] Deleted volume successfully. Sep 23 00:28:57 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=133,cinder:UPDATE=183,cinder:INSERT=48,cinder:DELETE=21 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:28:57 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a2918ecd-45d9-4421-b658-67902a181e5e tempest-ProjectReaderTests-116725566 None] Lock "cinder-11f18871-05e6-49e3-a49e-d25e7cde7b7e-delete_volume" released by "delete_volume" :: held 1.495s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:57 devstack sudo[104052]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9423e5fd-fbc4-4256-b8ab-02a0d044bf86 tempest-TestStampPattern-410397350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-18830956-febd-4f80-95cb-29c7f36f4da6.f00cdcbe-6149-45c7-b696-4b521da55dd7" returned: 0 in 0.459s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9423e5fd-fbc4-4256-b8ab-02a0d044bf86 tempest-TestStampPattern-410397350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-18830956-febd-4f80-95cb-29c7f36f4da6.f00cdcbe-6149-45c7-b696-4b521da55dd7 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:57 devstack sudo[104061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-18830956-febd-4f80-95cb-29c7f36f4da6.f00cdcbe-6149-45c7-b696-4b521da55dd7 Sep 23 00:28:57 devstack sudo[104061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:57 devstack sudo[104061]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9423e5fd-fbc4-4256-b8ab-02a0d044bf86 tempest-TestStampPattern-410397350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-18830956-febd-4f80-95cb-29c7f36f4da6.f00cdcbe-6149-45c7-b696-4b521da55dd7" returned: 0 in 0.295s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:57 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:INSERT=37,cinder:UPDATE=185,cinder:SELECT=127,cinder:DELETE=12 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:28:57 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9423e5fd-fbc4-4256-b8ab-02a0d044bf86 tempest-TestStampPattern-410397350 None] Lock "cinder-quobyte-f00cdcbe-6149-45c7-b696-4b521da55dd7" released by "_delete_snapshot" :: held 2.227s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:57 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9423e5fd-fbc4-4256-b8ab-02a0d044bf86 tempest-TestStampPattern-410397350 None] Lock "cinder-quobyte-18830956-febd-4f80-95cb-29c7f36f4da6" released by "delete_snapshot" :: held 2.263s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:57 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-9423e5fd-fbc4-4256-b8ab-02a0d044bf86 tempest-TestStampPattern-410397350 None] Created reservations ['e81e8eec-c61e-4a46-8c78-4ec9ca88d789', '45874ed0-b557-4df7-a704-ac3f4dbf3d29', '87cea6eb-263d-4d48-befd-f7d0f9df2b3c', 'f812db5f-0293-4f18-8e7c-1fbd516ceb3c'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:28:57 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-9423e5fd-fbc4-4256-b8ab-02a0d044bf86 tempest-TestStampPattern-410397350 None] Delete snapshot completed successfully. Sep 23 00:28:57 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9423e5fd-fbc4-4256-b8ab-02a0d044bf86 tempest-TestStampPattern-410397350 None] Lock "cinder-f00cdcbe-6149-45c7-b696-4b521da55dd7-delete_snapshot" released by "delete_snapshot" :: held 2.451s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:00 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbb91080-a5d2-4c37-a748-709ff544213c tempest-VolumesExtendTest-2114009666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:29:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-dbb91080-a5d2-4c37-a748-709ff544213c tempest-VolumesExtendTest-2114009666 None] Flow 'volume_create_manager' (102896b1-dce0-4c99-b748-8c445df09513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-dbb91080-a5d2-4c37-a748-709ff544213c tempest-VolumesExtendTest-2114009666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (429c729f-d606-44d6-b146-e49ef1396dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-dbb91080-a5d2-4c37-a748-709ff544213c tempest-VolumesExtendTest-2114009666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (429c729f-d606-44d6-b146-e49ef1396dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-73275405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3823456-18c1-4f0f-bc64-68db5e5a9124,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f5f814f01324b0ca97b5223d8fc35bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:00Z,use_quota=True,user_id='1cd2290824aa4c3783575fb7ccdf418f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-dbb91080-a5d2-4c37-a748-709ff544213c tempest-VolumesExtendTest-2114009666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c75dde2f-c3d3-49c5-afa0-150330f4eb04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-dbb91080-a5d2-4c37-a748-709ff544213c tempest-VolumesExtendTest-2114009666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c75dde2f-c3d3-49c5-afa0-150330f4eb04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-dbb91080-a5d2-4c37-a748-709ff544213c tempest-VolumesExtendTest-2114009666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a12dd187-24ab-4ef9-b325-def13e60b92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:00 devstack cinder-volume[86591]: DEBUG cinder.image.glance [None req-dbb91080-a5d2-4c37-a748-709ff544213c tempest-VolumesExtendTest-2114009666 None] Creating Keystone auth plugin from conf {{(pid=86591) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 00:29:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-dbb91080-a5d2-4c37-a748-709ff544213c tempest-VolumesExtendTest-2114009666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a12dd187-24ab-4ef9-b325-def13e60b92f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b3823456-18c1-4f0f-bc64-68db5e5a9124', 'volume_name': 'volume-b3823456-18c1-4f0f-bc64-68db5e5a9124', 'volume_size': 1, 'image_id': 'acf635b7-10f9-4fce-8332-3b60fddafd4d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/acf635b7-10f9-4fce-8332-3b60fddafd4d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '91fff89797994a81952b7814d0d951c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'acf635b7-10f9-4fce-8332-3b60fddafd4d', 'created_at': datetime.datetime(2026, 9, 22, 22, 4, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 4, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/acf635b7-10f9-4fce-8332-3b60fddafd4d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-dbb91080-a5d2-4c37-a748-709ff544213c tempest-VolumesExtendTest-2114009666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffbd3dce-dd4b-4011-af5d-2385e5a8c713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-dbb91080-a5d2-4c37-a748-709ff544213c tempest-VolumesExtendTest-2114009666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffbd3dce-dd4b-4011-af5d-2385e5a8c713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-dbb91080-a5d2-4c37-a748-709ff544213c tempest-VolumesExtendTest-2114009666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa028a05-aefc-4ed6-9dab-a72a5cde7853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:01 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-dbb91080-a5d2-4c37-a748-709ff544213c tempest-VolumesExtendTest-2114009666 None] Volume b3823456-18c1-4f0f-bc64-68db5e5a9124: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b3823456-18c1-4f0f-bc64-68db5e5a9124', 'volume_size': 1, 'image_id': 'acf635b7-10f9-4fce-8332-3b60fddafd4d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/acf635b7-10f9-4fce-8332-3b60fddafd4d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '91fff89797994a81952b7814d0d951c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'acf635b7-10f9-4fce-8332-3b60fddafd4d', 'created_at': datetime.datetime(2026, 9, 22, 22, 4, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 4, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/acf635b7-10f9-4fce-8332-3b60fddafd4d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 23 00:29:01 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbb91080-a5d2-4c37-a748-709ff544213c tempest-VolumesExtendTest-2114009666 None] Trying to clone b3823456-18c1-4f0f-bc64-68db5e5a9124 from image acf635b7-10f9-4fce-8332-3b60fddafd4d at location (None, [{'url': 'file:///opt/stack/data/glance/images/acf635b7-10f9-4fce-8332-3b60fddafd4d', 'metadata': {}}]). {{(pid=86591) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 00:29:01 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-dbb91080-a5d2-4c37-a748-709ff544213c tempest-VolumesExtendTest-2114009666 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_j_o2dh6mdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86591) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 00:29:01 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-dbb91080-a5d2-4c37-a748-709ff544213c tempest-VolumesExtendTest-2114009666 None] Image download 20.69 MB at 20.69 MB/s Sep 23 00:29:01 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[8988f0a7-a912-4589-8a49-ece3c526992e]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dbb91080-a5d2-4c37-a748-709ff544213c tempest-VolumesExtendTest-2114009666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_j_o2dh6mdevstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:01 devstack sudo[104093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_j_o2dh6mdevstack@QuobyteHD Sep 23 00:29:01 devstack sudo[104093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:01 devstack sudo[104093]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dbb91080-a5d2-4c37-a748-709ff544213c tempest-VolumesExtendTest-2114009666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_j_o2dh6mdevstack@QuobyteHD" returned: 0 in 0.459s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:01 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-dbb91080-a5d2-4c37-a748-709ff544213c tempest-VolumesExtendTest-2114009666 None] Temporary image acf635b7-10f9-4fce-8332-3b60fddafd4d is fetched for user 1cd2290824aa4c3783575fb7ccdf418f. {{(pid=86591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 00:29:02 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da66612-62f5-4cc0-8be9-7c8eba2b58d7]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dbb91080-a5d2-4c37-a748-709ff544213c tempest-VolumesExtendTest-2114009666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_j_o2dh6mdevstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:02 devstack sudo[104099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_j_o2dh6mdevstack@QuobyteHD Sep 23 00:29:02 devstack sudo[104099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:02 devstack sudo[104099]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dbb91080-a5d2-4c37-a748-709ff544213c tempest-VolumesExtendTest-2114009666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_j_o2dh6mdevstack@QuobyteHD" returned: 0 in 0.432s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-dbb91080-a5d2-4c37-a748-709ff544213c tempest-VolumesExtendTest-2114009666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-dbb91080-a5d2-4c37-a748-709ff544213c tempest-VolumesExtendTest-2114009666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:02 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-dbb91080-a5d2-4c37-a748-709ff544213c tempest-VolumesExtendTest-2114009666 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-73275405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3823456-18c1-4f0f-bc64-68db5e5a9124,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f5f814f01324b0ca97b5223d8fc35bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:00Z,use_quota=True,user_id='1cd2290824aa4c3783575fb7ccdf418f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:29:02 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-dbb91080-a5d2-4c37-a748-709ff544213c tempest-VolumesExtendTest-2114009666 None] Creating volume b3823456-18c1-4f0f-bc64-68db5e5a9124 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:29:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-dbb91080-a5d2-4c37-a748-709ff544213c tempest-VolumesExtendTest-2114009666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-dbb91080-a5d2-4c37-a748-709ff544213c tempest-VolumesExtendTest-2114009666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:02 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-dbb91080-a5d2-4c37-a748-709ff544213c tempest-VolumesExtendTest-2114009666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:02 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-dbb91080-a5d2-4c37-a748-709ff544213c tempest-VolumesExtendTest-2114009666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-dbb91080-a5d2-4c37-a748-709ff544213c tempest-VolumesExtendTest-2114009666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:02 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-dbb91080-a5d2-4c37-a748-709ff544213c tempest-VolumesExtendTest-2114009666 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:29:02 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-dbb91080-a5d2-4c37-a748-709ff544213c tempest-VolumesExtendTest-2114009666 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:29:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dbb91080-a5d2-4c37-a748-709ff544213c tempest-VolumesExtendTest-2114009666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b3823456-18c1-4f0f-bc64-68db5e5a9124 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:02 devstack sudo[104104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b3823456-18c1-4f0f-bc64-68db5e5a9124 1073741824 Sep 23 00:29:02 devstack sudo[104104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:02 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f5374049-86ac-4534-b87d-835780321cd8 tempest-TestStampPattern-410397350 None] Acquiring lock "cinder-18830956-febd-4f80-95cb-29c7f36f4da6-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:02 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f5374049-86ac-4534-b87d-835780321cd8 tempest-TestStampPattern-410397350 None] Lock "cinder-18830956-febd-4f80-95cb-29c7f36f4da6-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:02 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f5374049-86ac-4534-b87d-835780321cd8 tempest-TestStampPattern-410397350 None] Acquiring lock "cinder-quobyte-18830956-febd-4f80-95cb-29c7f36f4da6" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:02 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f5374049-86ac-4534-b87d-835780321cd8 tempest-TestStampPattern-410397350 None] Lock "cinder-quobyte-18830956-febd-4f80-95cb-29c7f36f4da6" acquired by "delete_volume" :: waited 0.024s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:02 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[488860f5-ad3f-4b2e-ad84-9aa546142235]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f5374049-86ac-4534-b87d-835780321cd8 tempest-TestStampPattern-410397350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-18830956-febd-4f80-95cb-29c7f36f4da6 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:03 devstack sudo[104110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-18830956-febd-4f80-95cb-29c7f36f4da6 Sep 23 00:29:03 devstack sudo[104110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:03 devstack sudo[104104]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dbb91080-a5d2-4c37-a748-709ff544213c tempest-VolumesExtendTest-2114009666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b3823456-18c1-4f0f-bc64-68db5e5a9124 1073741824" returned: 0 in 0.556s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dbb91080-a5d2-4c37-a748-709ff544213c tempest-VolumesExtendTest-2114009666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b3823456-18c1-4f0f-bc64-68db5e5a9124 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:03 devstack sudo[104112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b3823456-18c1-4f0f-bc64-68db5e5a9124 Sep 23 00:29:03 devstack sudo[104112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:03 devstack sudo[104110]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f5374049-86ac-4534-b87d-835780321cd8 tempest-TestStampPattern-410397350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-18830956-febd-4f80-95cb-29c7f36f4da6" returned: 0 in 0.460s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f5374049-86ac-4534-b87d-835780321cd8 tempest-TestStampPattern-410397350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-18830956-febd-4f80-95cb-29c7f36f4da6 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:03 devstack sudo[104117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-18830956-febd-4f80-95cb-29c7f36f4da6 Sep 23 00:29:03 devstack sudo[104117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:03 devstack sudo[104112]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dbb91080-a5d2-4c37-a748-709ff544213c tempest-VolumesExtendTest-2114009666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b3823456-18c1-4f0f-bc64-68db5e5a9124" returned: 0 in 0.361s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:03 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-dbb91080-a5d2-4c37-a748-709ff544213c tempest-VolumesExtendTest-2114009666 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:29:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-dbb91080-a5d2-4c37-a748-709ff544213c tempest-VolumesExtendTest-2114009666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:03 devstack cinder-volume[86591]: DEBUG cinder.volume.volume_utils [None req-dbb91080-a5d2-4c37-a748-709ff544213c tempest-VolumesExtendTest-2114009666 None] Attempting download of acf635b7-10f9-4fce-8332-3b60fddafd4d ((None, [{'url': 'file:///opt/stack/data/glance/images/acf635b7-10f9-4fce-8332-3b60fddafd4d', 'metadata': {}}])) to volume b3823456-18c1-4f0f-bc64-68db5e5a9124. {{(pid=86591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 00:29:03 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[22fc0f95-0fb0-4ca9-8548-5b4b15757eec]: (4, 'raw') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dbb91080-a5d2-4c37-a748-709ff544213c tempest-VolumesExtendTest-2114009666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_acf635b7-10f9-4fce-8332-3b60fddafd4d_aglqp7g5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:03 devstack sudo[104117]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f5374049-86ac-4534-b87d-835780321cd8 tempest-TestStampPattern-410397350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-18830956-febd-4f80-95cb-29c7f36f4da6" returned: 0 in 0.305s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:03 devstack sudo[104120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_acf635b7-10f9-4fce-8332-3b60fddafd4d_aglqp7g5 Sep 23 00:29:03 devstack sudo[104120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:03 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f5374049-86ac-4534-b87d-835780321cd8 tempest-TestStampPattern-410397350 None] Lock "cinder-quobyte-18830956-febd-4f80-95cb-29c7f36f4da6" released by "delete_volume" :: held 0.848s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:03 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-f5374049-86ac-4534-b87d-835780321cd8 tempest-TestStampPattern-410397350 None] Created reservations ['0351673e-bcc3-46d3-be22-2881e2edf6f6', '98032060-1144-4751-8027-270dcd48f871', 'f357148b-0b89-4062-887f-dc2e65dc98e7', '1a674f31-730f-40e5-a7ba-b2da14c03ee0'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:29:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5374049-86ac-4534-b87d-835780321cd8 tempest-TestStampPattern-410397350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5374049-86ac-4534-b87d-835780321cd8 tempest-TestStampPattern-410397350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:03 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f5374049-86ac-4534-b87d-835780321cd8 tempest-TestStampPattern-410397350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:03 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f5374049-86ac-4534-b87d-835780321cd8 tempest-TestStampPattern-410397350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5374049-86ac-4534-b87d-835780321cd8 tempest-TestStampPattern-410397350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f5374049-86ac-4534-b87d-835780321cd8 tempest-TestStampPattern-410397350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:03 devstack sudo[104123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:29:03 devstack sudo[104123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:03 devstack sudo[104120]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dbb91080-a5d2-4c37-a748-709ff544213c tempest-VolumesExtendTest-2114009666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_acf635b7-10f9-4fce-8332-3b60fddafd4d_aglqp7g5" returned: 0 in 0.364s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dbb91080-a5d2-4c37-a748-709ff544213c tempest-VolumesExtendTest-2114009666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_acf635b7-10f9-4fce-8332-3b60fddafd4d_aglqp7g5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:04 devstack sudo[104127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_acf635b7-10f9-4fce-8332-3b60fddafd4d_aglqp7g5 Sep 23 00:29:04 devstack sudo[104127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:04 devstack sudo[104123]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f5374049-86ac-4534-b87d-835780321cd8 tempest-TestStampPattern-410397350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.306s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:04 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-f5374049-86ac-4534-b87d-835780321cd8 tempest-TestStampPattern-410397350 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:29:04 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-f5374049-86ac-4534-b87d-835780321cd8 tempest-TestStampPattern-410397350 None] Deleted volume successfully. Sep 23 00:29:04 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f5374049-86ac-4534-b87d-835780321cd8 tempest-TestStampPattern-410397350 None] Lock "cinder-18830956-febd-4f80-95cb-29c7f36f4da6-delete_volume" released by "delete_volume" :: held 1.421s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:04 devstack sudo[104127]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dbb91080-a5d2-4c37-a748-709ff544213c tempest-VolumesExtendTest-2114009666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_acf635b7-10f9-4fce-8332-3b60fddafd4d_aglqp7g5" returned: 1 in 0.393s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dbb91080-a5d2-4c37-a748-709ff544213c tempest-VolumesExtendTest-2114009666 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_acf635b7-10f9-4fce-8332-3b60fddafd4d_aglqp7g5' failed. Not Retrying. {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:29:04 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[3913f0e7-7632-4180-835f-f2b2d52cfe94]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dbb91080-a5d2-4c37-a748-709ff544213c tempest-VolumesExtendTest-2114009666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_j_o2dh6mdevstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:04 devstack sudo[104132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_j_o2dh6mdevstack@QuobyteHD Sep 23 00:29:04 devstack sudo[104132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:04 devstack sudo[104132]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dbb91080-a5d2-4c37-a748-709ff544213c tempest-VolumesExtendTest-2114009666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_j_o2dh6mdevstack@QuobyteHD" returned: 0 in 0.424s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:04 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-dbb91080-a5d2-4c37-a748-709ff544213c tempest-VolumesExtendTest-2114009666 None] acf635b7-10f9-4fce-8332-3b60fddafd4d was qcow2, converting to qcow2 {{(pid=86591) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 00:29:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dbb91080-a5d2-4c37-a748-709ff544213c tempest-VolumesExtendTest-2114009666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_j_o2dh6mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b3823456-18c1-4f0f-bc64-68db5e5a9124 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:04 devstack sudo[104138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_j_o2dh6mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b3823456-18c1-4f0f-bc64-68db5e5a9124 Sep 23 00:29:04 devstack sudo[104138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:07 devstack sudo[104138]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dbb91080-a5d2-4c37-a748-709ff544213c tempest-VolumesExtendTest-2114009666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_j_o2dh6mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b3823456-18c1-4f0f-bc64-68db5e5a9124" returned: 0 in 2.389s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:07 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-dbb91080-a5d2-4c37-a748-709ff544213c tempest-VolumesExtendTest-2114009666 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_acf635b7-10f9-4fce-8332-3b60fddafd4d_j_o2dh6mdevstack@QuobyteHD, size 112.00 MB, duration 2.39 sec, destination /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b3823456-18c1-4f0f-bc64-68db5e5a9124 {{(pid=86591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:29:07 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-dbb91080-a5d2-4c37-a748-709ff544213c tempest-VolumesExtendTest-2114009666 None] Converted 112.00 MB image at 46.85 MB/s Sep 23 00:29:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dbb91080-a5d2-4c37-a748-709ff544213c tempest-VolumesExtendTest-2114009666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b3823456-18c1-4f0f-bc64-68db5e5a9124 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:07 devstack sudo[104148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b3823456-18c1-4f0f-bc64-68db5e5a9124 1G Sep 23 00:29:07 devstack sudo[104148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:07 devstack sudo[104148]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dbb91080-a5d2-4c37-a748-709ff544213c tempest-VolumesExtendTest-2114009666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b3823456-18c1-4f0f-bc64-68db5e5a9124 1G" returned: 0 in 0.383s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:07 devstack cinder-volume[86591]: DEBUG cinder.volume.volume_utils [None req-dbb91080-a5d2-4c37-a748-709ff544213c tempest-VolumesExtendTest-2114009666 None] Downloaded image acf635b7-10f9-4fce-8332-3b60fddafd4d ((None, [{'url': 'file:///opt/stack/data/glance/images/acf635b7-10f9-4fce-8332-3b60fddafd4d', 'metadata': {}}])) to volume b3823456-18c1-4f0f-bc64-68db5e5a9124 successfully. {{(pid=86591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 00:29:07 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-dbb91080-a5d2-4c37-a748-709ff544213c tempest-VolumesExtendTest-2114009666 None] Temporary image acf635b7-10f9-4fce-8332-3b60fddafd4d for user 1cd2290824aa4c3783575fb7ccdf418f is deleted. {{(pid=86591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 00:29:07 devstack cinder-volume[86591]: DEBUG cinder.volume.volume_utils [None req-dbb91080-a5d2-4c37-a748-709ff544213c tempest-VolumesExtendTest-2114009666 None] Marking volume b3823456-18c1-4f0f-bc64-68db5e5a9124 as bootable. {{(pid=86591) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 00:29:07 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbb91080-a5d2-4c37-a748-709ff544213c tempest-VolumesExtendTest-2114009666 None] Copying metadata from image acf635b7-10f9-4fce-8332-3b60fddafd4d to b3823456-18c1-4f0f-bc64-68db5e5a9124. {{(pid=86591) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 00:29:07 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbb91080-a5d2-4c37-a748-709ff544213c tempest-VolumesExtendTest-2114009666 None] Creating volume glance metadata for volume b3823456-18c1-4f0f-bc64-68db5e5a9124 backed by image acf635b7-10f9-4fce-8332-3b60fddafd4d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'acf635b7-10f9-4fce-8332-3b60fddafd4d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86591) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 00:29:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-dbb91080-a5d2-4c37-a748-709ff544213c tempest-VolumesExtendTest-2114009666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa028a05-aefc-4ed6-9dab-a72a5cde7853) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3823456-18c1-4f0f-bc64-68db5e5a9124', 'volume_size': 1, 'image_id': 'acf635b7-10f9-4fce-8332-3b60fddafd4d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/acf635b7-10f9-4fce-8332-3b60fddafd4d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '91fff89797994a81952b7814d0d951c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'acf635b7-10f9-4fce-8332-3b60fddafd4d', 'created_at': datetime.datetime(2026, 9, 22, 22, 4, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 4, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/acf635b7-10f9-4fce-8332-3b60fddafd4d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-dbb91080-a5d2-4c37-a748-709ff544213c tempest-VolumesExtendTest-2114009666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30e0c617-02a1-4085-91c9-ce01dc4d95cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:07 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-dbb91080-a5d2-4c37-a748-709ff544213c tempest-VolumesExtendTest-2114009666 None] Volume volume-b3823456-18c1-4f0f-bc64-68db5e5a9124 (b3823456-18c1-4f0f-bc64-68db5e5a9124): created successfully Sep 23 00:29:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-dbb91080-a5d2-4c37-a748-709ff544213c tempest-VolumesExtendTest-2114009666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30e0c617-02a1-4085-91c9-ce01dc4d95cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-dbb91080-a5d2-4c37-a748-709ff544213c tempest-VolumesExtendTest-2114009666 None] Flow 'volume_create_manager' (102896b1-dce0-4c99-b748-8c445df09513) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:07 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-dbb91080-a5d2-4c37-a748-709ff544213c tempest-VolumesExtendTest-2114009666 None] Created volume successfully. Sep 23 00:29:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b12f082e-3c95-4aca-87f1-9e9fa650d7df tempest-VolumesExtendTest-2114009666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b12f082e-3c95-4aca-87f1-9e9fa650d7df tempest-VolumesExtendTest-2114009666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:08 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f7b75f-bb92-4c09-9344-791f95acaac3]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b12f082e-3c95-4aca-87f1-9e9fa650d7df tempest-VolumesExtendTest-2114009666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b3823456-18c1-4f0f-bc64-68db5e5a9124 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:09 devstack sudo[104154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b3823456-18c1-4f0f-bc64-68db5e5a9124 Sep 23 00:29:09 devstack sudo[104154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:09 devstack sudo[104154]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b12f082e-3c95-4aca-87f1-9e9fa650d7df tempest-VolumesExtendTest-2114009666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b3823456-18c1-4f0f-bc64-68db5e5a9124" returned: 0 in 0.474s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b12f082e-3c95-4aca-87f1-9e9fa650d7df tempest-VolumesExtendTest-2114009666 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b3823456-18c1-4f0f-bc64-68db5e5a9124 2G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b12f082e-3c95-4aca-87f1-9e9fa650d7df tempest-VolumesExtendTest-2114009666 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b3823456-18c1-4f0f-bc64-68db5e5a9124 2G" returned: 0 in 0.124s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b12f082e-3c95-4aca-87f1-9e9fa650d7df tempest-VolumesExtendTest-2114009666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.627s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:09 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-b12f082e-3c95-4aca-87f1-9e9fa650d7df tempest-VolumesExtendTest-2114009666 None] Extend volume completed successfully. Sep 23 00:29:10 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6f0eabe2-4491-4670-ae4e-8e8c9e284cc6 tempest-VolumesExtendTest-2114009666 None] Acquiring lock "cinder-b3823456-18c1-4f0f-bc64-68db5e5a9124-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:10 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6f0eabe2-4491-4670-ae4e-8e8c9e284cc6 tempest-VolumesExtendTest-2114009666 None] Lock "cinder-b3823456-18c1-4f0f-bc64-68db5e5a9124-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:10 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6f0eabe2-4491-4670-ae4e-8e8c9e284cc6 tempest-VolumesExtendTest-2114009666 None] Acquiring lock "cinder-quobyte-b3823456-18c1-4f0f-bc64-68db5e5a9124" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:10 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6f0eabe2-4491-4670-ae4e-8e8c9e284cc6 tempest-VolumesExtendTest-2114009666 None] Lock "cinder-quobyte-b3823456-18c1-4f0f-bc64-68db5e5a9124" acquired by "delete_volume" :: waited 0.019s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:10 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c42377-f3ca-4cda-9ed4-42d879727d49]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6f0eabe2-4491-4670-ae4e-8e8c9e284cc6 tempest-VolumesExtendTest-2114009666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b3823456-18c1-4f0f-bc64-68db5e5a9124 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:10 devstack sudo[104164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b3823456-18c1-4f0f-bc64-68db5e5a9124 Sep 23 00:29:10 devstack sudo[104164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:11 devstack sudo[104164]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6f0eabe2-4491-4670-ae4e-8e8c9e284cc6 tempest-VolumesExtendTest-2114009666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b3823456-18c1-4f0f-bc64-68db5e5a9124" returned: 0 in 0.404s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6f0eabe2-4491-4670-ae4e-8e8c9e284cc6 tempest-VolumesExtendTest-2114009666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b3823456-18c1-4f0f-bc64-68db5e5a9124 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:11 devstack sudo[104175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b3823456-18c1-4f0f-bc64-68db5e5a9124 Sep 23 00:29:11 devstack sudo[104175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:11 devstack sudo[104175]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6f0eabe2-4491-4670-ae4e-8e8c9e284cc6 tempest-VolumesExtendTest-2114009666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b3823456-18c1-4f0f-bc64-68db5e5a9124" returned: 0 in 0.311s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:11 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6f0eabe2-4491-4670-ae4e-8e8c9e284cc6 tempest-VolumesExtendTest-2114009666 None] Lock "cinder-quobyte-b3823456-18c1-4f0f-bc64-68db5e5a9124" released by "delete_volume" :: held 0.756s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:11 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-6f0eabe2-4491-4670-ae4e-8e8c9e284cc6 tempest-VolumesExtendTest-2114009666 None] Created reservations ['73a511d4-d47a-4814-a490-25277e262293', '0883d8f0-823a-46bb-87e7-86bcece80746', '90292f75-cc05-4a60-8d4d-b748c38bc2b9', '9315b4e4-19b1-45d9-ae48-aa24df1bee2a'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:29:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6f0eabe2-4491-4670-ae4e-8e8c9e284cc6 tempest-VolumesExtendTest-2114009666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6f0eabe2-4491-4670-ae4e-8e8c9e284cc6 tempest-VolumesExtendTest-2114009666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:11 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6f0eabe2-4491-4670-ae4e-8e8c9e284cc6 tempest-VolumesExtendTest-2114009666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:11 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6f0eabe2-4491-4670-ae4e-8e8c9e284cc6 tempest-VolumesExtendTest-2114009666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6f0eabe2-4491-4670-ae4e-8e8c9e284cc6 tempest-VolumesExtendTest-2114009666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6f0eabe2-4491-4670-ae4e-8e8c9e284cc6 tempest-VolumesExtendTest-2114009666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:11 devstack sudo[104178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:29:11 devstack sudo[104178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:11 devstack sudo[104178]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6f0eabe2-4491-4670-ae4e-8e8c9e284cc6 tempest-VolumesExtendTest-2114009666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.307s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:11 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-6f0eabe2-4491-4670-ae4e-8e8c9e284cc6 tempest-VolumesExtendTest-2114009666 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:29:11 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-6f0eabe2-4491-4670-ae4e-8e8c9e284cc6 tempest-VolumesExtendTest-2114009666 None] Deleted volume successfully. Sep 23 00:29:11 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6f0eabe2-4491-4670-ae4e-8e8c9e284cc6 tempest-VolumesExtendTest-2114009666 None] Lock "cinder-b3823456-18c1-4f0f-bc64-68db5e5a9124-delete_volume" released by "delete_volume" :: held 1.383s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:12 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-51f21860-a46f-4419-923e-69753fab48cf tempest-VolumesExtendTest-2114009666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:29:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-51f21860-a46f-4419-923e-69753fab48cf tempest-VolumesExtendTest-2114009666 None] Flow 'volume_create_manager' (e1d2b308-a10d-445a-9462-c69e30fe2280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-51f21860-a46f-4419-923e-69753fab48cf tempest-VolumesExtendTest-2114009666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9e47b1f-dee8-4569-8303-600004f38340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-51f21860-a46f-4419-923e-69753fab48cf tempest-VolumesExtendTest-2114009666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9e47b1f-dee8-4569-8303-600004f38340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:29:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1088556218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=924ce021-7022-45de-a288-08fe8bb3fb10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f5f814f01324b0ca97b5223d8fc35bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:12Z,use_quota=True,user_id='1cd2290824aa4c3783575fb7ccdf418f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-51f21860-a46f-4419-923e-69753fab48cf tempest-VolumesExtendTest-2114009666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5266e717-20e6-4424-8f35-522af94922dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-51f21860-a46f-4419-923e-69753fab48cf tempest-VolumesExtendTest-2114009666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5266e717-20e6-4424-8f35-522af94922dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-51f21860-a46f-4419-923e-69753fab48cf tempest-VolumesExtendTest-2114009666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72cb15bd-b5b0-44da-804a-2e66122e8139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-51f21860-a46f-4419-923e-69753fab48cf tempest-VolumesExtendTest-2114009666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72cb15bd-b5b0-44da-804a-2e66122e8139) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '924ce021-7022-45de-a288-08fe8bb3fb10', 'volume_name': 'volume-924ce021-7022-45de-a288-08fe8bb3fb10', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-51f21860-a46f-4419-923e-69753fab48cf tempest-VolumesExtendTest-2114009666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5355bacd-f0be-486f-804c-2c99f434a707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-51f21860-a46f-4419-923e-69753fab48cf tempest-VolumesExtendTest-2114009666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5355bacd-f0be-486f-804c-2c99f434a707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-51f21860-a46f-4419-923e-69753fab48cf tempest-VolumesExtendTest-2114009666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cca9fb2e-52db-44f6-86bb-68bdee747015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:12 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-51f21860-a46f-4419-923e-69753fab48cf tempest-VolumesExtendTest-2114009666 None] Volume 924ce021-7022-45de-a288-08fe8bb3fb10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-924ce021-7022-45de-a288-08fe8bb3fb10', 'volume_size': 1} Sep 23 00:29:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-51f21860-a46f-4419-923e-69753fab48cf tempest-VolumesExtendTest-2114009666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-51f21860-a46f-4419-923e-69753fab48cf tempest-VolumesExtendTest-2114009666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:12 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-51f21860-a46f-4419-923e-69753fab48cf tempest-VolumesExtendTest-2114009666 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:29:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1088556218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=924ce021-7022-45de-a288-08fe8bb3fb10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f5f814f01324b0ca97b5223d8fc35bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:12Z,use_quota=True,user_id='1cd2290824aa4c3783575fb7ccdf418f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:29:12 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-51f21860-a46f-4419-923e-69753fab48cf tempest-VolumesExtendTest-2114009666 None] Creating volume 924ce021-7022-45de-a288-08fe8bb3fb10 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:29:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-51f21860-a46f-4419-923e-69753fab48cf tempest-VolumesExtendTest-2114009666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-51f21860-a46f-4419-923e-69753fab48cf tempest-VolumesExtendTest-2114009666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:12 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-51f21860-a46f-4419-923e-69753fab48cf tempest-VolumesExtendTest-2114009666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:12 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-51f21860-a46f-4419-923e-69753fab48cf tempest-VolumesExtendTest-2114009666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-51f21860-a46f-4419-923e-69753fab48cf tempest-VolumesExtendTest-2114009666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:12 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-51f21860-a46f-4419-923e-69753fab48cf tempest-VolumesExtendTest-2114009666 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:29:12 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-51f21860-a46f-4419-923e-69753fab48cf tempest-VolumesExtendTest-2114009666 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:29:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-51f21860-a46f-4419-923e-69753fab48cf tempest-VolumesExtendTest-2114009666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-924ce021-7022-45de-a288-08fe8bb3fb10 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:12 devstack sudo[104182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-924ce021-7022-45de-a288-08fe8bb3fb10 1073741824 Sep 23 00:29:12 devstack sudo[104182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:12 devstack sudo[104182]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-51f21860-a46f-4419-923e-69753fab48cf tempest-VolumesExtendTest-2114009666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-924ce021-7022-45de-a288-08fe8bb3fb10 1073741824" returned: 0 in 0.495s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-51f21860-a46f-4419-923e-69753fab48cf tempest-VolumesExtendTest-2114009666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-924ce021-7022-45de-a288-08fe8bb3fb10 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:12 devstack sudo[104188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-924ce021-7022-45de-a288-08fe8bb3fb10 Sep 23 00:29:12 devstack sudo[104188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:13 devstack sudo[104188]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-51f21860-a46f-4419-923e-69753fab48cf tempest-VolumesExtendTest-2114009666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-924ce021-7022-45de-a288-08fe8bb3fb10" returned: 0 in 0.295s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:13 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-51f21860-a46f-4419-923e-69753fab48cf tempest-VolumesExtendTest-2114009666 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:29:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-51f21860-a46f-4419-923e-69753fab48cf tempest-VolumesExtendTest-2114009666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:13 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-51f21860-a46f-4419-923e-69753fab48cf tempest-VolumesExtendTest-2114009666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cca9fb2e-52db-44f6-86bb-68bdee747015) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-924ce021-7022-45de-a288-08fe8bb3fb10', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:13 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-51f21860-a46f-4419-923e-69753fab48cf tempest-VolumesExtendTest-2114009666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62ff09fd-3065-4310-a637-a03a4e138891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:13 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-51f21860-a46f-4419-923e-69753fab48cf tempest-VolumesExtendTest-2114009666 None] Volume volume-924ce021-7022-45de-a288-08fe8bb3fb10 (924ce021-7022-45de-a288-08fe8bb3fb10): created successfully Sep 23 00:29:13 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-51f21860-a46f-4419-923e-69753fab48cf tempest-VolumesExtendTest-2114009666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62ff09fd-3065-4310-a637-a03a4e138891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:13 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-51f21860-a46f-4419-923e-69753fab48cf tempest-VolumesExtendTest-2114009666 None] Flow 'volume_create_manager' (e1d2b308-a10d-445a-9462-c69e30fe2280) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:13 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-51f21860-a46f-4419-923e-69753fab48cf tempest-VolumesExtendTest-2114009666 None] Created volume successfully. Sep 23 00:29:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-982a8784-d434-46ff-8f6a-47c4e3c794cf tempest-VolumesExtendTest-2114009666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-982a8784-d434-46ff-8f6a-47c4e3c794cf tempest-VolumesExtendTest-2114009666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:14 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-982a8784-d434-46ff-8f6a-47c4e3c794cf tempest-VolumesExtendTest-2114009666 None] Creating offline snapshot 6abbc23d-9cb8-4abd-9e3a-ff82d39ad245 of volume 924ce021-7022-45de-a288-08fe8bb3fb10 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:29:14 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[320d5a2e-edcf-43f9-a821-71abbb09fbaf]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-982a8784-d434-46ff-8f6a-47c4e3c794cf tempest-VolumesExtendTest-2114009666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-924ce021-7022-45de-a288-08fe8bb3fb10 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:14 devstack sudo[104193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-924ce021-7022-45de-a288-08fe8bb3fb10 Sep 23 00:29:14 devstack sudo[104193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:15 devstack sudo[104193]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-982a8784-d434-46ff-8f6a-47c4e3c794cf tempest-VolumesExtendTest-2114009666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-924ce021-7022-45de-a288-08fe8bb3fb10" returned: 0 in 0.490s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-982a8784-d434-46ff-8f6a-47c4e3c794cf tempest-VolumesExtendTest-2114009666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-924ce021-7022-45de-a288-08fe8bb3fb10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-924ce021-7022-45de-a288-08fe8bb3fb10.6abbc23d-9cb8-4abd-9e3a-ff82d39ad245 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:15 devstack sudo[104198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-924ce021-7022-45de-a288-08fe8bb3fb10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-924ce021-7022-45de-a288-08fe8bb3fb10.6abbc23d-9cb8-4abd-9e3a-ff82d39ad245 1G Sep 23 00:29:15 devstack sudo[104198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:15 devstack sudo[104198]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-982a8784-d434-46ff-8f6a-47c4e3c794cf tempest-VolumesExtendTest-2114009666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-924ce021-7022-45de-a288-08fe8bb3fb10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-924ce021-7022-45de-a288-08fe8bb3fb10.6abbc23d-9cb8-4abd-9e3a-ff82d39ad245 1G" returned: 0 in 0.548s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-982a8784-d434-46ff-8f6a-47c4e3c794cf tempest-VolumesExtendTest-2114009666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-924ce021-7022-45de-a288-08fe8bb3fb10 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-924ce021-7022-45de-a288-08fe8bb3fb10.6abbc23d-9cb8-4abd-9e3a-ff82d39ad245 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:15 devstack sudo[104205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-924ce021-7022-45de-a288-08fe8bb3fb10 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-924ce021-7022-45de-a288-08fe8bb3fb10.6abbc23d-9cb8-4abd-9e3a-ff82d39ad245 Sep 23 00:29:15 devstack sudo[104205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:16 devstack sudo[104205]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-982a8784-d434-46ff-8f6a-47c4e3c794cf tempest-VolumesExtendTest-2114009666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-924ce021-7022-45de-a288-08fe8bb3fb10 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-924ce021-7022-45de-a288-08fe8bb3fb10.6abbc23d-9cb8-4abd-9e3a-ff82d39ad245" returned: 0 in 0.390s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:16 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-982a8784-d434-46ff-8f6a-47c4e3c794cf tempest-VolumesExtendTest-2114009666 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-924ce021-7022-45de-a288-08fe8bb3fb10.6abbc23d-9cb8-4abd-9e3a-ff82d39ad245 is being set with open permissions: ugo+rw Sep 23 00:29:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-982a8784-d434-46ff-8f6a-47c4e3c794cf tempest-VolumesExtendTest-2114009666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-924ce021-7022-45de-a288-08fe8bb3fb10.6abbc23d-9cb8-4abd-9e3a-ff82d39ad245 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:16 devstack sudo[104245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-924ce021-7022-45de-a288-08fe8bb3fb10.6abbc23d-9cb8-4abd-9e3a-ff82d39ad245 Sep 23 00:29:16 devstack sudo[104245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:16 devstack sudo[104245]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-982a8784-d434-46ff-8f6a-47c4e3c794cf tempest-VolumesExtendTest-2114009666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-924ce021-7022-45de-a288-08fe8bb3fb10.6abbc23d-9cb8-4abd-9e3a-ff82d39ad245" returned: 0 in 0.287s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-982a8784-d434-46ff-8f6a-47c4e3c794cf tempest-VolumesExtendTest-2114009666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-924ce021-7022-45de-a288-08fe8bb3fb10.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:16 devstack sudo[104250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-924ce021-7022-45de-a288-08fe8bb3fb10.info Sep 23 00:29:16 devstack sudo[104250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:16 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:29:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:16 devstack sudo[104252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:29:16 devstack sudo[104252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:16 devstack sudo[104250]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-982a8784-d434-46ff-8f6a-47c4e3c794cf tempest-VolumesExtendTest-2114009666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-924ce021-7022-45de-a288-08fe8bb3fb10.info" returned: 0 in 0.297s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:16 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-982a8784-d434-46ff-8f6a-47c4e3c794cf tempest-VolumesExtendTest-2114009666 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-924ce021-7022-45de-a288-08fe8bb3fb10.info is being set with open permissions: ugo+rw Sep 23 00:29:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-982a8784-d434-46ff-8f6a-47c4e3c794cf tempest-VolumesExtendTest-2114009666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-924ce021-7022-45de-a288-08fe8bb3fb10.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:16 devstack sudo[104255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-924ce021-7022-45de-a288-08fe8bb3fb10.info Sep 23 00:29:16 devstack sudo[104255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:16 devstack sudo[104252]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.292s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:16 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:29:17 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running periodic task VolumeManager._thread_info {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:29:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] thread count: 29 {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:29:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] thread info: [<_MainThread(MainThread, started 135440660459648)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:29:17 devstack sudo[104255]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-982a8784-d434-46ff-8f6a-47c4e3c794cf tempest-VolumesExtendTest-2114009666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-924ce021-7022-45de-a288-08fe8bb3fb10.info" returned: 0 in 0.299s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-982a8784-d434-46ff-8f6a-47c4e3c794cf tempest-VolumesExtendTest-2114009666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.454s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:17 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-982a8784-d434-46ff-8f6a-47c4e3c794cf tempest-VolumesExtendTest-2114009666 None] Create snapshot completed successfully Sep 23 00:29:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f67bfdff-6e22-446a-b229-44b77cfbbce8 tempest-VolumesExtendTest-2114009666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f67bfdff-6e22-446a-b229-44b77cfbbce8 tempest-VolumesExtendTest-2114009666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:17 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e018d03-787c-4d27-9781-ba4c59c94f84]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f67bfdff-6e22-446a-b229-44b77cfbbce8 tempest-VolumesExtendTest-2114009666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-924ce021-7022-45de-a288-08fe8bb3fb10 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:18 devstack sudo[104260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-924ce021-7022-45de-a288-08fe8bb3fb10 Sep 23 00:29:18 devstack sudo[104260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:18 devstack sudo[104260]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f67bfdff-6e22-446a-b229-44b77cfbbce8 tempest-VolumesExtendTest-2114009666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-924ce021-7022-45de-a288-08fe8bb3fb10" returned: 0 in 0.433s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f67bfdff-6e22-446a-b229-44b77cfbbce8 tempest-VolumesExtendTest-2114009666 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-924ce021-7022-45de-a288-08fe8bb3fb10.6abbc23d-9cb8-4abd-9e3a-ff82d39ad245 2G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f67bfdff-6e22-446a-b229-44b77cfbbce8 tempest-VolumesExtendTest-2114009666 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-924ce021-7022-45de-a288-08fe8bb3fb10.6abbc23d-9cb8-4abd-9e3a-ff82d39ad245 2G" returned: 0 in 0.138s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f67bfdff-6e22-446a-b229-44b77cfbbce8 tempest-VolumesExtendTest-2114009666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.625s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:18 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-f67bfdff-6e22-446a-b229-44b77cfbbce8 tempest-VolumesExtendTest-2114009666 None] Extend volume completed successfully. Sep 23 00:29:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-90de43a9-530d-40e3-b13f-39817f856e59 tempest-VolumesExtendTest-2114009666 None] Acquiring lock "cinder-6abbc23d-9cb8-4abd-9e3a-ff82d39ad245-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-90de43a9-530d-40e3-b13f-39817f856e59 tempest-VolumesExtendTest-2114009666 None] Lock "cinder-6abbc23d-9cb8-4abd-9e3a-ff82d39ad245-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-90de43a9-530d-40e3-b13f-39817f856e59 tempest-VolumesExtendTest-2114009666 None] Acquiring lock "cinder-quobyte-924ce021-7022-45de-a288-08fe8bb3fb10" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-90de43a9-530d-40e3-b13f-39817f856e59 tempest-VolumesExtendTest-2114009666 None] Lock "cinder-quobyte-924ce021-7022-45de-a288-08fe8bb3fb10" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-90de43a9-530d-40e3-b13f-39817f856e59 tempest-VolumesExtendTest-2114009666 None] Acquiring lock "cinder-quobyte-6abbc23d-9cb8-4abd-9e3a-ff82d39ad245" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-90de43a9-530d-40e3-b13f-39817f856e59 tempest-VolumesExtendTest-2114009666 None] Lock "cinder-quobyte-6abbc23d-9cb8-4abd-9e3a-ff82d39ad245" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:19 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-90de43a9-530d-40e3-b13f-39817f856e59 tempest-VolumesExtendTest-2114009666 None] Deleting offline snapshot 6abbc23d-9cb8-4abd-9e3a-ff82d39ad245 of volume 924ce021-7022-45de-a288-08fe8bb3fb10 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:29:19 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-90de43a9-530d-40e3-b13f-39817f856e59 tempest-VolumesExtendTest-2114009666 None] snapshot_file for this snap is: volume-924ce021-7022-45de-a288-08fe8bb3fb10.6abbc23d-9cb8-4abd-9e3a-ff82d39ad245 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:29:19 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de6fc3c-e570-4634-b69a-bb07d7c80021]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-90de43a9-530d-40e3-b13f-39817f856e59 tempest-VolumesExtendTest-2114009666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-924ce021-7022-45de-a288-08fe8bb3fb10.6abbc23d-9cb8-4abd-9e3a-ff82d39ad245 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:19 devstack sudo[104269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-924ce021-7022-45de-a288-08fe8bb3fb10.6abbc23d-9cb8-4abd-9e3a-ff82d39ad245 Sep 23 00:29:19 devstack sudo[104269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:19 devstack sudo[104269]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-90de43a9-530d-40e3-b13f-39817f856e59 tempest-VolumesExtendTest-2114009666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-924ce021-7022-45de-a288-08fe8bb3fb10.6abbc23d-9cb8-4abd-9e3a-ff82d39ad245" returned: 0 in 0.403s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:19 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-90de43a9-530d-40e3-b13f-39817f856e59 tempest-VolumesExtendTest-2114009666 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-924ce021-7022-45de-a288-08fe8bb3fb10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:29:19 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d099e26-3afb-450b-a54f-7fb095a14238]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-90de43a9-530d-40e3-b13f-39817f856e59 tempest-VolumesExtendTest-2114009666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-924ce021-7022-45de-a288-08fe8bb3fb10 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:19 devstack sudo[104274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-924ce021-7022-45de-a288-08fe8bb3fb10 Sep 23 00:29:19 devstack sudo[104274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:20 devstack sudo[104274]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-90de43a9-530d-40e3-b13f-39817f856e59 tempest-VolumesExtendTest-2114009666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-924ce021-7022-45de-a288-08fe8bb3fb10" returned: 0 in 0.453s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-90de43a9-530d-40e3-b13f-39817f856e59 tempest-VolumesExtendTest-2114009666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-924ce021-7022-45de-a288-08fe8bb3fb10.6abbc23d-9cb8-4abd-9e3a-ff82d39ad245 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:20 devstack sudo[104280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-924ce021-7022-45de-a288-08fe8bb3fb10.6abbc23d-9cb8-4abd-9e3a-ff82d39ad245 Sep 23 00:29:20 devstack sudo[104280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:20 devstack sudo[104280]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-90de43a9-530d-40e3-b13f-39817f856e59 tempest-VolumesExtendTest-2114009666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-924ce021-7022-45de-a288-08fe8bb3fb10.6abbc23d-9cb8-4abd-9e3a-ff82d39ad245" returned: 0 in 0.465s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-90de43a9-530d-40e3-b13f-39817f856e59 tempest-VolumesExtendTest-2114009666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-924ce021-7022-45de-a288-08fe8bb3fb10.6abbc23d-9cb8-4abd-9e3a-ff82d39ad245 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:20 devstack sudo[104286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-924ce021-7022-45de-a288-08fe8bb3fb10.6abbc23d-9cb8-4abd-9e3a-ff82d39ad245 Sep 23 00:29:20 devstack sudo[104286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:20 devstack sudo[104286]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-90de43a9-530d-40e3-b13f-39817f856e59 tempest-VolumesExtendTest-2114009666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-924ce021-7022-45de-a288-08fe8bb3fb10.6abbc23d-9cb8-4abd-9e3a-ff82d39ad245" returned: 0 in 0.260s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:20 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-90de43a9-530d-40e3-b13f-39817f856e59 tempest-VolumesExtendTest-2114009666 None] Lock "cinder-quobyte-6abbc23d-9cb8-4abd-9e3a-ff82d39ad245" released by "_delete_snapshot" :: held 1.701s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:20 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-90de43a9-530d-40e3-b13f-39817f856e59 tempest-VolumesExtendTest-2114009666 None] Lock "cinder-quobyte-924ce021-7022-45de-a288-08fe8bb3fb10" released by "delete_snapshot" :: held 1.728s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:21 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-90de43a9-530d-40e3-b13f-39817f856e59 tempest-VolumesExtendTest-2114009666 None] Created reservations ['5268a3d3-4562-4865-8205-b4c827882af6', 'cdbde9ca-5c0c-4444-a185-e8574ae655ad', 'd19e319e-b680-4a73-b1e3-b16d94abf688', '0d2d4a05-70d9-4049-8881-2b8b1ff89d41'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:29:21 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-90de43a9-530d-40e3-b13f-39817f856e59 tempest-VolumesExtendTest-2114009666 None] Delete snapshot completed successfully. Sep 23 00:29:21 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-90de43a9-530d-40e3-b13f-39817f856e59 tempest-VolumesExtendTest-2114009666 None] Lock "cinder-6abbc23d-9cb8-4abd-9e3a-ff82d39ad245-delete_snapshot" released by "delete_snapshot" :: held 1.879s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:21 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5124c124-1265-454f-9a8c-4f8d67ffd619 tempest-VolumesExtendTest-2114009666 None] Acquiring lock "cinder-924ce021-7022-45de-a288-08fe8bb3fb10-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:21 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5124c124-1265-454f-9a8c-4f8d67ffd619 tempest-VolumesExtendTest-2114009666 None] Lock "cinder-924ce021-7022-45de-a288-08fe8bb3fb10-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:21 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5124c124-1265-454f-9a8c-4f8d67ffd619 tempest-VolumesExtendTest-2114009666 None] Acquiring lock "cinder-quobyte-924ce021-7022-45de-a288-08fe8bb3fb10" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:21 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5124c124-1265-454f-9a8c-4f8d67ffd619 tempest-VolumesExtendTest-2114009666 None] Lock "cinder-quobyte-924ce021-7022-45de-a288-08fe8bb3fb10" acquired by "delete_volume" :: waited 0.019s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:21 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b6c6ab-d1d1-4e4b-96b2-076c3e16d366]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5124c124-1265-454f-9a8c-4f8d67ffd619 tempest-VolumesExtendTest-2114009666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-924ce021-7022-45de-a288-08fe8bb3fb10 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:21 devstack sudo[104289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-924ce021-7022-45de-a288-08fe8bb3fb10 Sep 23 00:29:21 devstack sudo[104289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:22 devstack sudo[104289]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5124c124-1265-454f-9a8c-4f8d67ffd619 tempest-VolumesExtendTest-2114009666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-924ce021-7022-45de-a288-08fe8bb3fb10" returned: 0 in 0.462s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5124c124-1265-454f-9a8c-4f8d67ffd619 tempest-VolumesExtendTest-2114009666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-924ce021-7022-45de-a288-08fe8bb3fb10 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:22 devstack sudo[104294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-924ce021-7022-45de-a288-08fe8bb3fb10 Sep 23 00:29:22 devstack sudo[104294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:22 devstack sudo[104294]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5124c124-1265-454f-9a8c-4f8d67ffd619 tempest-VolumesExtendTest-2114009666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-924ce021-7022-45de-a288-08fe8bb3fb10" returned: 0 in 0.269s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:22 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5124c124-1265-454f-9a8c-4f8d67ffd619 tempest-VolumesExtendTest-2114009666 None] Lock "cinder-quobyte-924ce021-7022-45de-a288-08fe8bb3fb10" released by "delete_volume" :: held 0.805s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:22 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-5124c124-1265-454f-9a8c-4f8d67ffd619 tempest-VolumesExtendTest-2114009666 None] Created reservations ['232a2854-bf71-4c8f-8a00-f57875e2edf7', '75a757d9-d349-4ad9-ac3e-77de66f707e5', '22978af1-715f-4526-b64f-c32ca3a85c6a', '02d986cd-7aac-4eb9-8129-794f65913e5b'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:29:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5124c124-1265-454f-9a8c-4f8d67ffd619 tempest-VolumesExtendTest-2114009666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5124c124-1265-454f-9a8c-4f8d67ffd619 tempest-VolumesExtendTest-2114009666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:22 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5124c124-1265-454f-9a8c-4f8d67ffd619 tempest-VolumesExtendTest-2114009666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:22 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5124c124-1265-454f-9a8c-4f8d67ffd619 tempest-VolumesExtendTest-2114009666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5124c124-1265-454f-9a8c-4f8d67ffd619 tempest-VolumesExtendTest-2114009666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5124c124-1265-454f-9a8c-4f8d67ffd619 tempest-VolumesExtendTest-2114009666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:22 devstack sudo[104297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:29:22 devstack sudo[104297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:22 devstack sudo[104297]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5124c124-1265-454f-9a8c-4f8d67ffd619 tempest-VolumesExtendTest-2114009666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.332s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:22 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-5124c124-1265-454f-9a8c-4f8d67ffd619 tempest-VolumesExtendTest-2114009666 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:29:22 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-5124c124-1265-454f-9a8c-4f8d67ffd619 tempest-VolumesExtendTest-2114009666 None] Deleted volume successfully. Sep 23 00:29:22 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5124c124-1265-454f-9a8c-4f8d67ffd619 tempest-VolumesExtendTest-2114009666 None] Lock "cinder-924ce021-7022-45de-a288-08fe8bb3fb10-delete_volume" released by "delete_volume" :: held 1.409s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:23 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:29:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Flow 'volume_create_manager' (ac27b3f4-8411-4fe2-8305-d41b7e021426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c35c7eb-104b-42f2-ab5c-ccb55fb32dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c35c7eb-104b-42f2-ab5c-ccb55fb32dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:29:23Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f29de9b-cfea-4065-a2ea-3f5671f977a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bd500ec10e14606b4fa9641483f817b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:23Z,use_quota=True,user_id='aceb24b566c34004a01272184b0a5fc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b96878e-0de7-4a10-a9e9-2700d182c4bf),volume_type_id=3b96878e-0de7-4a10-a9e9-2700d182c4bf)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bad19123-fe16-49a5-ba4f-bfb14d95edae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bad19123-fe16-49a5-ba4f-bfb14d95edae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fc94524-d738-4797-87eb-6101b5eb4ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:23 devstack cinder-volume[86591]: DEBUG cinder.image.glance [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Creating Keystone auth plugin from conf {{(pid=86591) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 00:29:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fc94524-d738-4797-87eb-6101b5eb4ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7f29de9b-cfea-4065-a2ea-3f5671f977a9', 'volume_name': 'volume-7f29de9b-cfea-4065-a2ea-3f5671f977a9', 'volume_size': 1, 'image_id': 'e101f4ce-49d7-4110-80ec-cd24a689f5bb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e101f4ce-49d7-4110-80ec-cd24a689f5bb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '83baa8d89fd16b4a4f634cbd59ed9edf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2bd500ec10e14606b4fa9641483f817b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1384d572f9c5ff37411db2f4cc76f786f6e21061a3681c4cff71f49068d46c33447a03843a4f4fb4440fd1616106c1318493f173a9b2b9ae4389289dad353403', 'id': 'e101f4ce-49d7-4110-80ec-cd24a689f5bb', 'created_at': datetime.datetime(2026, 9, 22, 22, 29, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 29, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e101f4ce-49d7-4110-80ec-cd24a689f5bb/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21a7f75c-9daf-441f-8d7d-0a43e5f52ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21a7f75c-9daf-441f-8d7d-0a43e5f52ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c427330-babb-432b-969a-d3e66397527f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:23 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Volume 7f29de9b-cfea-4065-a2ea-3f5671f977a9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7f29de9b-cfea-4065-a2ea-3f5671f977a9', 'volume_size': 1, 'image_id': 'e101f4ce-49d7-4110-80ec-cd24a689f5bb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e101f4ce-49d7-4110-80ec-cd24a689f5bb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '83baa8d89fd16b4a4f634cbd59ed9edf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2bd500ec10e14606b4fa9641483f817b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1384d572f9c5ff37411db2f4cc76f786f6e21061a3681c4cff71f49068d46c33447a03843a4f4fb4440fd1616106c1318493f173a9b2b9ae4389289dad353403', 'id': 'e101f4ce-49d7-4110-80ec-cd24a689f5bb', 'created_at': datetime.datetime(2026, 9, 22, 22, 29, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 29, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e101f4ce-49d7-4110-80ec-cd24a689f5bb/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 23 00:29:23 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Trying to clone 7f29de9b-cfea-4065-a2ea-3f5671f977a9 from image e101f4ce-49d7-4110-80ec-cd24a689f5bb at location (None, [{'url': 'file:///opt/stack/data/glance/images/e101f4ce-49d7-4110-80ec-cd24a689f5bb', 'metadata': {}}]). {{(pid=86591) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 00:29:23 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e101f4ce-49d7-4110-80ec-cd24a689f5bb_umy7aqlfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86591) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 00:29:23 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Image download 0.00 MB at 0.00 MB/s Sep 23 00:29:23 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4509e3-ccac-40b6-814b-1f463ffdd3ae]: (4, 'raw') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e101f4ce-49d7-4110-80ec-cd24a689f5bb_umy7aqlfdevstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:24 devstack sudo[104300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e101f4ce-49d7-4110-80ec-cd24a689f5bb_umy7aqlfdevstack@QuobyteHD Sep 23 00:29:24 devstack sudo[104300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:24 devstack sudo[104300]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e101f4ce-49d7-4110-80ec-cd24a689f5bb_umy7aqlfdevstack@QuobyteHD" returned: 0 in 0.469s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e101f4ce-49d7-4110-80ec-cd24a689f5bb_umy7aqlfdevstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:24 devstack sudo[104304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e101f4ce-49d7-4110-80ec-cd24a689f5bb_umy7aqlfdevstack@QuobyteHD Sep 23 00:29:24 devstack sudo[104304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:24 devstack sudo[104304]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e101f4ce-49d7-4110-80ec-cd24a689f5bb_umy7aqlfdevstack@QuobyteHD" returned: 1 in 0.417s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e101f4ce-49d7-4110-80ec-cd24a689f5bb_umy7aqlfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:29:24 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Temporary image e101f4ce-49d7-4110-80ec-cd24a689f5bb is fetched for user aceb24b566c34004a01272184b0a5fc2. {{(pid=86591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 00:29:24 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba45f308-2ec3-4c20-a124-2f4fa3dd3863]: (4, 'raw') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e101f4ce-49d7-4110-80ec-cd24a689f5bb_umy7aqlfdevstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:25 devstack sudo[104309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e101f4ce-49d7-4110-80ec-cd24a689f5bb_umy7aqlfdevstack@QuobyteHD Sep 23 00:29:25 devstack sudo[104309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:25 devstack sudo[104309]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e101f4ce-49d7-4110-80ec-cd24a689f5bb_umy7aqlfdevstack@QuobyteHD" returned: 0 in 0.387s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e101f4ce-49d7-4110-80ec-cd24a689f5bb_umy7aqlfdevstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:25 devstack sudo[104313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e101f4ce-49d7-4110-80ec-cd24a689f5bb_umy7aqlfdevstack@QuobyteHD Sep 23 00:29:25 devstack sudo[104313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:25 devstack sudo[104313]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e101f4ce-49d7-4110-80ec-cd24a689f5bb_umy7aqlfdevstack@QuobyteHD" returned: 1 in 0.384s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e101f4ce-49d7-4110-80ec-cd24a689f5bb_umy7aqlfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:29:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:25 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:29:23Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f29de9b-cfea-4065-a2ea-3f5671f977a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bd500ec10e14606b4fa9641483f817b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:23Z,use_quota=True,user_id='aceb24b566c34004a01272184b0a5fc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b96878e-0de7-4a10-a9e9-2700d182c4bf),volume_type_id=3b96878e-0de7-4a10-a9e9-2700d182c4bf)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:29:25 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Creating volume 7f29de9b-cfea-4065-a2ea-3f5671f977a9 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:29:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:25 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:25 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:25 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:29:25 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:29:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7f29de9b-cfea-4065-a2ea-3f5671f977a9 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:25 devstack sudo[104319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7f29de9b-cfea-4065-a2ea-3f5671f977a9 1073741824 Sep 23 00:29:25 devstack sudo[104319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:26 devstack sudo[104319]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7f29de9b-cfea-4065-a2ea-3f5671f977a9 1073741824" returned: 0 in 0.541s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7f29de9b-cfea-4065-a2ea-3f5671f977a9 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:26 devstack sudo[104325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7f29de9b-cfea-4065-a2ea-3f5671f977a9 Sep 23 00:29:26 devstack sudo[104325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:26 devstack sudo[104325]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7f29de9b-cfea-4065-a2ea-3f5671f977a9" returned: 0 in 0.288s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:26 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:29:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:26 devstack cinder-volume[86591]: DEBUG cinder.volume.volume_utils [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Attempting download of e101f4ce-49d7-4110-80ec-cd24a689f5bb ((None, [{'url': 'file:///opt/stack/data/glance/images/e101f4ce-49d7-4110-80ec-cd24a689f5bb', 'metadata': {}}])) to volume 7f29de9b-cfea-4065-a2ea-3f5671f977a9. {{(pid=86591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 00:29:26 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8fd47d6-c05f-4285-a23c-c35e2ef5913f]: (4, 'raw') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e101f4ce-49d7-4110-80ec-cd24a689f5bb_1sgrxbt3 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:26 devstack sudo[104328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e101f4ce-49d7-4110-80ec-cd24a689f5bb_1sgrxbt3 Sep 23 00:29:26 devstack sudo[104328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:27 devstack sudo[104328]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e101f4ce-49d7-4110-80ec-cd24a689f5bb_1sgrxbt3" returned: 0 in 0.425s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e101f4ce-49d7-4110-80ec-cd24a689f5bb_1sgrxbt3 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:27 devstack sudo[104332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e101f4ce-49d7-4110-80ec-cd24a689f5bb_1sgrxbt3 Sep 23 00:29:27 devstack sudo[104332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:27 devstack sudo[104332]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e101f4ce-49d7-4110-80ec-cd24a689f5bb_1sgrxbt3" returned: 1 in 0.451s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e101f4ce-49d7-4110-80ec-cd24a689f5bb_1sgrxbt3' failed. Not Retrying. {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:29:27 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b64641-1d81-43c2-a810-0763382ca3f4]: (4, 'raw') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e101f4ce-49d7-4110-80ec-cd24a689f5bb_umy7aqlfdevstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:27 devstack sudo[104337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e101f4ce-49d7-4110-80ec-cd24a689f5bb_umy7aqlfdevstack@QuobyteHD Sep 23 00:29:27 devstack sudo[104337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:27 devstack sudo[104337]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e101f4ce-49d7-4110-80ec-cd24a689f5bb_umy7aqlfdevstack@QuobyteHD" returned: 0 in 0.453s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e101f4ce-49d7-4110-80ec-cd24a689f5bb_umy7aqlfdevstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:28 devstack sudo[104341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e101f4ce-49d7-4110-80ec-cd24a689f5bb_umy7aqlfdevstack@QuobyteHD Sep 23 00:29:28 devstack sudo[104341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:28 devstack sudo[104341]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e101f4ce-49d7-4110-80ec-cd24a689f5bb_umy7aqlfdevstack@QuobyteHD" returned: 1 in 0.350s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e101f4ce-49d7-4110-80ec-cd24a689f5bb_umy7aqlfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:29:28 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] e101f4ce-49d7-4110-80ec-cd24a689f5bb was raw, converting to qcow2 {{(pid=86591) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 00:29:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e101f4ce-49d7-4110-80ec-cd24a689f5bb_umy7aqlfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7f29de9b-cfea-4065-a2ea-3f5671f977a9 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:28 devstack sudo[104348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e101f4ce-49d7-4110-80ec-cd24a689f5bb_umy7aqlfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7f29de9b-cfea-4065-a2ea-3f5671f977a9 Sep 23 00:29:28 devstack sudo[104348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:28 devstack sudo[104348]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e101f4ce-49d7-4110-80ec-cd24a689f5bb_umy7aqlfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7f29de9b-cfea-4065-a2ea-3f5671f977a9" returned: 0 in 0.522s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:28 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e101f4ce-49d7-4110-80ec-cd24a689f5bb_umy7aqlfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7f29de9b-cfea-4065-a2ea-3f5671f977a9 {{(pid=86591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:29:28 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Converted 0.00 MB image at 0.00 MB/s Sep 23 00:29:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7f29de9b-cfea-4065-a2ea-3f5671f977a9 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:28 devstack sudo[104353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7f29de9b-cfea-4065-a2ea-3f5671f977a9 1G Sep 23 00:29:28 devstack sudo[104353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:29 devstack sudo[104353]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7f29de9b-cfea-4065-a2ea-3f5671f977a9 1G" returned: 0 in 0.350s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:29 devstack cinder-volume[86591]: DEBUG cinder.volume.volume_utils [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Downloaded image e101f4ce-49d7-4110-80ec-cd24a689f5bb ((None, [{'url': 'file:///opt/stack/data/glance/images/e101f4ce-49d7-4110-80ec-cd24a689f5bb', 'metadata': {}}])) to volume 7f29de9b-cfea-4065-a2ea-3f5671f977a9 successfully. {{(pid=86591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 00:29:29 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Temporary image e101f4ce-49d7-4110-80ec-cd24a689f5bb for user aceb24b566c34004a01272184b0a5fc2 is deleted. {{(pid=86591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 00:29:29 devstack cinder-volume[86591]: DEBUG cinder.volume.volume_utils [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Marking volume 7f29de9b-cfea-4065-a2ea-3f5671f977a9 as bootable. {{(pid=86591) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 00:29:29 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Copying metadata from image e101f4ce-49d7-4110-80ec-cd24a689f5bb to 7f29de9b-cfea-4065-a2ea-3f5671f977a9. {{(pid=86591) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 00:29:29 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Creating volume glance metadata for volume 7f29de9b-cfea-4065-a2ea-3f5671f977a9 backed by image e101f4ce-49d7-4110-80ec-cd24a689f5bb with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'e101f4ce-49d7-4110-80ec-cd24a689f5bb', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '83baa8d89fd16b4a4f634cbd59ed9edf', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86591) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 00:29:29 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c427330-babb-432b-969a-d3e66397527f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f29de9b-cfea-4065-a2ea-3f5671f977a9', 'volume_size': 1, 'image_id': 'e101f4ce-49d7-4110-80ec-cd24a689f5bb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e101f4ce-49d7-4110-80ec-cd24a689f5bb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '83baa8d89fd16b4a4f634cbd59ed9edf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2bd500ec10e14606b4fa9641483f817b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1384d572f9c5ff37411db2f4cc76f786f6e21061a3681c4cff71f49068d46c33447a03843a4f4fb4440fd1616106c1318493f173a9b2b9ae4389289dad353403', 'id': 'e101f4ce-49d7-4110-80ec-cd24a689f5bb', 'created_at': datetime.datetime(2026, 9, 22, 22, 29, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 29, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e101f4ce-49d7-4110-80ec-cd24a689f5bb/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:29 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0a0f281-481c-4d73-9640-456270025555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:29 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Volume volume-7f29de9b-cfea-4065-a2ea-3f5671f977a9 (7f29de9b-cfea-4065-a2ea-3f5671f977a9): created successfully Sep 23 00:29:29 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0a0f281-481c-4d73-9640-456270025555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:29 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Flow 'volume_create_manager' (ac27b3f4-8411-4fe2-8305-d41b7e021426) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:29 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-6772d793-959f-46d0-8209-d0ec6abd9496 tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Created volume successfully. Sep 23 00:29:29 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5ae6bc42-5a17-4f0b-857e-40675dd9b9ec tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Acquiring lock "cinder-7f29de9b-cfea-4065-a2ea-3f5671f977a9-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:29 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5ae6bc42-5a17-4f0b-857e-40675dd9b9ec tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Lock "cinder-7f29de9b-cfea-4065-a2ea-3f5671f977a9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:29 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5ae6bc42-5a17-4f0b-857e-40675dd9b9ec tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Acquiring lock "cinder-quobyte-7f29de9b-cfea-4065-a2ea-3f5671f977a9" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:29 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5ae6bc42-5a17-4f0b-857e-40675dd9b9ec tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Lock "cinder-quobyte-7f29de9b-cfea-4065-a2ea-3f5671f977a9" acquired by "delete_volume" :: waited 0.015s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:29 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[654a554c-a4df-44d1-a308-d1b8b2cf9811]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5ae6bc42-5a17-4f0b-857e-40675dd9b9ec tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7f29de9b-cfea-4065-a2ea-3f5671f977a9 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:29 devstack sudo[104359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7f29de9b-cfea-4065-a2ea-3f5671f977a9 Sep 23 00:29:29 devstack sudo[104359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:30 devstack sudo[104359]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5ae6bc42-5a17-4f0b-857e-40675dd9b9ec tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7f29de9b-cfea-4065-a2ea-3f5671f977a9" returned: 0 in 0.417s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5ae6bc42-5a17-4f0b-857e-40675dd9b9ec tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7f29de9b-cfea-4065-a2ea-3f5671f977a9 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:30 devstack sudo[104364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7f29de9b-cfea-4065-a2ea-3f5671f977a9 Sep 23 00:29:30 devstack sudo[104364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:30 devstack sudo[104364]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5ae6bc42-5a17-4f0b-857e-40675dd9b9ec tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7f29de9b-cfea-4065-a2ea-3f5671f977a9" returned: 0 in 0.277s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:30 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5ae6bc42-5a17-4f0b-857e-40675dd9b9ec tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Lock "cinder-quobyte-7f29de9b-cfea-4065-a2ea-3f5671f977a9" released by "delete_volume" :: held 0.748s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:30 devstack cinder-volume[86591]: WARNING cinder.quota [None req-5ae6bc42-5a17-4f0b-857e-40675dd9b9ec tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:29:30 devstack cinder-volume[86591]: WARNING cinder.quota [None req-5ae6bc42-5a17-4f0b-857e-40675dd9b9ec tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:29:30 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-5ae6bc42-5a17-4f0b-857e-40675dd9b9ec tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Created reservations ['29e79556-d295-48f9-b1a6-a11bac8c7e36', '722c6c31-c441-4535-8efb-43cfebbb81c4', 'febb8e33-ad8d-405f-b16b-00138afeea87', '9a94dd1d-73dc-4c49-a16a-ad735b1ec3a6'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:29:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5ae6bc42-5a17-4f0b-857e-40675dd9b9ec tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5ae6bc42-5a17-4f0b-857e-40675dd9b9ec tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:30 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5ae6bc42-5a17-4f0b-857e-40675dd9b9ec tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:30 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5ae6bc42-5a17-4f0b-857e-40675dd9b9ec tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5ae6bc42-5a17-4f0b-857e-40675dd9b9ec tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5ae6bc42-5a17-4f0b-857e-40675dd9b9ec tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:30 devstack sudo[104367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:29:30 devstack sudo[104367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:30 devstack sudo[104367]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5ae6bc42-5a17-4f0b-857e-40675dd9b9ec tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.305s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:30 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-5ae6bc42-5a17-4f0b-857e-40675dd9b9ec tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:29:30 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-5ae6bc42-5a17-4f0b-857e-40675dd9b9ec tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Deleted volume successfully. Sep 23 00:29:31 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5ae6bc42-5a17-4f0b-857e-40675dd9b9ec tempest-VolumeAndVolumeTypeFromImageTest-645011746 None] Lock "cinder-7f29de9b-cfea-4065-a2ea-3f5671f977a9-delete_volume" released by "delete_volume" :: held 1.349s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:31 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-be32722e-4b62-4ed8-8af8-1caba2ce710b tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:29:31 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-be32722e-4b62-4ed8-8af8-1caba2ce710b tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Flow 'volume_create_manager' (83b01e1d-f1c5-47ba-9356-5ea934f377c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:31 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-be32722e-4b62-4ed8-8af8-1caba2ce710b tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d458e7b-4d30-4b71-8a35-f03e9a427ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:31 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-be32722e-4b62-4ed8-8af8-1caba2ce710b tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d458e7b-4d30-4b71-8a35-f03e9a427ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:29:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1629986522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7187875d-82bf-41de-8810-86d3fe4cd25e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='babfbfb726f04864ba0390226fdbdb13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:31Z,use_quota=True,user_id='8cc563cebc874b238997dc6fb0de1147',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:31 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-be32722e-4b62-4ed8-8af8-1caba2ce710b tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af3afcff-30e6-4ddd-9a47-d88bcb40a153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:31 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-be32722e-4b62-4ed8-8af8-1caba2ce710b tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af3afcff-30e6-4ddd-9a47-d88bcb40a153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:31 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-be32722e-4b62-4ed8-8af8-1caba2ce710b tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7a4fbfe-86ea-477e-b463-a22610537b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:31 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-be32722e-4b62-4ed8-8af8-1caba2ce710b tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7a4fbfe-86ea-477e-b463-a22610537b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7187875d-82bf-41de-8810-86d3fe4cd25e', 'volume_name': 'volume-7187875d-82bf-41de-8810-86d3fe4cd25e', 'volume_size': 2}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:31 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-be32722e-4b62-4ed8-8af8-1caba2ce710b tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dff052d-7ed5-4310-9bc7-96fd466d0cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:31 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-be32722e-4b62-4ed8-8af8-1caba2ce710b tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dff052d-7ed5-4310-9bc7-96fd466d0cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:31 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-be32722e-4b62-4ed8-8af8-1caba2ce710b tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7c14b12-adba-4055-802b-6b1605c57007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:31 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-be32722e-4b62-4ed8-8af8-1caba2ce710b tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Volume 7187875d-82bf-41de-8810-86d3fe4cd25e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7187875d-82bf-41de-8810-86d3fe4cd25e', 'volume_size': 2} Sep 23 00:29:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-be32722e-4b62-4ed8-8af8-1caba2ce710b tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-be32722e-4b62-4ed8-8af8-1caba2ce710b tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:31 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-be32722e-4b62-4ed8-8af8-1caba2ce710b tempest-VolumesSnapshotNegativeTestJSON-114577576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:29:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1629986522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7187875d-82bf-41de-8810-86d3fe4cd25e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='babfbfb726f04864ba0390226fdbdb13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:31Z,use_quota=True,user_id='8cc563cebc874b238997dc6fb0de1147',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:29:31 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-be32722e-4b62-4ed8-8af8-1caba2ce710b tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Creating volume 7187875d-82bf-41de-8810-86d3fe4cd25e {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:29:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-be32722e-4b62-4ed8-8af8-1caba2ce710b tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-be32722e-4b62-4ed8-8af8-1caba2ce710b tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:31 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-be32722e-4b62-4ed8-8af8-1caba2ce710b tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:31 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-be32722e-4b62-4ed8-8af8-1caba2ce710b tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-be32722e-4b62-4ed8-8af8-1caba2ce710b tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:31 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-be32722e-4b62-4ed8-8af8-1caba2ce710b tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:29:31 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-be32722e-4b62-4ed8-8af8-1caba2ce710b tempest-VolumesSnapshotNegativeTestJSON-114577576 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:29:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-be32722e-4b62-4ed8-8af8-1caba2ce710b tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7187875d-82bf-41de-8810-86d3fe4cd25e 2147483648 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:31 devstack sudo[104370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7187875d-82bf-41de-8810-86d3fe4cd25e 2147483648 Sep 23 00:29:31 devstack sudo[104370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:31 devstack sudo[104370]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-be32722e-4b62-4ed8-8af8-1caba2ce710b tempest-VolumesSnapshotNegativeTestJSON-114577576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7187875d-82bf-41de-8810-86d3fe4cd25e 2147483648" returned: 0 in 0.601s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-be32722e-4b62-4ed8-8af8-1caba2ce710b tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7187875d-82bf-41de-8810-86d3fe4cd25e {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:32 devstack sudo[104376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7187875d-82bf-41de-8810-86d3fe4cd25e Sep 23 00:29:32 devstack sudo[104376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:32 devstack sudo[104376]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-be32722e-4b62-4ed8-8af8-1caba2ce710b tempest-VolumesSnapshotNegativeTestJSON-114577576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7187875d-82bf-41de-8810-86d3fe4cd25e" returned: 0 in 0.296s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:32 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-be32722e-4b62-4ed8-8af8-1caba2ce710b tempest-VolumesSnapshotNegativeTestJSON-114577576 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:29:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-be32722e-4b62-4ed8-8af8-1caba2ce710b tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-be32722e-4b62-4ed8-8af8-1caba2ce710b tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7c14b12-adba-4055-802b-6b1605c57007) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7187875d-82bf-41de-8810-86d3fe4cd25e', 'volume_size': 2}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-be32722e-4b62-4ed8-8af8-1caba2ce710b tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd679007-87c1-4b41-91b7-3badf5c5ced8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:32 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-be32722e-4b62-4ed8-8af8-1caba2ce710b tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Volume volume-7187875d-82bf-41de-8810-86d3fe4cd25e (7187875d-82bf-41de-8810-86d3fe4cd25e): created successfully Sep 23 00:29:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-be32722e-4b62-4ed8-8af8-1caba2ce710b tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd679007-87c1-4b41-91b7-3badf5c5ced8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-be32722e-4b62-4ed8-8af8-1caba2ce710b tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Flow 'volume_create_manager' (83b01e1d-f1c5-47ba-9356-5ea934f377c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:32 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-be32722e-4b62-4ed8-8af8-1caba2ce710b tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Created volume successfully. Sep 23 00:29:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b75fbc73-4e16-43e1-aa99-f74a87bae75a tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b75fbc73-4e16-43e1-aa99-f74a87bae75a tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:33 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-b75fbc73-4e16-43e1-aa99-f74a87bae75a tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Creating offline snapshot bcb7cfa2-55fc-43a0-9a51-aa89ec3bb8b2 of volume 7187875d-82bf-41de-8810-86d3fe4cd25e {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:29:33 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[6309e3d2-bc5b-4b90-af91-2a578f5b52bb]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b75fbc73-4e16-43e1-aa99-f74a87bae75a tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7187875d-82bf-41de-8810-86d3fe4cd25e {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:33 devstack sudo[104379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7187875d-82bf-41de-8810-86d3fe4cd25e Sep 23 00:29:33 devstack sudo[104379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:34 devstack sudo[104379]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b75fbc73-4e16-43e1-aa99-f74a87bae75a tempest-VolumesSnapshotNegativeTestJSON-114577576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7187875d-82bf-41de-8810-86d3fe4cd25e" returned: 0 in 0.418s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b75fbc73-4e16-43e1-aa99-f74a87bae75a tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7187875d-82bf-41de-8810-86d3fe4cd25e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7187875d-82bf-41de-8810-86d3fe4cd25e.bcb7cfa2-55fc-43a0-9a51-aa89ec3bb8b2 2G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:34 devstack sudo[104384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7187875d-82bf-41de-8810-86d3fe4cd25e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7187875d-82bf-41de-8810-86d3fe4cd25e.bcb7cfa2-55fc-43a0-9a51-aa89ec3bb8b2 2G Sep 23 00:29:34 devstack sudo[104384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:34 devstack sudo[104384]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b75fbc73-4e16-43e1-aa99-f74a87bae75a tempest-VolumesSnapshotNegativeTestJSON-114577576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7187875d-82bf-41de-8810-86d3fe4cd25e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7187875d-82bf-41de-8810-86d3fe4cd25e.bcb7cfa2-55fc-43a0-9a51-aa89ec3bb8b2 2G" returned: 0 in 0.475s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b75fbc73-4e16-43e1-aa99-f74a87bae75a tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7187875d-82bf-41de-8810-86d3fe4cd25e -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7187875d-82bf-41de-8810-86d3fe4cd25e.bcb7cfa2-55fc-43a0-9a51-aa89ec3bb8b2 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:34 devstack sudo[104390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7187875d-82bf-41de-8810-86d3fe4cd25e -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7187875d-82bf-41de-8810-86d3fe4cd25e.bcb7cfa2-55fc-43a0-9a51-aa89ec3bb8b2 Sep 23 00:29:34 devstack sudo[104390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:34 devstack sudo[104390]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b75fbc73-4e16-43e1-aa99-f74a87bae75a tempest-VolumesSnapshotNegativeTestJSON-114577576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7187875d-82bf-41de-8810-86d3fe4cd25e -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7187875d-82bf-41de-8810-86d3fe4cd25e.bcb7cfa2-55fc-43a0-9a51-aa89ec3bb8b2" returned: 0 in 0.369s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:34 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-b75fbc73-4e16-43e1-aa99-f74a87bae75a tempest-VolumesSnapshotNegativeTestJSON-114577576 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7187875d-82bf-41de-8810-86d3fe4cd25e.bcb7cfa2-55fc-43a0-9a51-aa89ec3bb8b2 is being set with open permissions: ugo+rw Sep 23 00:29:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b75fbc73-4e16-43e1-aa99-f74a87bae75a tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7187875d-82bf-41de-8810-86d3fe4cd25e.bcb7cfa2-55fc-43a0-9a51-aa89ec3bb8b2 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:34 devstack sudo[104395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7187875d-82bf-41de-8810-86d3fe4cd25e.bcb7cfa2-55fc-43a0-9a51-aa89ec3bb8b2 Sep 23 00:29:34 devstack sudo[104395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:35 devstack sudo[104395]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b75fbc73-4e16-43e1-aa99-f74a87bae75a tempest-VolumesSnapshotNegativeTestJSON-114577576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7187875d-82bf-41de-8810-86d3fe4cd25e.bcb7cfa2-55fc-43a0-9a51-aa89ec3bb8b2" returned: 0 in 0.326s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b75fbc73-4e16-43e1-aa99-f74a87bae75a tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7187875d-82bf-41de-8810-86d3fe4cd25e.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:35 devstack sudo[104398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7187875d-82bf-41de-8810-86d3fe4cd25e.info Sep 23 00:29:35 devstack sudo[104398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:35 devstack sudo[104398]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b75fbc73-4e16-43e1-aa99-f74a87bae75a tempest-VolumesSnapshotNegativeTestJSON-114577576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7187875d-82bf-41de-8810-86d3fe4cd25e.info" returned: 0 in 0.307s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:35 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-b75fbc73-4e16-43e1-aa99-f74a87bae75a tempest-VolumesSnapshotNegativeTestJSON-114577576 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7187875d-82bf-41de-8810-86d3fe4cd25e.info is being set with open permissions: ugo+rw Sep 23 00:29:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b75fbc73-4e16-43e1-aa99-f74a87bae75a tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7187875d-82bf-41de-8810-86d3fe4cd25e.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:35 devstack sudo[104401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7187875d-82bf-41de-8810-86d3fe4cd25e.info Sep 23 00:29:35 devstack sudo[104401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:35 devstack sudo[104401]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b75fbc73-4e16-43e1-aa99-f74a87bae75a tempest-VolumesSnapshotNegativeTestJSON-114577576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7187875d-82bf-41de-8810-86d3fe4cd25e.info" returned: 0 in 0.300s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b75fbc73-4e16-43e1-aa99-f74a87bae75a tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.308s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:35 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7278548-d7fe-4e01-82ac-0a7503199a85 tempest-CreateVolumesFromImageTest-357588858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:29:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d7278548-d7fe-4e01-82ac-0a7503199a85 tempest-CreateVolumesFromImageTest-357588858 None] Flow 'volume_create_manager' (32b696d7-ed14-4648-86df-0d6dd919f9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d7278548-d7fe-4e01-82ac-0a7503199a85 tempest-CreateVolumesFromImageTest-357588858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf8dad7e-529e-48a3-b26e-3b680ebcecf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:35 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-b75fbc73-4e16-43e1-aa99-f74a87bae75a tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Create snapshot completed successfully Sep 23 00:29:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d7278548-d7fe-4e01-82ac-0a7503199a85 tempest-CreateVolumesFromImageTest-357588858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf8dad7e-529e-48a3-b26e-3b680ebcecf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1826948755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6263a5d6-750e-4ba5-8430-854c37895e31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5977798111d44e71a0808e2def704099',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:36Z,use_quota=True,user_id='ee6ce2cf4fec4c74a05e734d69980ae9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d7278548-d7fe-4e01-82ac-0a7503199a85 tempest-CreateVolumesFromImageTest-357588858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d35fa93c-d020-416e-b323-89c9b5573c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d7278548-d7fe-4e01-82ac-0a7503199a85 tempest-CreateVolumesFromImageTest-357588858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d35fa93c-d020-416e-b323-89c9b5573c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d7278548-d7fe-4e01-82ac-0a7503199a85 tempest-CreateVolumesFromImageTest-357588858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (531432d9-67d3-4cdf-b8c8-12175404a2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d7278548-d7fe-4e01-82ac-0a7503199a85 tempest-CreateVolumesFromImageTest-357588858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (531432d9-67d3-4cdf-b8c8-12175404a2e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6263a5d6-750e-4ba5-8430-854c37895e31', 'volume_name': 'volume-6263a5d6-750e-4ba5-8430-854c37895e31', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d7278548-d7fe-4e01-82ac-0a7503199a85 tempest-CreateVolumesFromImageTest-357588858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70375eff-833f-4d38-99ca-fe12d3b458b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d7278548-d7fe-4e01-82ac-0a7503199a85 tempest-CreateVolumesFromImageTest-357588858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70375eff-833f-4d38-99ca-fe12d3b458b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d7278548-d7fe-4e01-82ac-0a7503199a85 tempest-CreateVolumesFromImageTest-357588858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b410bf5a-ea5d-4be5-92fb-87a8a3f7219c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:36 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-d7278548-d7fe-4e01-82ac-0a7503199a85 tempest-CreateVolumesFromImageTest-357588858 None] Volume 6263a5d6-750e-4ba5-8430-854c37895e31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6263a5d6-750e-4ba5-8430-854c37895e31', 'volume_size': 1} Sep 23 00:29:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d7278548-d7fe-4e01-82ac-0a7503199a85 tempest-CreateVolumesFromImageTest-357588858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d7278548-d7fe-4e01-82ac-0a7503199a85 tempest-CreateVolumesFromImageTest-357588858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:36 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d7278548-d7fe-4e01-82ac-0a7503199a85 tempest-CreateVolumesFromImageTest-357588858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1826948755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6263a5d6-750e-4ba5-8430-854c37895e31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5977798111d44e71a0808e2def704099',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:36Z,use_quota=True,user_id='ee6ce2cf4fec4c74a05e734d69980ae9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:29:36 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-d7278548-d7fe-4e01-82ac-0a7503199a85 tempest-CreateVolumesFromImageTest-357588858 None] Creating volume 6263a5d6-750e-4ba5-8430-854c37895e31 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:29:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d7278548-d7fe-4e01-82ac-0a7503199a85 tempest-CreateVolumesFromImageTest-357588858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d7278548-d7fe-4e01-82ac-0a7503199a85 tempest-CreateVolumesFromImageTest-357588858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:36 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d7278548-d7fe-4e01-82ac-0a7503199a85 tempest-CreateVolumesFromImageTest-357588858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:36 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d7278548-d7fe-4e01-82ac-0a7503199a85 tempest-CreateVolumesFromImageTest-357588858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d7278548-d7fe-4e01-82ac-0a7503199a85 tempest-CreateVolumesFromImageTest-357588858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:36 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d7278548-d7fe-4e01-82ac-0a7503199a85 tempest-CreateVolumesFromImageTest-357588858 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:29:36 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-d7278548-d7fe-4e01-82ac-0a7503199a85 tempest-CreateVolumesFromImageTest-357588858 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:29:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d7278548-d7fe-4e01-82ac-0a7503199a85 tempest-CreateVolumesFromImageTest-357588858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6263a5d6-750e-4ba5-8430-854c37895e31 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:36 devstack sudo[104404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6263a5d6-750e-4ba5-8430-854c37895e31 1073741824 Sep 23 00:29:36 devstack sudo[104404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:36 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0f7fcf7-b85c-4661-b5a7-b6dd9076577c tempest-CreateVolumesFromImageTest-357588858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:29:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f0f7fcf7-b85c-4661-b5a7-b6dd9076577c tempest-CreateVolumesFromImageTest-357588858 None] Flow 'volume_create_manager' (d15aface-9a8e-4cb2-b172-6e5fd8eaddd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f0f7fcf7-b85c-4661-b5a7-b6dd9076577c tempest-CreateVolumesFromImageTest-357588858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (776b25a8-bf47-48c1-9d69-5cd2eaa7c3f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f0f7fcf7-b85c-4661-b5a7-b6dd9076577c tempest-CreateVolumesFromImageTest-357588858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (776b25a8-bf47-48c1-9d69-5cd2eaa7c3f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1288063799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fb5cd20-2023-4809-9807-81af1240d2ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5977798111d44e71a0808e2def704099',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:36Z,use_quota=True,user_id='ee6ce2cf4fec4c74a05e734d69980ae9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f0f7fcf7-b85c-4661-b5a7-b6dd9076577c tempest-CreateVolumesFromImageTest-357588858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f3d49dc-699b-4e5f-8703-7061828099cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f0f7fcf7-b85c-4661-b5a7-b6dd9076577c tempest-CreateVolumesFromImageTest-357588858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f3d49dc-699b-4e5f-8703-7061828099cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f0f7fcf7-b85c-4661-b5a7-b6dd9076577c tempest-CreateVolumesFromImageTest-357588858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe33d0d2-e339-4c9f-ace5-814ad72b323b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f0f7fcf7-b85c-4661-b5a7-b6dd9076577c tempest-CreateVolumesFromImageTest-357588858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe33d0d2-e339-4c9f-ace5-814ad72b323b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fb5cd20-2023-4809-9807-81af1240d2ae', 'volume_name': 'volume-3fb5cd20-2023-4809-9807-81af1240d2ae', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f0f7fcf7-b85c-4661-b5a7-b6dd9076577c tempest-CreateVolumesFromImageTest-357588858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (700a2ef1-ce20-45aa-8a62-df75a13cf2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f0f7fcf7-b85c-4661-b5a7-b6dd9076577c tempest-CreateVolumesFromImageTest-357588858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (700a2ef1-ce20-45aa-8a62-df75a13cf2f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f0f7fcf7-b85c-4661-b5a7-b6dd9076577c tempest-CreateVolumesFromImageTest-357588858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d4396da-973a-474d-9389-06d37da2b079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:36 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-f0f7fcf7-b85c-4661-b5a7-b6dd9076577c tempest-CreateVolumesFromImageTest-357588858 None] Volume 3fb5cd20-2023-4809-9807-81af1240d2ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fb5cd20-2023-4809-9807-81af1240d2ae', 'volume_size': 1} Sep 23 00:29:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f0f7fcf7-b85c-4661-b5a7-b6dd9076577c tempest-CreateVolumesFromImageTest-357588858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:36 devstack sudo[104404]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d7278548-d7fe-4e01-82ac-0a7503199a85 tempest-CreateVolumesFromImageTest-357588858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6263a5d6-750e-4ba5-8430-854c37895e31 1073741824" returned: 0 in 0.552s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d7278548-d7fe-4e01-82ac-0a7503199a85 tempest-CreateVolumesFromImageTest-357588858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6263a5d6-750e-4ba5-8430-854c37895e31 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:36 devstack sudo[104410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6263a5d6-750e-4ba5-8430-854c37895e31 Sep 23 00:29:36 devstack sudo[104410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:36 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e96038d-fdaa-4c88-95c1-c583f159cd91 tempest-CreateVolumesFromImageTest-357588858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:29:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3e96038d-fdaa-4c88-95c1-c583f159cd91 tempest-CreateVolumesFromImageTest-357588858 None] Flow 'volume_create_manager' (4fbf1ba9-b87b-4030-917b-e334acba38e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3e96038d-fdaa-4c88-95c1-c583f159cd91 tempest-CreateVolumesFromImageTest-357588858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (097edac3-d73c-4f0d-b3d1-c22134d38454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:36 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-7138ff2a-c8d9-4d6a-b10d-b3b4f8ed0550 tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Acquiring lock "cinder-bcb7cfa2-55fc-43a0-9a51-aa89ec3bb8b2-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:36 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-7138ff2a-c8d9-4d6a-b10d-b3b4f8ed0550 tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Lock "cinder-bcb7cfa2-55fc-43a0-9a51-aa89ec3bb8b2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:36 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-7138ff2a-c8d9-4d6a-b10d-b3b4f8ed0550 tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Acquiring lock "cinder-quobyte-7187875d-82bf-41de-8810-86d3fe4cd25e" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3e96038d-fdaa-4c88-95c1-c583f159cd91 tempest-CreateVolumesFromImageTest-357588858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (097edac3-d73c-4f0d-b3d1-c22134d38454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-907877659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=804c99fc-8448-4685-8bbd-f46eb6a5d45f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5977798111d44e71a0808e2def704099',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:37Z,use_quota=True,user_id='ee6ce2cf4fec4c74a05e734d69980ae9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3e96038d-fdaa-4c88-95c1-c583f159cd91 tempest-CreateVolumesFromImageTest-357588858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (577fd7b9-db79-463b-8aa5-e1f05d1f4d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3e96038d-fdaa-4c88-95c1-c583f159cd91 tempest-CreateVolumesFromImageTest-357588858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (577fd7b9-db79-463b-8aa5-e1f05d1f4d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3e96038d-fdaa-4c88-95c1-c583f159cd91 tempest-CreateVolumesFromImageTest-357588858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24358138-0fdb-4484-a0f1-625d542dd802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3e96038d-fdaa-4c88-95c1-c583f159cd91 tempest-CreateVolumesFromImageTest-357588858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24358138-0fdb-4484-a0f1-625d542dd802) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '804c99fc-8448-4685-8bbd-f46eb6a5d45f', 'volume_name': 'volume-804c99fc-8448-4685-8bbd-f46eb6a5d45f', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3e96038d-fdaa-4c88-95c1-c583f159cd91 tempest-CreateVolumesFromImageTest-357588858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3652c09c-a059-488d-b487-7bc3ea41fa28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3e96038d-fdaa-4c88-95c1-c583f159cd91 tempest-CreateVolumesFromImageTest-357588858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3652c09c-a059-488d-b487-7bc3ea41fa28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3e96038d-fdaa-4c88-95c1-c583f159cd91 tempest-CreateVolumesFromImageTest-357588858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b51cd1e-35e3-4889-86e5-6666b8ab7495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:37 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-3e96038d-fdaa-4c88-95c1-c583f159cd91 tempest-CreateVolumesFromImageTest-357588858 None] Volume 804c99fc-8448-4685-8bbd-f46eb6a5d45f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-804c99fc-8448-4685-8bbd-f46eb6a5d45f', 'volume_size': 1} Sep 23 00:29:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-3e96038d-fdaa-4c88-95c1-c583f159cd91 tempest-CreateVolumesFromImageTest-357588858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:37 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-7138ff2a-c8d9-4d6a-b10d-b3b4f8ed0550 tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Lock "cinder-quobyte-7187875d-82bf-41de-8810-86d3fe4cd25e" acquired by "delete_snapshot" :: waited 0.085s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:37 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-7138ff2a-c8d9-4d6a-b10d-b3b4f8ed0550 tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Acquiring lock "cinder-quobyte-bcb7cfa2-55fc-43a0-9a51-aa89ec3bb8b2" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:37 devstack sudo[104410]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:37 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-7138ff2a-c8d9-4d6a-b10d-b3b4f8ed0550 tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Lock "cinder-quobyte-bcb7cfa2-55fc-43a0-9a51-aa89ec3bb8b2" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-7138ff2a-c8d9-4d6a-b10d-b3b4f8ed0550 tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Deleting offline snapshot bcb7cfa2-55fc-43a0-9a51-aa89ec3bb8b2 of volume 7187875d-82bf-41de-8810-86d3fe4cd25e {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:29:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-7138ff2a-c8d9-4d6a-b10d-b3b4f8ed0550 tempest-VolumesSnapshotNegativeTestJSON-114577576 None] snapshot_file for this snap is: volume-7187875d-82bf-41de-8810-86d3fe4cd25e.bcb7cfa2-55fc-43a0-9a51-aa89ec3bb8b2 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:29:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d7278548-d7fe-4e01-82ac-0a7503199a85 tempest-CreateVolumesFromImageTest-357588858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6263a5d6-750e-4ba5-8430-854c37895e31" returned: 0 in 0.468s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d7278548-d7fe-4e01-82ac-0a7503199a85 tempest-CreateVolumesFromImageTest-357588858 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:29:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d7278548-d7fe-4e01-82ac-0a7503199a85 tempest-CreateVolumesFromImageTest-357588858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f0f7fcf7-b85c-4661-b5a7-b6dd9076577c tempest-CreateVolumesFromImageTest-357588858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.642s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f0f7fcf7-b85c-4661-b5a7-b6dd9076577c tempest-CreateVolumesFromImageTest-357588858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1288063799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fb5cd20-2023-4809-9807-81af1240d2ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5977798111d44e71a0808e2def704099',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:36Z,use_quota=True,user_id='ee6ce2cf4fec4c74a05e734d69980ae9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:29:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-f0f7fcf7-b85c-4661-b5a7-b6dd9076577c tempest-CreateVolumesFromImageTest-357588858 None] Creating volume 3fb5cd20-2023-4809-9807-81af1240d2ae {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:29:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f0f7fcf7-b85c-4661-b5a7-b6dd9076577c tempest-CreateVolumesFromImageTest-357588858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f0f7fcf7-b85c-4661-b5a7-b6dd9076577c tempest-CreateVolumesFromImageTest-357588858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f0f7fcf7-b85c-4661-b5a7-b6dd9076577c tempest-CreateVolumesFromImageTest-357588858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f0f7fcf7-b85c-4661-b5a7-b6dd9076577c tempest-CreateVolumesFromImageTest-357588858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f0f7fcf7-b85c-4661-b5a7-b6dd9076577c tempest-CreateVolumesFromImageTest-357588858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f0f7fcf7-b85c-4661-b5a7-b6dd9076577c tempest-CreateVolumesFromImageTest-357588858 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:29:37 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-f0f7fcf7-b85c-4661-b5a7-b6dd9076577c tempest-CreateVolumesFromImageTest-357588858 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:29:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f0f7fcf7-b85c-4661-b5a7-b6dd9076577c tempest-CreateVolumesFromImageTest-357588858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fb5cd20-2023-4809-9807-81af1240d2ae 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:37 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be83b2e-aca1-43e9-aec3-b2922eb86878]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7138ff2a-c8d9-4d6a-b10d-b3b4f8ed0550 tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7187875d-82bf-41de-8810-86d3fe4cd25e.bcb7cfa2-55fc-43a0-9a51-aa89ec3bb8b2 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d7278548-d7fe-4e01-82ac-0a7503199a85 tempest-CreateVolumesFromImageTest-357588858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b410bf5a-ea5d-4be5-92fb-87a8a3f7219c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6263a5d6-750e-4ba5-8430-854c37895e31', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d7278548-d7fe-4e01-82ac-0a7503199a85 tempest-CreateVolumesFromImageTest-357588858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1308ac44-b8b8-480d-8127-3eca0065102b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:37 devstack sudo[104413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fb5cd20-2023-4809-9807-81af1240d2ae 1073741824 Sep 23 00:29:37 devstack sudo[104413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:37 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-d7278548-d7fe-4e01-82ac-0a7503199a85 tempest-CreateVolumesFromImageTest-357588858 None] Volume volume-6263a5d6-750e-4ba5-8430-854c37895e31 (6263a5d6-750e-4ba5-8430-854c37895e31): created successfully Sep 23 00:29:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d7278548-d7fe-4e01-82ac-0a7503199a85 tempest-CreateVolumesFromImageTest-357588858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1308ac44-b8b8-480d-8127-3eca0065102b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d7278548-d7fe-4e01-82ac-0a7503199a85 tempest-CreateVolumesFromImageTest-357588858 None] Flow 'volume_create_manager' (32b696d7-ed14-4648-86df-0d6dd919f9f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:37 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-d7278548-d7fe-4e01-82ac-0a7503199a85 tempest-CreateVolumesFromImageTest-357588858 None] Created volume successfully. Sep 23 00:29:37 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4691a3e-2403-4124-8177-2503395be807 tempest-CreateVolumesFromImageTest-357588858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:29:37 devstack sudo[104414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7187875d-82bf-41de-8810-86d3fe4cd25e.bcb7cfa2-55fc-43a0-9a51-aa89ec3bb8b2 Sep 23 00:29:37 devstack sudo[104414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c4691a3e-2403-4124-8177-2503395be807 tempest-CreateVolumesFromImageTest-357588858 None] Flow 'volume_create_manager' (717756bb-2273-4947-8552-6b132f85d77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c4691a3e-2403-4124-8177-2503395be807 tempest-CreateVolumesFromImageTest-357588858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10c13689-8b32-4f05-ba27-fa471028cb21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c4691a3e-2403-4124-8177-2503395be807 tempest-CreateVolumesFromImageTest-357588858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10c13689-8b32-4f05-ba27-fa471028cb21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:29:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1513361123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dbfb651-533b-42f7-8722-20a3f994b809,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5977798111d44e71a0808e2def704099',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:37Z,use_quota=True,user_id='ee6ce2cf4fec4c74a05e734d69980ae9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c4691a3e-2403-4124-8177-2503395be807 tempest-CreateVolumesFromImageTest-357588858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0546049-a9bf-42ba-bb55-052b4b507d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c4691a3e-2403-4124-8177-2503395be807 tempest-CreateVolumesFromImageTest-357588858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0546049-a9bf-42ba-bb55-052b4b507d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c4691a3e-2403-4124-8177-2503395be807 tempest-CreateVolumesFromImageTest-357588858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e502b44-9471-4b98-bb4f-74c1f76d87b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c4691a3e-2403-4124-8177-2503395be807 tempest-CreateVolumesFromImageTest-357588858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e502b44-9471-4b98-bb4f-74c1f76d87b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7dbfb651-533b-42f7-8722-20a3f994b809', 'volume_name': 'volume-7dbfb651-533b-42f7-8722-20a3f994b809', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c4691a3e-2403-4124-8177-2503395be807 tempest-CreateVolumesFromImageTest-357588858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05e783dc-1ea1-4a9a-b52a-7c5802648248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c4691a3e-2403-4124-8177-2503395be807 tempest-CreateVolumesFromImageTest-357588858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05e783dc-1ea1-4a9a-b52a-7c5802648248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c4691a3e-2403-4124-8177-2503395be807 tempest-CreateVolumesFromImageTest-357588858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d630d14-f3bf-4d04-acab-823b98b54d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:37 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-c4691a3e-2403-4124-8177-2503395be807 tempest-CreateVolumesFromImageTest-357588858 None] Volume 7dbfb651-533b-42f7-8722-20a3f994b809: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7dbfb651-533b-42f7-8722-20a3f994b809', 'volume_size': 1} Sep 23 00:29:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c4691a3e-2403-4124-8177-2503395be807 tempest-CreateVolumesFromImageTest-357588858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:37 devstack sudo[104414]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7138ff2a-c8d9-4d6a-b10d-b3b4f8ed0550 tempest-VolumesSnapshotNegativeTestJSON-114577576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7187875d-82bf-41de-8810-86d3fe4cd25e.bcb7cfa2-55fc-43a0-9a51-aa89ec3bb8b2" returned: 0 in 0.616s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-7138ff2a-c8d9-4d6a-b10d-b3b4f8ed0550 tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7187875d-82bf-41de-8810-86d3fe4cd25e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:29:37 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f85c06-bbb9-416a-9291-07e2b22c954f]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7138ff2a-c8d9-4d6a-b10d-b3b4f8ed0550 tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7187875d-82bf-41de-8810-86d3fe4cd25e {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:37 devstack sudo[104413]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f0f7fcf7-b85c-4661-b5a7-b6dd9076577c tempest-CreateVolumesFromImageTest-357588858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fb5cd20-2023-4809-9807-81af1240d2ae 1073741824" returned: 0 in 0.720s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f0f7fcf7-b85c-4661-b5a7-b6dd9076577c tempest-CreateVolumesFromImageTest-357588858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fb5cd20-2023-4809-9807-81af1240d2ae {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:37 devstack sudo[104426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fb5cd20-2023-4809-9807-81af1240d2ae Sep 23 00:29:37 devstack sudo[104426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:37 devstack sudo[104425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7187875d-82bf-41de-8810-86d3fe4cd25e Sep 23 00:29:37 devstack sudo[104425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:37 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-747bfc06-7625-42ca-98d3-5c5a1181fd0d tempest-CreateVolumesFromImageTest-357588858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:29:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-747bfc06-7625-42ca-98d3-5c5a1181fd0d tempest-CreateVolumesFromImageTest-357588858 None] Flow 'volume_create_manager' (38aa3125-9ac0-4d8c-bc58-4e4493ad989a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-747bfc06-7625-42ca-98d3-5c5a1181fd0d tempest-CreateVolumesFromImageTest-357588858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb702325-b61e-4603-955e-90ecfc8723a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:38 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-747bfc06-7625-42ca-98d3-5c5a1181fd0d tempest-CreateVolumesFromImageTest-357588858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb702325-b61e-4603-955e-90ecfc8723a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:29:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1709481153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70bfcc06-d8b9-4d37-be8f-d888c19cb799,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5977798111d44e71a0808e2def704099',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:38Z,use_quota=True,user_id='ee6ce2cf4fec4c74a05e734d69980ae9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:38 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-747bfc06-7625-42ca-98d3-5c5a1181fd0d tempest-CreateVolumesFromImageTest-357588858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0118062b-6dac-4614-ad50-e50c526cf757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:38 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-747bfc06-7625-42ca-98d3-5c5a1181fd0d tempest-CreateVolumesFromImageTest-357588858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0118062b-6dac-4614-ad50-e50c526cf757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:38 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-747bfc06-7625-42ca-98d3-5c5a1181fd0d tempest-CreateVolumesFromImageTest-357588858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8e2aab1-17b5-4c15-bb85-44ee5afb9070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:38 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-747bfc06-7625-42ca-98d3-5c5a1181fd0d tempest-CreateVolumesFromImageTest-357588858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8e2aab1-17b5-4c15-bb85-44ee5afb9070) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70bfcc06-d8b9-4d37-be8f-d888c19cb799', 'volume_name': 'volume-70bfcc06-d8b9-4d37-be8f-d888c19cb799', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:38 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-747bfc06-7625-42ca-98d3-5c5a1181fd0d tempest-CreateVolumesFromImageTest-357588858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e77f1036-2259-43cb-9a6f-0f6c07b57682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:38 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-747bfc06-7625-42ca-98d3-5c5a1181fd0d tempest-CreateVolumesFromImageTest-357588858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e77f1036-2259-43cb-9a6f-0f6c07b57682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:38 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-747bfc06-7625-42ca-98d3-5c5a1181fd0d tempest-CreateVolumesFromImageTest-357588858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a13a07ab-803d-4731-87cb-0f0b90373baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:38 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-747bfc06-7625-42ca-98d3-5c5a1181fd0d tempest-CreateVolumesFromImageTest-357588858 None] Volume 70bfcc06-d8b9-4d37-be8f-d888c19cb799: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70bfcc06-d8b9-4d37-be8f-d888c19cb799', 'volume_size': 1} Sep 23 00:29:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-747bfc06-7625-42ca-98d3-5c5a1181fd0d tempest-CreateVolumesFromImageTest-357588858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:38 devstack sudo[104426]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f0f7fcf7-b85c-4661-b5a7-b6dd9076577c tempest-CreateVolumesFromImageTest-357588858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fb5cd20-2023-4809-9807-81af1240d2ae" returned: 0 in 0.309s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:38 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f0f7fcf7-b85c-4661-b5a7-b6dd9076577c tempest-CreateVolumesFromImageTest-357588858 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:29:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f0f7fcf7-b85c-4661-b5a7-b6dd9076577c tempest-CreateVolumesFromImageTest-357588858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-3e96038d-fdaa-4c88-95c1-c583f159cd91 tempest-CreateVolumesFromImageTest-357588858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.188s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:38 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-3e96038d-fdaa-4c88-95c1-c583f159cd91 tempest-CreateVolumesFromImageTest-357588858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-907877659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=804c99fc-8448-4685-8bbd-f46eb6a5d45f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5977798111d44e71a0808e2def704099',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:37Z,use_quota=True,user_id='ee6ce2cf4fec4c74a05e734d69980ae9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:29:38 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-3e96038d-fdaa-4c88-95c1-c583f159cd91 tempest-CreateVolumesFromImageTest-357588858 None] Creating volume 804c99fc-8448-4685-8bbd-f46eb6a5d45f {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:29:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-3e96038d-fdaa-4c88-95c1-c583f159cd91 tempest-CreateVolumesFromImageTest-357588858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-3e96038d-fdaa-4c88-95c1-c583f159cd91 tempest-CreateVolumesFromImageTest-357588858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:38 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-3e96038d-fdaa-4c88-95c1-c583f159cd91 tempest-CreateVolumesFromImageTest-357588858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:38 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-3e96038d-fdaa-4c88-95c1-c583f159cd91 tempest-CreateVolumesFromImageTest-357588858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-3e96038d-fdaa-4c88-95c1-c583f159cd91 tempest-CreateVolumesFromImageTest-357588858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:38 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-3e96038d-fdaa-4c88-95c1-c583f159cd91 tempest-CreateVolumesFromImageTest-357588858 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:29:38 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-3e96038d-fdaa-4c88-95c1-c583f159cd91 tempest-CreateVolumesFromImageTest-357588858 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:29:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3e96038d-fdaa-4c88-95c1-c583f159cd91 tempest-CreateVolumesFromImageTest-357588858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-804c99fc-8448-4685-8bbd-f46eb6a5d45f 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:38 devstack sudo[104425]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7138ff2a-c8d9-4d6a-b10d-b3b4f8ed0550 tempest-VolumesSnapshotNegativeTestJSON-114577576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7187875d-82bf-41de-8810-86d3fe4cd25e" returned: 0 in 0.443s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7138ff2a-c8d9-4d6a-b10d-b3b4f8ed0550 tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7187875d-82bf-41de-8810-86d3fe4cd25e.bcb7cfa2-55fc-43a0-9a51-aa89ec3bb8b2 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:38 devstack sudo[104433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-804c99fc-8448-4685-8bbd-f46eb6a5d45f 1073741824 Sep 23 00:29:38 devstack sudo[104433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:38 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f0f7fcf7-b85c-4661-b5a7-b6dd9076577c tempest-CreateVolumesFromImageTest-357588858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d4396da-973a-474d-9389-06d37da2b079) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fb5cd20-2023-4809-9807-81af1240d2ae', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:38 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f0f7fcf7-b85c-4661-b5a7-b6dd9076577c tempest-CreateVolumesFromImageTest-357588858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c8aab4d-fbd9-4884-91c2-6189c4c12aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:38 devstack sudo[104434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7187875d-82bf-41de-8810-86d3fe4cd25e.bcb7cfa2-55fc-43a0-9a51-aa89ec3bb8b2 Sep 23 00:29:38 devstack sudo[104434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:38 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-f0f7fcf7-b85c-4661-b5a7-b6dd9076577c tempest-CreateVolumesFromImageTest-357588858 None] Volume volume-3fb5cd20-2023-4809-9807-81af1240d2ae (3fb5cd20-2023-4809-9807-81af1240d2ae): created successfully Sep 23 00:29:38 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f0f7fcf7-b85c-4661-b5a7-b6dd9076577c tempest-CreateVolumesFromImageTest-357588858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c8aab4d-fbd9-4884-91c2-6189c4c12aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:38 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f0f7fcf7-b85c-4661-b5a7-b6dd9076577c tempest-CreateVolumesFromImageTest-357588858 None] Flow 'volume_create_manager' (d15aface-9a8e-4cb2-b172-6e5fd8eaddd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:38 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-f0f7fcf7-b85c-4661-b5a7-b6dd9076577c tempest-CreateVolumesFromImageTest-357588858 None] Created volume successfully. Sep 23 00:29:38 devstack sudo[104434]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7138ff2a-c8d9-4d6a-b10d-b3b4f8ed0550 tempest-VolumesSnapshotNegativeTestJSON-114577576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7187875d-82bf-41de-8810-86d3fe4cd25e.bcb7cfa2-55fc-43a0-9a51-aa89ec3bb8b2" returned: 0 in 0.424s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7138ff2a-c8d9-4d6a-b10d-b3b4f8ed0550 tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7187875d-82bf-41de-8810-86d3fe4cd25e.bcb7cfa2-55fc-43a0-9a51-aa89ec3bb8b2 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:38 devstack sudo[104445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7187875d-82bf-41de-8810-86d3fe4cd25e.bcb7cfa2-55fc-43a0-9a51-aa89ec3bb8b2 Sep 23 00:29:38 devstack sudo[104445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:38 devstack sudo[104433]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3e96038d-fdaa-4c88-95c1-c583f159cd91 tempest-CreateVolumesFromImageTest-357588858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-804c99fc-8448-4685-8bbd-f46eb6a5d45f 1073741824" returned: 0 in 0.552s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3e96038d-fdaa-4c88-95c1-c583f159cd91 tempest-CreateVolumesFromImageTest-357588858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-804c99fc-8448-4685-8bbd-f46eb6a5d45f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:38 devstack sudo[104447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-804c99fc-8448-4685-8bbd-f46eb6a5d45f Sep 23 00:29:38 devstack sudo[104447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:39 devstack sudo[104445]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7138ff2a-c8d9-4d6a-b10d-b3b4f8ed0550 tempest-VolumesSnapshotNegativeTestJSON-114577576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7187875d-82bf-41de-8810-86d3fe4cd25e.bcb7cfa2-55fc-43a0-9a51-aa89ec3bb8b2" returned: 0 in 0.332s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:39 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-7138ff2a-c8d9-4d6a-b10d-b3b4f8ed0550 tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Lock "cinder-quobyte-bcb7cfa2-55fc-43a0-9a51-aa89ec3bb8b2" released by "_delete_snapshot" :: held 2.028s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:39 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-7138ff2a-c8d9-4d6a-b10d-b3b4f8ed0550 tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Lock "cinder-quobyte-7187875d-82bf-41de-8810-86d3fe4cd25e" released by "delete_snapshot" :: held 2.059s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:39 devstack sudo[104447]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3e96038d-fdaa-4c88-95c1-c583f159cd91 tempest-CreateVolumesFromImageTest-357588858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-804c99fc-8448-4685-8bbd-f46eb6a5d45f" returned: 0 in 0.297s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:39 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-3e96038d-fdaa-4c88-95c1-c583f159cd91 tempest-CreateVolumesFromImageTest-357588858 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:29:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-3e96038d-fdaa-4c88-95c1-c583f159cd91 tempest-CreateVolumesFromImageTest-357588858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c4691a3e-2403-4124-8177-2503395be807 tempest-CreateVolumesFromImageTest-357588858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.722s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:39 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c4691a3e-2403-4124-8177-2503395be807 tempest-CreateVolumesFromImageTest-357588858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:29:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1513361123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dbfb651-533b-42f7-8722-20a3f994b809,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5977798111d44e71a0808e2def704099',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:37Z,use_quota=True,user_id='ee6ce2cf4fec4c74a05e734d69980ae9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:29:39 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-c4691a3e-2403-4124-8177-2503395be807 tempest-CreateVolumesFromImageTest-357588858 None] Creating volume 7dbfb651-533b-42f7-8722-20a3f994b809 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:29:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c4691a3e-2403-4124-8177-2503395be807 tempest-CreateVolumesFromImageTest-357588858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c4691a3e-2403-4124-8177-2503395be807 tempest-CreateVolumesFromImageTest-357588858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:39 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c4691a3e-2403-4124-8177-2503395be807 tempest-CreateVolumesFromImageTest-357588858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:39 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c4691a3e-2403-4124-8177-2503395be807 tempest-CreateVolumesFromImageTest-357588858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c4691a3e-2403-4124-8177-2503395be807 tempest-CreateVolumesFromImageTest-357588858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:39 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c4691a3e-2403-4124-8177-2503395be807 tempest-CreateVolumesFromImageTest-357588858 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:29:39 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-c4691a3e-2403-4124-8177-2503395be807 tempest-CreateVolumesFromImageTest-357588858 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:29:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c4691a3e-2403-4124-8177-2503395be807 tempest-CreateVolumesFromImageTest-357588858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7dbfb651-533b-42f7-8722-20a3f994b809 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:39 devstack sudo[104451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7dbfb651-533b-42f7-8722-20a3f994b809 1073741824 Sep 23 00:29:39 devstack sudo[104451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3e96038d-fdaa-4c88-95c1-c583f159cd91 tempest-CreateVolumesFromImageTest-357588858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b51cd1e-35e3-4889-86e5-6666b8ab7495) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-804c99fc-8448-4685-8bbd-f46eb6a5d45f', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3e96038d-fdaa-4c88-95c1-c583f159cd91 tempest-CreateVolumesFromImageTest-357588858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a55f1a11-1a6d-4f98-a8d0-66d15ffa5c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:39 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-3e96038d-fdaa-4c88-95c1-c583f159cd91 tempest-CreateVolumesFromImageTest-357588858 None] Volume volume-804c99fc-8448-4685-8bbd-f46eb6a5d45f (804c99fc-8448-4685-8bbd-f46eb6a5d45f): created successfully Sep 23 00:29:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3e96038d-fdaa-4c88-95c1-c583f159cd91 tempest-CreateVolumesFromImageTest-357588858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a55f1a11-1a6d-4f98-a8d0-66d15ffa5c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3e96038d-fdaa-4c88-95c1-c583f159cd91 tempest-CreateVolumesFromImageTest-357588858 None] Flow 'volume_create_manager' (4fbf1ba9-b87b-4030-917b-e334acba38e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:39 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-3e96038d-fdaa-4c88-95c1-c583f159cd91 tempest-CreateVolumesFromImageTest-357588858 None] Created volume successfully. Sep 23 00:29:39 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-7138ff2a-c8d9-4d6a-b10d-b3b4f8ed0550 tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Created reservations ['09c66f6e-2956-4006-9584-0a1a3adfa256', 'cfa63672-5b7a-41ac-9b3e-cd44867c1958', '43edb0dd-c738-468b-b914-3145957afc76', '6b5279a6-ff4d-4586-ad96-aedb85d448ca'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:29:39 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-7138ff2a-c8d9-4d6a-b10d-b3b4f8ed0550 tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Delete snapshot completed successfully. Sep 23 00:29:39 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-7138ff2a-c8d9-4d6a-b10d-b3b4f8ed0550 tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Lock "cinder-bcb7cfa2-55fc-43a0-9a51-aa89ec3bb8b2-delete_snapshot" released by "delete_snapshot" :: held 2.366s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:39 devstack sudo[104451]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c4691a3e-2403-4124-8177-2503395be807 tempest-CreateVolumesFromImageTest-357588858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7dbfb651-533b-42f7-8722-20a3f994b809 1073741824" returned: 0 in 0.484s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c4691a3e-2403-4124-8177-2503395be807 tempest-CreateVolumesFromImageTest-357588858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7dbfb651-533b-42f7-8722-20a3f994b809 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:39 devstack sudo[104456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7dbfb651-533b-42f7-8722-20a3f994b809 Sep 23 00:29:39 devstack sudo[104456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:39 devstack sudo[104456]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c4691a3e-2403-4124-8177-2503395be807 tempest-CreateVolumesFromImageTest-357588858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7dbfb651-533b-42f7-8722-20a3f994b809" returned: 0 in 0.263s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:39 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c4691a3e-2403-4124-8177-2503395be807 tempest-CreateVolumesFromImageTest-357588858 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:29:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c4691a3e-2403-4124-8177-2503395be807 tempest-CreateVolumesFromImageTest-357588858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-747bfc06-7625-42ca-98d3-5c5a1181fd0d tempest-CreateVolumesFromImageTest-357588858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.875s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:39 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-747bfc06-7625-42ca-98d3-5c5a1181fd0d tempest-CreateVolumesFromImageTest-357588858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:29:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1709481153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70bfcc06-d8b9-4d37-be8f-d888c19cb799,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5977798111d44e71a0808e2def704099',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:38Z,use_quota=True,user_id='ee6ce2cf4fec4c74a05e734d69980ae9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:29:39 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-747bfc06-7625-42ca-98d3-5c5a1181fd0d tempest-CreateVolumesFromImageTest-357588858 None] Creating volume 70bfcc06-d8b9-4d37-be8f-d888c19cb799 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:29:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-747bfc06-7625-42ca-98d3-5c5a1181fd0d tempest-CreateVolumesFromImageTest-357588858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-747bfc06-7625-42ca-98d3-5c5a1181fd0d tempest-CreateVolumesFromImageTest-357588858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:39 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-747bfc06-7625-42ca-98d3-5c5a1181fd0d tempest-CreateVolumesFromImageTest-357588858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:39 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-747bfc06-7625-42ca-98d3-5c5a1181fd0d tempest-CreateVolumesFromImageTest-357588858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-747bfc06-7625-42ca-98d3-5c5a1181fd0d tempest-CreateVolumesFromImageTest-357588858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:39 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-747bfc06-7625-42ca-98d3-5c5a1181fd0d tempest-CreateVolumesFromImageTest-357588858 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:29:39 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-747bfc06-7625-42ca-98d3-5c5a1181fd0d tempest-CreateVolumesFromImageTest-357588858 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:29:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-747bfc06-7625-42ca-98d3-5c5a1181fd0d tempest-CreateVolumesFromImageTest-357588858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-70bfcc06-d8b9-4d37-be8f-d888c19cb799 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c4691a3e-2403-4124-8177-2503395be807 tempest-CreateVolumesFromImageTest-357588858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d630d14-f3bf-4d04-acab-823b98b54d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dbfb651-533b-42f7-8722-20a3f994b809', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:39 devstack sudo[104459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-70bfcc06-d8b9-4d37-be8f-d888c19cb799 1073741824 Sep 23 00:29:39 devstack sudo[104459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c4691a3e-2403-4124-8177-2503395be807 tempest-CreateVolumesFromImageTest-357588858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (863cd9d9-8947-4676-ae5f-d591dfa7e336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:39 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-c4691a3e-2403-4124-8177-2503395be807 tempest-CreateVolumesFromImageTest-357588858 None] Volume volume-7dbfb651-533b-42f7-8722-20a3f994b809 (7dbfb651-533b-42f7-8722-20a3f994b809): created successfully Sep 23 00:29:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c4691a3e-2403-4124-8177-2503395be807 tempest-CreateVolumesFromImageTest-357588858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (863cd9d9-8947-4676-ae5f-d591dfa7e336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:39 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c4691a3e-2403-4124-8177-2503395be807 tempest-CreateVolumesFromImageTest-357588858 None] Flow 'volume_create_manager' (717756bb-2273-4947-8552-6b132f85d77a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:40 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-c4691a3e-2403-4124-8177-2503395be807 tempest-CreateVolumesFromImageTest-357588858 None] Created volume successfully. Sep 23 00:29:40 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-25b2c786-685a-4991-84e2-b9213c8a019f tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Acquiring lock "cinder-7187875d-82bf-41de-8810-86d3fe4cd25e-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:40 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-25b2c786-685a-4991-84e2-b9213c8a019f tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Lock "cinder-7187875d-82bf-41de-8810-86d3fe4cd25e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:40 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-25b2c786-685a-4991-84e2-b9213c8a019f tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Acquiring lock "cinder-quobyte-7187875d-82bf-41de-8810-86d3fe4cd25e" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:40 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-25b2c786-685a-4991-84e2-b9213c8a019f tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Lock "cinder-quobyte-7187875d-82bf-41de-8810-86d3fe4cd25e" acquired by "delete_volume" :: waited 0.026s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:40 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60b5597-be75-4c22-a43d-ece7ca8ec61a]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-25b2c786-685a-4991-84e2-b9213c8a019f tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7187875d-82bf-41de-8810-86d3fe4cd25e {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:40 devstack sudo[104459]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-747bfc06-7625-42ca-98d3-5c5a1181fd0d tempest-CreateVolumesFromImageTest-357588858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-70bfcc06-d8b9-4d37-be8f-d888c19cb799 1073741824" returned: 0 in 0.566s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-747bfc06-7625-42ca-98d3-5c5a1181fd0d tempest-CreateVolumesFromImageTest-357588858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-70bfcc06-d8b9-4d37-be8f-d888c19cb799 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:40 devstack sudo[104465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7187875d-82bf-41de-8810-86d3fe4cd25e Sep 23 00:29:40 devstack sudo[104465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:40 devstack sudo[104466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-70bfcc06-d8b9-4d37-be8f-d888c19cb799 Sep 23 00:29:40 devstack sudo[104466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:40 devstack sudo[104466]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-747bfc06-7625-42ca-98d3-5c5a1181fd0d tempest-CreateVolumesFromImageTest-357588858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-70bfcc06-d8b9-4d37-be8f-d888c19cb799" returned: 0 in 0.305s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:40 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-747bfc06-7625-42ca-98d3-5c5a1181fd0d tempest-CreateVolumesFromImageTest-357588858 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:29:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-747bfc06-7625-42ca-98d3-5c5a1181fd0d tempest-CreateVolumesFromImageTest-357588858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:40 devstack sudo[104465]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-747bfc06-7625-42ca-98d3-5c5a1181fd0d tempest-CreateVolumesFromImageTest-357588858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a13a07ab-803d-4731-87cb-0f0b90373baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70bfcc06-d8b9-4d37-be8f-d888c19cb799', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-747bfc06-7625-42ca-98d3-5c5a1181fd0d tempest-CreateVolumesFromImageTest-357588858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72757e3e-28d8-47e3-9564-b293edd2c684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-25b2c786-685a-4991-84e2-b9213c8a019f tempest-VolumesSnapshotNegativeTestJSON-114577576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7187875d-82bf-41de-8810-86d3fe4cd25e" returned: 0 in 0.472s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-25b2c786-685a-4991-84e2-b9213c8a019f tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7187875d-82bf-41de-8810-86d3fe4cd25e {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:40 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-747bfc06-7625-42ca-98d3-5c5a1181fd0d tempest-CreateVolumesFromImageTest-357588858 None] Volume volume-70bfcc06-d8b9-4d37-be8f-d888c19cb799 (70bfcc06-d8b9-4d37-be8f-d888c19cb799): created successfully Sep 23 00:29:40 devstack sudo[104473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7187875d-82bf-41de-8810-86d3fe4cd25e Sep 23 00:29:40 devstack sudo[104473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-747bfc06-7625-42ca-98d3-5c5a1181fd0d tempest-CreateVolumesFromImageTest-357588858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72757e3e-28d8-47e3-9564-b293edd2c684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-747bfc06-7625-42ca-98d3-5c5a1181fd0d tempest-CreateVolumesFromImageTest-357588858 None] Flow 'volume_create_manager' (38aa3125-9ac0-4d8c-bc58-4e4493ad989a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:40 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-747bfc06-7625-42ca-98d3-5c5a1181fd0d tempest-CreateVolumesFromImageTest-357588858 None] Created volume successfully. Sep 23 00:29:41 devstack sudo[104473]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-25b2c786-685a-4991-84e2-b9213c8a019f tempest-VolumesSnapshotNegativeTestJSON-114577576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7187875d-82bf-41de-8810-86d3fe4cd25e" returned: 0 in 0.305s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:41 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-25b2c786-685a-4991-84e2-b9213c8a019f tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Lock "cinder-quobyte-7187875d-82bf-41de-8810-86d3fe4cd25e" released by "delete_volume" :: held 0.848s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:41 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-25b2c786-685a-4991-84e2-b9213c8a019f tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Created reservations ['6ccd5c42-1e79-4615-88cf-2d3e01abdcae', 'f9079774-1bed-4390-bf36-1ef00af89bc5', 'c9db590c-3c55-477f-89e3-0b5988da3f33', '8b649b45-d5ca-4f32-89aa-70b311a72653'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:29:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-25b2c786-685a-4991-84e2-b9213c8a019f tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-25b2c786-685a-4991-84e2-b9213c8a019f tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-25b2c786-685a-4991-84e2-b9213c8a019f tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-25b2c786-685a-4991-84e2-b9213c8a019f tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-25b2c786-685a-4991-84e2-b9213c8a019f tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-25b2c786-685a-4991-84e2-b9213c8a019f tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:41 devstack sudo[104476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:29:41 devstack sudo[104476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:41 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-34aacfb7-075c-4c87-b18e-24360e8d1301 tempest-CreateVolumesFromImageTest-357588858 None] Acquiring lock "cinder-70bfcc06-d8b9-4d37-be8f-d888c19cb799-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:41 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-34aacfb7-075c-4c87-b18e-24360e8d1301 tempest-CreateVolumesFromImageTest-357588858 None] Lock "cinder-70bfcc06-d8b9-4d37-be8f-d888c19cb799-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:41 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-34aacfb7-075c-4c87-b18e-24360e8d1301 tempest-CreateVolumesFromImageTest-357588858 None] Acquiring lock "cinder-quobyte-70bfcc06-d8b9-4d37-be8f-d888c19cb799" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:41 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-34aacfb7-075c-4c87-b18e-24360e8d1301 tempest-CreateVolumesFromImageTest-357588858 None] Lock "cinder-quobyte-70bfcc06-d8b9-4d37-be8f-d888c19cb799" acquired by "delete_volume" :: waited 0.018s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:41 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7c30a9-4fd5-4d3b-a03f-0feeb375f21b]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-34aacfb7-075c-4c87-b18e-24360e8d1301 tempest-CreateVolumesFromImageTest-357588858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-70bfcc06-d8b9-4d37-be8f-d888c19cb799 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:41 devstack sudo[104476]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-25b2c786-685a-4991-84e2-b9213c8a019f tempest-VolumesSnapshotNegativeTestJSON-114577576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.400s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:41 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-25b2c786-685a-4991-84e2-b9213c8a019f tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:29:41 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-25b2c786-685a-4991-84e2-b9213c8a019f tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Deleted volume successfully. Sep 23 00:29:41 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-25b2c786-685a-4991-84e2-b9213c8a019f tempest-VolumesSnapshotNegativeTestJSON-114577576 None] Lock "cinder-7187875d-82bf-41de-8810-86d3fe4cd25e-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:41 devstack sudo[104478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-70bfcc06-d8b9-4d37-be8f-d888c19cb799 Sep 23 00:29:41 devstack sudo[104478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:42 devstack sudo[104478]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-34aacfb7-075c-4c87-b18e-24360e8d1301 tempest-CreateVolumesFromImageTest-357588858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-70bfcc06-d8b9-4d37-be8f-d888c19cb799" returned: 0 in 0.462s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-34aacfb7-075c-4c87-b18e-24360e8d1301 tempest-CreateVolumesFromImageTest-357588858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-70bfcc06-d8b9-4d37-be8f-d888c19cb799 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:42 devstack sudo[104484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-70bfcc06-d8b9-4d37-be8f-d888c19cb799 Sep 23 00:29:42 devstack sudo[104484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:42 devstack sudo[104484]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-34aacfb7-075c-4c87-b18e-24360e8d1301 tempest-CreateVolumesFromImageTest-357588858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-70bfcc06-d8b9-4d37-be8f-d888c19cb799" returned: 0 in 0.279s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:42 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-34aacfb7-075c-4c87-b18e-24360e8d1301 tempest-CreateVolumesFromImageTest-357588858 None] Lock "cinder-quobyte-70bfcc06-d8b9-4d37-be8f-d888c19cb799" released by "delete_volume" :: held 0.811s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:42 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-34aacfb7-075c-4c87-b18e-24360e8d1301 tempest-CreateVolumesFromImageTest-357588858 None] Created reservations ['50cc735f-cd39-419a-9f16-c5909bae6b21', '92d33f18-1eab-461b-b39f-4c86646e6fef', '0eef9a72-5d6b-4982-bda0-e2078d6af4e1', '05c98403-c23e-4736-afa4-8fb04b9e1738'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:29:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-34aacfb7-075c-4c87-b18e-24360e8d1301 tempest-CreateVolumesFromImageTest-357588858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-34aacfb7-075c-4c87-b18e-24360e8d1301 tempest-CreateVolumesFromImageTest-357588858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-34aacfb7-075c-4c87-b18e-24360e8d1301 tempest-CreateVolumesFromImageTest-357588858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-34aacfb7-075c-4c87-b18e-24360e8d1301 tempest-CreateVolumesFromImageTest-357588858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-34aacfb7-075c-4c87-b18e-24360e8d1301 tempest-CreateVolumesFromImageTest-357588858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-34aacfb7-075c-4c87-b18e-24360e8d1301 tempest-CreateVolumesFromImageTest-357588858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:42 devstack sudo[104487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:29:42 devstack sudo[104487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:42 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-40e88791-1188-4fac-9fe1-db3133c21d5f tempest-CreateVolumesFromImageTest-357588858 None] Acquiring lock "cinder-7dbfb651-533b-42f7-8722-20a3f994b809-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:42 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-40e88791-1188-4fac-9fe1-db3133c21d5f tempest-CreateVolumesFromImageTest-357588858 None] Lock "cinder-7dbfb651-533b-42f7-8722-20a3f994b809-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:43 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-40e88791-1188-4fac-9fe1-db3133c21d5f tempest-CreateVolumesFromImageTest-357588858 None] Acquiring lock "cinder-quobyte-7dbfb651-533b-42f7-8722-20a3f994b809" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:43 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-40e88791-1188-4fac-9fe1-db3133c21d5f tempest-CreateVolumesFromImageTest-357588858 None] Lock "cinder-quobyte-7dbfb651-533b-42f7-8722-20a3f994b809" acquired by "delete_volume" :: waited 0.022s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:43 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d879077-525e-4ffd-9d2f-9e4b0fee9ee6]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-40e88791-1188-4fac-9fe1-db3133c21d5f tempest-CreateVolumesFromImageTest-357588858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7dbfb651-533b-42f7-8722-20a3f994b809 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:43 devstack sudo[104487]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-34aacfb7-075c-4c87-b18e-24360e8d1301 tempest-CreateVolumesFromImageTest-357588858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.447s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:43 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-34aacfb7-075c-4c87-b18e-24360e8d1301 tempest-CreateVolumesFromImageTest-357588858 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:29:43 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-34aacfb7-075c-4c87-b18e-24360e8d1301 tempest-CreateVolumesFromImageTest-357588858 None] Deleted volume successfully. Sep 23 00:29:43 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-34aacfb7-075c-4c87-b18e-24360e8d1301 tempest-CreateVolumesFromImageTest-357588858 None] Lock "cinder-70bfcc06-d8b9-4d37-be8f-d888c19cb799-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:43 devstack sudo[104490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7dbfb651-533b-42f7-8722-20a3f994b809 Sep 23 00:29:43 devstack sudo[104490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:43 devstack sudo[104490]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-40e88791-1188-4fac-9fe1-db3133c21d5f tempest-CreateVolumesFromImageTest-357588858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7dbfb651-533b-42f7-8722-20a3f994b809" returned: 0 in 0.552s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-40e88791-1188-4fac-9fe1-db3133c21d5f tempest-CreateVolumesFromImageTest-357588858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7dbfb651-533b-42f7-8722-20a3f994b809 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:43 devstack sudo[104495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7dbfb651-533b-42f7-8722-20a3f994b809 Sep 23 00:29:43 devstack sudo[104495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:43 devstack sudo[104495]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-40e88791-1188-4fac-9fe1-db3133c21d5f tempest-CreateVolumesFromImageTest-357588858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7dbfb651-533b-42f7-8722-20a3f994b809" returned: 0 in 0.350s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:44 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-40e88791-1188-4fac-9fe1-db3133c21d5f tempest-CreateVolumesFromImageTest-357588858 None] Lock "cinder-quobyte-7dbfb651-533b-42f7-8722-20a3f994b809" released by "delete_volume" :: held 0.975s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:44 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-40e88791-1188-4fac-9fe1-db3133c21d5f tempest-CreateVolumesFromImageTest-357588858 None] Created reservations ['c1bd06c2-b6d1-4e19-8ba9-f4c720dc95af', 'e6431a5a-0cc5-4a1e-b3b1-0745e4625e77', 'e32915e4-8153-4e68-9ac5-d6516cae3e5c', '51d09cb3-15e9-44b9-842a-47e838aec10c'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:29:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-40e88791-1188-4fac-9fe1-db3133c21d5f tempest-CreateVolumesFromImageTest-357588858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-40e88791-1188-4fac-9fe1-db3133c21d5f tempest-CreateVolumesFromImageTest-357588858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:44 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-40e88791-1188-4fac-9fe1-db3133c21d5f tempest-CreateVolumesFromImageTest-357588858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:44 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-40e88791-1188-4fac-9fe1-db3133c21d5f tempest-CreateVolumesFromImageTest-357588858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-40e88791-1188-4fac-9fe1-db3133c21d5f tempest-CreateVolumesFromImageTest-357588858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-40e88791-1188-4fac-9fe1-db3133c21d5f tempest-CreateVolumesFromImageTest-357588858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:44 devstack sudo[104498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:29:44 devstack sudo[104498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:44 devstack sudo[104498]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-40e88791-1188-4fac-9fe1-db3133c21d5f tempest-CreateVolumesFromImageTest-357588858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.282s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:44 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-40e88791-1188-4fac-9fe1-db3133c21d5f tempest-CreateVolumesFromImageTest-357588858 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:29:44 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-40e88791-1188-4fac-9fe1-db3133c21d5f tempest-CreateVolumesFromImageTest-357588858 None] Deleted volume successfully. Sep 23 00:29:44 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-40e88791-1188-4fac-9fe1-db3133c21d5f tempest-CreateVolumesFromImageTest-357588858 None] Lock "cinder-7dbfb651-533b-42f7-8722-20a3f994b809-delete_volume" released by "delete_volume" :: held 1.548s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:45 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-76086526-a458-4030-a3a3-03e24e38316d tempest-CreateVolumesFromImageTest-357588858 None] Acquiring lock "cinder-804c99fc-8448-4685-8bbd-f46eb6a5d45f-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:45 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-76086526-a458-4030-a3a3-03e24e38316d tempest-CreateVolumesFromImageTest-357588858 None] Lock "cinder-804c99fc-8448-4685-8bbd-f46eb6a5d45f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:45 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-76086526-a458-4030-a3a3-03e24e38316d tempest-CreateVolumesFromImageTest-357588858 None] Acquiring lock "cinder-quobyte-804c99fc-8448-4685-8bbd-f46eb6a5d45f" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:45 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-76086526-a458-4030-a3a3-03e24e38316d tempest-CreateVolumesFromImageTest-357588858 None] Lock "cinder-quobyte-804c99fc-8448-4685-8bbd-f46eb6a5d45f" acquired by "delete_volume" :: waited 0.016s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:45 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[038519ae-103e-4620-9d41-31b78e1d5312]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-76086526-a458-4030-a3a3-03e24e38316d tempest-CreateVolumesFromImageTest-357588858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-804c99fc-8448-4685-8bbd-f46eb6a5d45f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:45 devstack sudo[104501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-804c99fc-8448-4685-8bbd-f46eb6a5d45f Sep 23 00:29:45 devstack sudo[104501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:45 devstack sudo[104501]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-76086526-a458-4030-a3a3-03e24e38316d tempest-CreateVolumesFromImageTest-357588858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-804c99fc-8448-4685-8bbd-f46eb6a5d45f" returned: 0 in 0.414s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-76086526-a458-4030-a3a3-03e24e38316d tempest-CreateVolumesFromImageTest-357588858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-804c99fc-8448-4685-8bbd-f46eb6a5d45f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:45 devstack sudo[104506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-804c99fc-8448-4685-8bbd-f46eb6a5d45f Sep 23 00:29:45 devstack sudo[104506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:46 devstack sudo[104506]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-76086526-a458-4030-a3a3-03e24e38316d tempest-CreateVolumesFromImageTest-357588858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-804c99fc-8448-4685-8bbd-f46eb6a5d45f" returned: 0 in 0.303s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:46 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-76086526-a458-4030-a3a3-03e24e38316d tempest-CreateVolumesFromImageTest-357588858 None] Lock "cinder-quobyte-804c99fc-8448-4685-8bbd-f46eb6a5d45f" released by "delete_volume" :: held 0.774s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:46 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-76086526-a458-4030-a3a3-03e24e38316d tempest-CreateVolumesFromImageTest-357588858 None] Created reservations ['1aae6f44-64ad-4090-b2d9-a4acc5d9829b', '6d6687e9-032d-477f-a27d-7a4589545aef', 'a832f565-7823-4c0a-be8b-5d95802f6b44', '3af47b9d-6e6d-4c4c-bbb1-6acdbbac2ab3'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:29:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-76086526-a458-4030-a3a3-03e24e38316d tempest-CreateVolumesFromImageTest-357588858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-76086526-a458-4030-a3a3-03e24e38316d tempest-CreateVolumesFromImageTest-357588858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-76086526-a458-4030-a3a3-03e24e38316d tempest-CreateVolumesFromImageTest-357588858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-76086526-a458-4030-a3a3-03e24e38316d tempest-CreateVolumesFromImageTest-357588858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-76086526-a458-4030-a3a3-03e24e38316d tempest-CreateVolumesFromImageTest-357588858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-76086526-a458-4030-a3a3-03e24e38316d tempest-CreateVolumesFromImageTest-357588858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:46 devstack sudo[104509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:29:46 devstack sudo[104509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:46 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b980345e-b5a1-4bd2-bb38-f6e5c5a5eddd tempest-CreateVolumesFromImageTest-357588858 None] Acquiring lock "cinder-3fb5cd20-2023-4809-9807-81af1240d2ae-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:46 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b980345e-b5a1-4bd2-bb38-f6e5c5a5eddd tempest-CreateVolumesFromImageTest-357588858 None] Lock "cinder-3fb5cd20-2023-4809-9807-81af1240d2ae-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:46 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b980345e-b5a1-4bd2-bb38-f6e5c5a5eddd tempest-CreateVolumesFromImageTest-357588858 None] Acquiring lock "cinder-quobyte-3fb5cd20-2023-4809-9807-81af1240d2ae" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:46 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b980345e-b5a1-4bd2-bb38-f6e5c5a5eddd tempest-CreateVolumesFromImageTest-357588858 None] Lock "cinder-quobyte-3fb5cd20-2023-4809-9807-81af1240d2ae" acquired by "delete_volume" :: waited 0.028s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:46 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[34075493-e8a0-4764-a817-3801acd1fcde]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b980345e-b5a1-4bd2-bb38-f6e5c5a5eddd tempest-CreateVolumesFromImageTest-357588858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fb5cd20-2023-4809-9807-81af1240d2ae {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:46 devstack sudo[104509]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-76086526-a458-4030-a3a3-03e24e38316d tempest-CreateVolumesFromImageTest-357588858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.424s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:46 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-76086526-a458-4030-a3a3-03e24e38316d tempest-CreateVolumesFromImageTest-357588858 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:29:46 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-76086526-a458-4030-a3a3-03e24e38316d tempest-CreateVolumesFromImageTest-357588858 None] Deleted volume successfully. Sep 23 00:29:46 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-76086526-a458-4030-a3a3-03e24e38316d tempest-CreateVolumesFromImageTest-357588858 None] Lock "cinder-804c99fc-8448-4685-8bbd-f46eb6a5d45f-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:46 devstack sudo[104512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fb5cd20-2023-4809-9807-81af1240d2ae Sep 23 00:29:46 devstack sudo[104512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:47 devstack sudo[104512]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b980345e-b5a1-4bd2-bb38-f6e5c5a5eddd tempest-CreateVolumesFromImageTest-357588858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fb5cd20-2023-4809-9807-81af1240d2ae" returned: 0 in 0.425s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b980345e-b5a1-4bd2-bb38-f6e5c5a5eddd tempest-CreateVolumesFromImageTest-357588858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fb5cd20-2023-4809-9807-81af1240d2ae {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:47 devstack sudo[104518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fb5cd20-2023-4809-9807-81af1240d2ae Sep 23 00:29:47 devstack sudo[104518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:47 devstack sudo[104518]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b980345e-b5a1-4bd2-bb38-f6e5c5a5eddd tempest-CreateVolumesFromImageTest-357588858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fb5cd20-2023-4809-9807-81af1240d2ae" returned: 0 in 0.309s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:47 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b980345e-b5a1-4bd2-bb38-f6e5c5a5eddd tempest-CreateVolumesFromImageTest-357588858 None] Lock "cinder-quobyte-3fb5cd20-2023-4809-9807-81af1240d2ae" released by "delete_volume" :: held 0.811s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:47 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-b980345e-b5a1-4bd2-bb38-f6e5c5a5eddd tempest-CreateVolumesFromImageTest-357588858 None] Created reservations ['49aea16a-4810-4d63-a1dd-6e95bcd0ad62', 'b9a085e1-e77e-4a5c-b236-634e64b190b9', '7617bcf1-8d49-459b-8fce-f35acc1ec848', '918fb289-50e2-4c19-ab37-c7ce569ae8ab'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:29:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b980345e-b5a1-4bd2-bb38-f6e5c5a5eddd tempest-CreateVolumesFromImageTest-357588858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b980345e-b5a1-4bd2-bb38-f6e5c5a5eddd tempest-CreateVolumesFromImageTest-357588858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:47 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b980345e-b5a1-4bd2-bb38-f6e5c5a5eddd tempest-CreateVolumesFromImageTest-357588858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:47 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b980345e-b5a1-4bd2-bb38-f6e5c5a5eddd tempest-CreateVolumesFromImageTest-357588858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b980345e-b5a1-4bd2-bb38-f6e5c5a5eddd tempest-CreateVolumesFromImageTest-357588858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b980345e-b5a1-4bd2-bb38-f6e5c5a5eddd tempest-CreateVolumesFromImageTest-357588858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:47 devstack sudo[104522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:29:47 devstack sudo[104522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:47 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6c221969-81a0-420c-8b96-88c1851a4a17 tempest-CreateVolumesFromImageTest-357588858 None] Acquiring lock "cinder-6263a5d6-750e-4ba5-8430-854c37895e31-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:47 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6c221969-81a0-420c-8b96-88c1851a4a17 tempest-CreateVolumesFromImageTest-357588858 None] Lock "cinder-6263a5d6-750e-4ba5-8430-854c37895e31-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:47 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6c221969-81a0-420c-8b96-88c1851a4a17 tempest-CreateVolumesFromImageTest-357588858 None] Acquiring lock "cinder-quobyte-6263a5d6-750e-4ba5-8430-854c37895e31" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:47 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6c221969-81a0-420c-8b96-88c1851a4a17 tempest-CreateVolumesFromImageTest-357588858 None] Lock "cinder-quobyte-6263a5d6-750e-4ba5-8430-854c37895e31" acquired by "delete_volume" :: waited 0.023s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:47 devstack sudo[104522]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b980345e-b5a1-4bd2-bb38-f6e5c5a5eddd tempest-CreateVolumesFromImageTest-357588858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.347s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:47 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-b980345e-b5a1-4bd2-bb38-f6e5c5a5eddd tempest-CreateVolumesFromImageTest-357588858 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:29:47 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-b980345e-b5a1-4bd2-bb38-f6e5c5a5eddd tempest-CreateVolumesFromImageTest-357588858 None] Deleted volume successfully. Sep 23 00:29:47 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[187364e4-502c-4419-8929-8fe6cd1ad175]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6c221969-81a0-420c-8b96-88c1851a4a17 tempest-CreateVolumesFromImageTest-357588858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6263a5d6-750e-4ba5-8430-854c37895e31 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:47 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b980345e-b5a1-4bd2-bb38-f6e5c5a5eddd tempest-CreateVolumesFromImageTest-357588858 None] Lock "cinder-3fb5cd20-2023-4809-9807-81af1240d2ae-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:48 devstack sudo[104525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6263a5d6-750e-4ba5-8430-854c37895e31 Sep 23 00:29:48 devstack sudo[104525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:48 devstack sudo[104525]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6c221969-81a0-420c-8b96-88c1851a4a17 tempest-CreateVolumesFromImageTest-357588858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6263a5d6-750e-4ba5-8430-854c37895e31" returned: 0 in 0.423s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6c221969-81a0-420c-8b96-88c1851a4a17 tempest-CreateVolumesFromImageTest-357588858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6263a5d6-750e-4ba5-8430-854c37895e31 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:48 devstack sudo[104530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6263a5d6-750e-4ba5-8430-854c37895e31 Sep 23 00:29:48 devstack sudo[104530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:48 devstack sudo[104530]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6c221969-81a0-420c-8b96-88c1851a4a17 tempest-CreateVolumesFromImageTest-357588858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6263a5d6-750e-4ba5-8430-854c37895e31" returned: 0 in 0.307s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:48 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6c221969-81a0-420c-8b96-88c1851a4a17 tempest-CreateVolumesFromImageTest-357588858 None] Lock "cinder-quobyte-6263a5d6-750e-4ba5-8430-854c37895e31" released by "delete_volume" :: held 0.798s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:48 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-6c221969-81a0-420c-8b96-88c1851a4a17 tempest-CreateVolumesFromImageTest-357588858 None] Created reservations ['833e954f-d1d7-4bd9-afbb-97ea57e11419', 'e3ea7826-6939-404c-a367-3cb72f87e30d', '380162e3-265c-4a27-898d-0e5779f2d780', '47f5b9ee-a3b3-4b6b-b57d-b14cf528701a'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:29:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6c221969-81a0-420c-8b96-88c1851a4a17 tempest-CreateVolumesFromImageTest-357588858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6c221969-81a0-420c-8b96-88c1851a4a17 tempest-CreateVolumesFromImageTest-357588858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:48 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6c221969-81a0-420c-8b96-88c1851a4a17 tempest-CreateVolumesFromImageTest-357588858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:48 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6c221969-81a0-420c-8b96-88c1851a4a17 tempest-CreateVolumesFromImageTest-357588858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6c221969-81a0-420c-8b96-88c1851a4a17 tempest-CreateVolumesFromImageTest-357588858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6c221969-81a0-420c-8b96-88c1851a4a17 tempest-CreateVolumesFromImageTest-357588858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:48 devstack sudo[104533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:29:48 devstack sudo[104533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:49 devstack sudo[104533]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6c221969-81a0-420c-8b96-88c1851a4a17 tempest-CreateVolumesFromImageTest-357588858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.339s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:49 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-6c221969-81a0-420c-8b96-88c1851a4a17 tempest-CreateVolumesFromImageTest-357588858 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:29:49 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-6c221969-81a0-420c-8b96-88c1851a4a17 tempest-CreateVolumesFromImageTest-357588858 None] Deleted volume successfully. Sep 23 00:29:49 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6c221969-81a0-420c-8b96-88c1851a4a17 tempest-CreateVolumesFromImageTest-357588858 None] Lock "cinder-6263a5d6-750e-4ba5-8430-854c37895e31-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:58 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=101,cinder:INSERT=47,cinder:UPDATE=131,cinder:DELETE=12 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:29:59 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=114,cinder:INSERT=39,cinder:UPDATE=138,cinder:DELETE=9 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:30:10 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab0a8092-2426-4018-9851-dc1713532d1b tempest-TestImageHashVerification-778249357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:30:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ab0a8092-2426-4018-9851-dc1713532d1b tempest-TestImageHashVerification-778249357 None] Flow 'volume_create_manager' (15bb59be-ab87-450e-bddf-88ddef08926b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ab0a8092-2426-4018-9851-dc1713532d1b tempest-TestImageHashVerification-778249357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cadc5276-185b-41c9-85da-5291f71eb311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ab0a8092-2426-4018-9851-dc1713532d1b tempest-TestImageHashVerification-778249357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cadc5276-185b-41c9-85da-5291f71eb311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:30:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-2020720969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d9d4132-8ac7-4d7e-ae65-31cc2494d626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e47c5bdef214779a02046ddadabff0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:10Z,use_quota=True,user_id='235f010aa63248879db2a72f7e1d68ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ab0a8092-2426-4018-9851-dc1713532d1b tempest-TestImageHashVerification-778249357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8983647-3961-40cc-b066-e9e481d90d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ab0a8092-2426-4018-9851-dc1713532d1b tempest-TestImageHashVerification-778249357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8983647-3961-40cc-b066-e9e481d90d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ab0a8092-2426-4018-9851-dc1713532d1b tempest-TestImageHashVerification-778249357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4821339-c74b-483f-88b8-cd2f66886147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ab0a8092-2426-4018-9851-dc1713532d1b tempest-TestImageHashVerification-778249357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4821339-c74b-483f-88b8-cd2f66886147) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d9d4132-8ac7-4d7e-ae65-31cc2494d626', 'volume_name': 'volume-1d9d4132-8ac7-4d7e-ae65-31cc2494d626', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ab0a8092-2426-4018-9851-dc1713532d1b tempest-TestImageHashVerification-778249357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d25207c-5662-4509-84d4-64657492bb60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ab0a8092-2426-4018-9851-dc1713532d1b tempest-TestImageHashVerification-778249357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d25207c-5662-4509-84d4-64657492bb60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ab0a8092-2426-4018-9851-dc1713532d1b tempest-TestImageHashVerification-778249357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d570b6ee-c1c3-47aa-a7a1-8475378764cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:10 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-ab0a8092-2426-4018-9851-dc1713532d1b tempest-TestImageHashVerification-778249357 None] Volume 1d9d4132-8ac7-4d7e-ae65-31cc2494d626: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d9d4132-8ac7-4d7e-ae65-31cc2494d626', 'volume_size': 1} Sep 23 00:30:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ab0a8092-2426-4018-9851-dc1713532d1b tempest-TestImageHashVerification-778249357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ab0a8092-2426-4018-9851-dc1713532d1b tempest-TestImageHashVerification-778249357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:10 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ab0a8092-2426-4018-9851-dc1713532d1b tempest-TestImageHashVerification-778249357 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:30:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-2020720969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d9d4132-8ac7-4d7e-ae65-31cc2494d626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e47c5bdef214779a02046ddadabff0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:10Z,use_quota=True,user_id='235f010aa63248879db2a72f7e1d68ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:30:10 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-ab0a8092-2426-4018-9851-dc1713532d1b tempest-TestImageHashVerification-778249357 None] Creating volume 1d9d4132-8ac7-4d7e-ae65-31cc2494d626 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:30:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ab0a8092-2426-4018-9851-dc1713532d1b tempest-TestImageHashVerification-778249357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ab0a8092-2426-4018-9851-dc1713532d1b tempest-TestImageHashVerification-778249357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:10 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ab0a8092-2426-4018-9851-dc1713532d1b tempest-TestImageHashVerification-778249357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:10 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ab0a8092-2426-4018-9851-dc1713532d1b tempest-TestImageHashVerification-778249357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ab0a8092-2426-4018-9851-dc1713532d1b tempest-TestImageHashVerification-778249357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:10 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ab0a8092-2426-4018-9851-dc1713532d1b tempest-TestImageHashVerification-778249357 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:30:10 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-ab0a8092-2426-4018-9851-dc1713532d1b tempest-TestImageHashVerification-778249357 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:30:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ab0a8092-2426-4018-9851-dc1713532d1b tempest-TestImageHashVerification-778249357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1d9d4132-8ac7-4d7e-ae65-31cc2494d626 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:10 devstack sudo[104540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1d9d4132-8ac7-4d7e-ae65-31cc2494d626 1073741824 Sep 23 00:30:10 devstack sudo[104540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:10 devstack sudo[104540]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ab0a8092-2426-4018-9851-dc1713532d1b tempest-TestImageHashVerification-778249357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1d9d4132-8ac7-4d7e-ae65-31cc2494d626 1073741824" returned: 0 in 0.498s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ab0a8092-2426-4018-9851-dc1713532d1b tempest-TestImageHashVerification-778249357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1d9d4132-8ac7-4d7e-ae65-31cc2494d626 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:10 devstack sudo[104546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1d9d4132-8ac7-4d7e-ae65-31cc2494d626 Sep 23 00:30:10 devstack sudo[104546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:11 devstack sudo[104546]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ab0a8092-2426-4018-9851-dc1713532d1b tempest-TestImageHashVerification-778249357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1d9d4132-8ac7-4d7e-ae65-31cc2494d626" returned: 0 in 0.277s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:11 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ab0a8092-2426-4018-9851-dc1713532d1b tempest-TestImageHashVerification-778249357 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:30:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ab0a8092-2426-4018-9851-dc1713532d1b tempest-TestImageHashVerification-778249357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:11 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ab0a8092-2426-4018-9851-dc1713532d1b tempest-TestImageHashVerification-778249357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d570b6ee-c1c3-47aa-a7a1-8475378764cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d9d4132-8ac7-4d7e-ae65-31cc2494d626', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:11 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ab0a8092-2426-4018-9851-dc1713532d1b tempest-TestImageHashVerification-778249357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (965d9996-206d-4dbd-af1f-5f190dbb4014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:11 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-ab0a8092-2426-4018-9851-dc1713532d1b tempest-TestImageHashVerification-778249357 None] Volume volume-1d9d4132-8ac7-4d7e-ae65-31cc2494d626 (1d9d4132-8ac7-4d7e-ae65-31cc2494d626): created successfully Sep 23 00:30:11 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ab0a8092-2426-4018-9851-dc1713532d1b tempest-TestImageHashVerification-778249357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (965d9996-206d-4dbd-af1f-5f190dbb4014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:11 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ab0a8092-2426-4018-9851-dc1713532d1b tempest-TestImageHashVerification-778249357 None] Flow 'volume_create_manager' (15bb59be-ab87-450e-bddf-88ddef08926b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:11 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-ab0a8092-2426-4018-9851-dc1713532d1b tempest-TestImageHashVerification-778249357 None] Created volume successfully. Sep 23 00:30:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-46c29448-2334-4afc-9f69-ccbcdbe4d95a tempest-TestImageHashVerification-778249357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-46c29448-2334-4afc-9f69-ccbcdbe4d95a tempest-TestImageHashVerification-778249357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:13 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[d88b39bf-7c43-489c-b8d7-a444685ffaac]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-46c29448-2334-4afc-9f69-ccbcdbe4d95a tempest-TestImageHashVerification-778249357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1d9d4132-8ac7-4d7e-ae65-31cc2494d626 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:13 devstack sudo[104555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1d9d4132-8ac7-4d7e-ae65-31cc2494d626 Sep 23 00:30:13 devstack sudo[104555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:13 devstack sudo[104555]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-46c29448-2334-4afc-9f69-ccbcdbe4d95a tempest-TestImageHashVerification-778249357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1d9d4132-8ac7-4d7e-ae65-31cc2494d626" returned: 0 in 0.439s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:13 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[70995ee3-a32b-4922-bb55-a751fea65291]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-46c29448-2334-4afc-9f69-ccbcdbe4d95a tempest-TestImageHashVerification-778249357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1d9d4132-8ac7-4d7e-ae65-31cc2494d626 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:14 devstack sudo[104560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1d9d4132-8ac7-4d7e-ae65-31cc2494d626 Sep 23 00:30:14 devstack sudo[104560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:14 devstack sudo[104560]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-46c29448-2334-4afc-9f69-ccbcdbe4d95a tempest-TestImageHashVerification-778249357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1d9d4132-8ac7-4d7e-ae65-31cc2494d626" returned: 0 in 0.470s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-46c29448-2334-4afc-9f69-ccbcdbe4d95a tempest-TestImageHashVerification-778249357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1d9d4132-8ac7-4d7e-ae65-31cc2494d626 /opt/stack/data/cinder/conversion/1d9d4132-8ac7-4d7e-ae65-31cc2494d626.temp_image.562dbbc6-1a98-4821-a729-62cc988dab6aa6gl480e.img {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:14 devstack sudo[104566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1d9d4132-8ac7-4d7e-ae65-31cc2494d626 /opt/stack/data/cinder/conversion/1d9d4132-8ac7-4d7e-ae65-31cc2494d626.temp_image.562dbbc6-1a98-4821-a729-62cc988dab6aa6gl480e.img Sep 23 00:30:14 devstack sudo[104566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:16 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:30:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:16 devstack sudo[104596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:30:16 devstack sudo[104596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:17 devstack sudo[104596]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.559s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:17 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:30:17 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running periodic task VolumeManager._thread_info {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:30:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] thread count: 29 {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:30:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] thread info: [<_MainThread(MainThread, started 135440660459648)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:30:20 devstack sudo[104566]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-46c29448-2334-4afc-9f69-ccbcdbe4d95a tempest-TestImageHashVerification-778249357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1d9d4132-8ac7-4d7e-ae65-31cc2494d626 /opt/stack/data/cinder/conversion/1d9d4132-8ac7-4d7e-ae65-31cc2494d626.temp_image.562dbbc6-1a98-4821-a729-62cc988dab6aa6gl480e.img" returned: 0 in 6.137s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:20 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b97cbb-8f5d-4582-80c7-def0b5246de4]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-46c29448-2334-4afc-9f69-ccbcdbe4d95a tempest-TestImageHashVerification-778249357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1d9d4132-8ac7-4d7e-ae65-31cc2494d626 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:20 devstack sudo[104623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1d9d4132-8ac7-4d7e-ae65-31cc2494d626 Sep 23 00:30:20 devstack sudo[104623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:21 devstack sudo[104623]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-46c29448-2334-4afc-9f69-ccbcdbe4d95a tempest-TestImageHashVerification-778249357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1d9d4132-8ac7-4d7e-ae65-31cc2494d626" returned: 0 in 0.624s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:21 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-46c29448-2334-4afc-9f69-ccbcdbe4d95a tempest-TestImageHashVerification-778249357 None] Image conversion details: src /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1d9d4132-8ac7-4d7e-ae65-31cc2494d626, size 1024.00 MB, duration 6.14 sec, destination /opt/stack/data/cinder/conversion/1d9d4132-8ac7-4d7e-ae65-31cc2494d626.temp_image.562dbbc6-1a98-4821-a729-62cc988dab6aa6gl480e.img {{(pid=86591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:30:21 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-46c29448-2334-4afc-9f69-ccbcdbe4d95a tempest-TestImageHashVerification-778249357 None] Converted 1024.00 MB image at 166.82 MB/s Sep 23 00:30:21 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-46c29448-2334-4afc-9f69-ccbcdbe4d95a tempest-TestImageHashVerification-778249357 None] 562dbbc6-1a98-4821-a729-62cc988dab6a was raw, no need to convert to raw {{(pid=86591) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 23 00:30:31 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:30:31 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:UPDATE=2,cinder:SELECT=5,cinder:DELETE=1 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:30:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-46c29448-2334-4afc-9f69-ccbcdbe4d95a tempest-TestImageHashVerification-778249357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 27.612s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-46c29448-2334-4afc-9f69-ccbcdbe4d95a tempest-TestImageHashVerification-778249357 None] Uploaded volume to glance image-id: 562dbbc6-1a98-4821-a729-62cc988dab6a. {{(pid=86591) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 23 00:30:41 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-46c29448-2334-4afc-9f69-ccbcdbe4d95a tempest-TestImageHashVerification-778249357 None] Copy volume to image completed successfully. Sep 23 00:30:42 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6a079d3e-ef30-489f-bb92-bbef4c12396a tempest-TestImageHashVerification-778249357 None] Acquiring lock "cinder-1d9d4132-8ac7-4d7e-ae65-31cc2494d626-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:42 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6a079d3e-ef30-489f-bb92-bbef4c12396a tempest-TestImageHashVerification-778249357 None] Lock "cinder-1d9d4132-8ac7-4d7e-ae65-31cc2494d626-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:42 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6a079d3e-ef30-489f-bb92-bbef4c12396a tempest-TestImageHashVerification-778249357 None] Acquiring lock "cinder-quobyte-1d9d4132-8ac7-4d7e-ae65-31cc2494d626" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:42 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6a079d3e-ef30-489f-bb92-bbef4c12396a tempest-TestImageHashVerification-778249357 None] Lock "cinder-quobyte-1d9d4132-8ac7-4d7e-ae65-31cc2494d626" acquired by "delete_volume" :: waited 0.021s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:42 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb4bece-032c-4212-8db9-435ced77ec9c]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6a079d3e-ef30-489f-bb92-bbef4c12396a tempest-TestImageHashVerification-778249357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1d9d4132-8ac7-4d7e-ae65-31cc2494d626 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:42 devstack sudo[104633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1d9d4132-8ac7-4d7e-ae65-31cc2494d626 Sep 23 00:30:42 devstack sudo[104633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:42 devstack sudo[104633]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6a079d3e-ef30-489f-bb92-bbef4c12396a tempest-TestImageHashVerification-778249357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1d9d4132-8ac7-4d7e-ae65-31cc2494d626" returned: 0 in 0.435s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6a079d3e-ef30-489f-bb92-bbef4c12396a tempest-TestImageHashVerification-778249357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1d9d4132-8ac7-4d7e-ae65-31cc2494d626 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:42 devstack sudo[104638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1d9d4132-8ac7-4d7e-ae65-31cc2494d626 Sep 23 00:30:42 devstack sudo[104638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:43 devstack sudo[104638]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6a079d3e-ef30-489f-bb92-bbef4c12396a tempest-TestImageHashVerification-778249357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1d9d4132-8ac7-4d7e-ae65-31cc2494d626" returned: 0 in 0.284s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:43 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6a079d3e-ef30-489f-bb92-bbef4c12396a tempest-TestImageHashVerification-778249357 None] Lock "cinder-quobyte-1d9d4132-8ac7-4d7e-ae65-31cc2494d626" released by "delete_volume" :: held 0.762s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:43 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-6a079d3e-ef30-489f-bb92-bbef4c12396a tempest-TestImageHashVerification-778249357 None] Created reservations ['8cbd2a54-e8ec-45d3-88a6-52e18d60f8b2', '8c1e7338-26f9-4cfa-8c5f-017ed85ec993', '7c88fb2a-d966-44a7-ab96-752408455392', '3601e0e6-bbb1-45cc-a78f-94671cad64eb'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:30:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6a079d3e-ef30-489f-bb92-bbef4c12396a tempest-TestImageHashVerification-778249357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6a079d3e-ef30-489f-bb92-bbef4c12396a tempest-TestImageHashVerification-778249357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:43 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6a079d3e-ef30-489f-bb92-bbef4c12396a tempest-TestImageHashVerification-778249357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:43 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6a079d3e-ef30-489f-bb92-bbef4c12396a tempest-TestImageHashVerification-778249357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6a079d3e-ef30-489f-bb92-bbef4c12396a tempest-TestImageHashVerification-778249357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6a079d3e-ef30-489f-bb92-bbef4c12396a tempest-TestImageHashVerification-778249357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:43 devstack sudo[104641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:30:43 devstack sudo[104641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:43 devstack sudo[104641]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6a079d3e-ef30-489f-bb92-bbef4c12396a tempest-TestImageHashVerification-778249357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.304s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:43 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-6a079d3e-ef30-489f-bb92-bbef4c12396a tempest-TestImageHashVerification-778249357 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:30:43 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-6a079d3e-ef30-489f-bb92-bbef4c12396a tempest-TestImageHashVerification-778249357 None] Deleted volume successfully. Sep 23 00:30:43 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6a079d3e-ef30-489f-bb92-bbef4c12396a tempest-TestImageHashVerification-778249357 None] Lock "cinder-1d9d4132-8ac7-4d7e-ae65-31cc2494d626-delete_volume" released by "delete_volume" :: held 1.310s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:53 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:UPDATE=10,cinder:SELECT=5,cinder:INSERT=2 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:30:53 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:30:59 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:30:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] Flow 'volume_create_manager' (21f9cea2-0d3d-44a8-85f0-88c9959aed9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21db9337-b5b1-4ff5-a5a7-f42d84fd4eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21db9337-b5b1-4ff5-a5a7-f42d84fd4eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0c90416-dbd9-478f-8d97-32efb67796f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='703ec8c8617243128fd8c1be4947168d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:00Z,use_quota=True,user_id='ff567c2fee2e4d8395167105abd2a9f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (583c3e0d-af2e-4f90-95ed-e0a5ee12b66e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (583c3e0d-af2e-4f90-95ed-e0a5ee12b66e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b91ffde7-a98b-40ed-962a-40993a2df1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:59 devstack cinder-volume[86591]: DEBUG cinder.image.glance [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] Creating Keystone auth plugin from conf {{(pid=86591) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 00:31:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b91ffde7-a98b-40ed-962a-40993a2df1b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f0c90416-dbd9-478f-8d97-32efb67796f2', 'volume_name': 'volume-f0c90416-dbd9-478f-8d97-32efb67796f2', 'volume_size': 1, 'image_id': 'ec9fb051-b905-4a69-8ea1-38b40bf755ec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ec9fb051-b905-4a69-8ea1-38b40bf755ec', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '940813c0b9739d9130fca3837c3b5738', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '703ec8c8617243128fd8c1be4947168d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ad25c04bda2ca3401afe60d99bd0319d2c723f289d61f88e17ddaa6c66e79288797ef5f4392219cccf5f0356d8c41cfbe77bd3379bf90ccf3bdeb900d68db8a3', 'id': 'ec9fb051-b905-4a69-8ea1-38b40bf755ec', 'created_at': datetime.datetime(2026, 9, 22, 22, 30, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 30, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ec9fb051-b905-4a69-8ea1-38b40bf755ec/file', 'properties': {}}, 'image_service': }' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbf6e487-0cd1-4c91-b80a-57414c4fee09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbf6e487-0cd1-4c91-b80a-57414c4fee09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:00 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39dc6aaf-2ba8-45c3-9085-256ecad88fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:00 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] Volume f0c90416-dbd9-478f-8d97-32efb67796f2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f0c90416-dbd9-478f-8d97-32efb67796f2', 'volume_size': 1, 'image_id': 'ec9fb051-b905-4a69-8ea1-38b40bf755ec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ec9fb051-b905-4a69-8ea1-38b40bf755ec', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '940813c0b9739d9130fca3837c3b5738', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '703ec8c8617243128fd8c1be4947168d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ad25c04bda2ca3401afe60d99bd0319d2c723f289d61f88e17ddaa6c66e79288797ef5f4392219cccf5f0356d8c41cfbe77bd3379bf90ccf3bdeb900d68db8a3', 'id': 'ec9fb051-b905-4a69-8ea1-38b40bf755ec', 'created_at': datetime.datetime(2026, 9, 22, 22, 30, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 30, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ec9fb051-b905-4a69-8ea1-38b40bf755ec/file', 'properties': {}}, 'image_service': } Sep 23 00:31:00 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] Trying to clone f0c90416-dbd9-478f-8d97-32efb67796f2 from image ec9fb051-b905-4a69-8ea1-38b40bf755ec at location (None, [{'url': 'file:///opt/stack/data/glance/images/ec9fb051-b905-4a69-8ea1-38b40bf755ec', 'metadata': {}}]). {{(pid=86591) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 00:31:00 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ec9fb051-b905-4a69-8ea1-38b40bf755ec_e_uf8deydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86591) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 00:31:00 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] Image download 0.00 MB at 0.00 MB/s Sep 23 00:31:00 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7b8a18-f58c-409f-afd2-f34b286b922b]: (4, 'raw') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec9fb051-b905-4a69-8ea1-38b40bf755ec_e_uf8deydevstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:00 devstack sudo[104651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec9fb051-b905-4a69-8ea1-38b40bf755ec_e_uf8deydevstack@QuobyteHD Sep 23 00:31:00 devstack sudo[104651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:00 devstack sudo[104651]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec9fb051-b905-4a69-8ea1-38b40bf755ec_e_uf8deydevstack@QuobyteHD" returned: 0 in 0.356s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec9fb051-b905-4a69-8ea1-38b40bf755ec_e_uf8deydevstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:00 devstack sudo[104655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec9fb051-b905-4a69-8ea1-38b40bf755ec_e_uf8deydevstack@QuobyteHD Sep 23 00:31:00 devstack sudo[104655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:01 devstack sudo[104655]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec9fb051-b905-4a69-8ea1-38b40bf755ec_e_uf8deydevstack@QuobyteHD" returned: 1 in 0.346s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec9fb051-b905-4a69-8ea1-38b40bf755ec_e_uf8deydevstack@QuobyteHD' failed. Not Retrying. {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:31:01 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] Temporary image ec9fb051-b905-4a69-8ea1-38b40bf755ec is fetched for user ff567c2fee2e4d8395167105abd2a9f3. {{(pid=86591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 00:31:01 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[990ff3d8-2383-4fac-8ff3-c64bd7fd2d86]: (4, 'raw') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec9fb051-b905-4a69-8ea1-38b40bf755ec_e_uf8deydevstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:01 devstack sudo[104660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec9fb051-b905-4a69-8ea1-38b40bf755ec_e_uf8deydevstack@QuobyteHD Sep 23 00:31:01 devstack sudo[104660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:01 devstack sudo[104660]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec9fb051-b905-4a69-8ea1-38b40bf755ec_e_uf8deydevstack@QuobyteHD" returned: 0 in 0.338s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec9fb051-b905-4a69-8ea1-38b40bf755ec_e_uf8deydevstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:01 devstack sudo[104664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec9fb051-b905-4a69-8ea1-38b40bf755ec_e_uf8deydevstack@QuobyteHD Sep 23 00:31:01 devstack sudo[104664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:01 devstack sudo[104664]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec9fb051-b905-4a69-8ea1-38b40bf755ec_e_uf8deydevstack@QuobyteHD" returned: 1 in 0.349s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec9fb051-b905-4a69-8ea1-38b40bf755ec_e_uf8deydevstack@QuobyteHD' failed. Not Retrying. {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:31:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0c90416-dbd9-478f-8d97-32efb67796f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='703ec8c8617243128fd8c1be4947168d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:00Z,use_quota=True,user_id='ff567c2fee2e4d8395167105abd2a9f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:31:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] Creating volume f0c90416-dbd9-478f-8d97-32efb67796f2 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:31:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:31:01 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:31:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0c90416-dbd9-478f-8d97-32efb67796f2 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:01 devstack sudo[104669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0c90416-dbd9-478f-8d97-32efb67796f2 1073741824 Sep 23 00:31:01 devstack sudo[104669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:02 devstack sudo[104669]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0c90416-dbd9-478f-8d97-32efb67796f2 1073741824" returned: 0 in 0.482s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0c90416-dbd9-478f-8d97-32efb67796f2 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:02 devstack sudo[104675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0c90416-dbd9-478f-8d97-32efb67796f2 Sep 23 00:31:02 devstack sudo[104675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:02 devstack sudo[104675]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0c90416-dbd9-478f-8d97-32efb67796f2" returned: 0 in 0.294s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:02 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:31:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:02 devstack cinder-volume[86591]: DEBUG cinder.volume.volume_utils [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] Attempting download of ec9fb051-b905-4a69-8ea1-38b40bf755ec ((None, [{'url': 'file:///opt/stack/data/glance/images/ec9fb051-b905-4a69-8ea1-38b40bf755ec', 'metadata': {}}])) to volume f0c90416-dbd9-478f-8d97-32efb67796f2. {{(pid=86591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 00:31:02 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a788cb-afb8-4d73-b603-c21a6e7fb10b]: (4, 'raw') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ec9fb051-b905-4a69-8ea1-38b40bf755ec_3qy94r55 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:02 devstack sudo[104678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ec9fb051-b905-4a69-8ea1-38b40bf755ec_3qy94r55 Sep 23 00:31:02 devstack sudo[104678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:03 devstack sudo[104678]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ec9fb051-b905-4a69-8ea1-38b40bf755ec_3qy94r55" returned: 0 in 0.382s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ec9fb051-b905-4a69-8ea1-38b40bf755ec_3qy94r55 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:03 devstack sudo[104682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ec9fb051-b905-4a69-8ea1-38b40bf755ec_3qy94r55 Sep 23 00:31:03 devstack sudo[104682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:03 devstack sudo[104682]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ec9fb051-b905-4a69-8ea1-38b40bf755ec_3qy94r55" returned: 1 in 0.397s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ec9fb051-b905-4a69-8ea1-38b40bf755ec_3qy94r55' failed. Not Retrying. {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:31:03 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[de848ccd-65b3-4e58-aaf6-6bc663510175]: (4, 'raw') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec9fb051-b905-4a69-8ea1-38b40bf755ec_e_uf8deydevstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:03 devstack sudo[104686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec9fb051-b905-4a69-8ea1-38b40bf755ec_e_uf8deydevstack@QuobyteHD Sep 23 00:31:03 devstack sudo[104686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:03 devstack sudo[104686]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec9fb051-b905-4a69-8ea1-38b40bf755ec_e_uf8deydevstack@QuobyteHD" returned: 0 in 0.335s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec9fb051-b905-4a69-8ea1-38b40bf755ec_e_uf8deydevstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:03 devstack sudo[104690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec9fb051-b905-4a69-8ea1-38b40bf755ec_e_uf8deydevstack@QuobyteHD Sep 23 00:31:03 devstack sudo[104690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:04 devstack sudo[104690]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec9fb051-b905-4a69-8ea1-38b40bf755ec_e_uf8deydevstack@QuobyteHD" returned: 1 in 0.361s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec9fb051-b905-4a69-8ea1-38b40bf755ec_e_uf8deydevstack@QuobyteHD' failed. Not Retrying. {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:31:04 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] ec9fb051-b905-4a69-8ea1-38b40bf755ec was raw, converting to qcow2 {{(pid=86591) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 00:31:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ec9fb051-b905-4a69-8ea1-38b40bf755ec_e_uf8deydevstack@QuobyteHD /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0c90416-dbd9-478f-8d97-32efb67796f2 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:04 devstack sudo[104695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ec9fb051-b905-4a69-8ea1-38b40bf755ec_e_uf8deydevstack@QuobyteHD /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0c90416-dbd9-478f-8d97-32efb67796f2 Sep 23 00:31:04 devstack sudo[104695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:04 devstack sudo[104695]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ec9fb051-b905-4a69-8ea1-38b40bf755ec_e_uf8deydevstack@QuobyteHD /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0c90416-dbd9-478f-8d97-32efb67796f2" returned: 0 in 0.484s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:04 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ec9fb051-b905-4a69-8ea1-38b40bf755ec_e_uf8deydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0c90416-dbd9-478f-8d97-32efb67796f2 {{(pid=86591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:31:04 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] Converted 0.00 MB image at 0.00 MB/s Sep 23 00:31:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0c90416-dbd9-478f-8d97-32efb67796f2 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:04 devstack sudo[104700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0c90416-dbd9-478f-8d97-32efb67796f2 1G Sep 23 00:31:04 devstack sudo[104700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:05 devstack sudo[104700]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0c90416-dbd9-478f-8d97-32efb67796f2 1G" returned: 0 in 0.326s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:05 devstack cinder-volume[86591]: DEBUG cinder.volume.volume_utils [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] Downloaded image ec9fb051-b905-4a69-8ea1-38b40bf755ec ((None, [{'url': 'file:///opt/stack/data/glance/images/ec9fb051-b905-4a69-8ea1-38b40bf755ec', 'metadata': {}}])) to volume f0c90416-dbd9-478f-8d97-32efb67796f2 successfully. {{(pid=86591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 00:31:05 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] Temporary image ec9fb051-b905-4a69-8ea1-38b40bf755ec for user ff567c2fee2e4d8395167105abd2a9f3 is deleted. {{(pid=86591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 00:31:05 devstack cinder-volume[86591]: DEBUG cinder.volume.volume_utils [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] Marking volume f0c90416-dbd9-478f-8d97-32efb67796f2 as bootable. {{(pid=86591) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 00:31:05 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] Copying metadata from image ec9fb051-b905-4a69-8ea1-38b40bf755ec to f0c90416-dbd9-478f-8d97-32efb67796f2. {{(pid=86591) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 00:31:05 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] Creating volume glance metadata for volume f0c90416-dbd9-478f-8d97-32efb67796f2 backed by image ec9fb051-b905-4a69-8ea1-38b40bf755ec with: {'image_id': 'ec9fb051-b905-4a69-8ea1-38b40bf755ec', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '940813c0b9739d9130fca3837c3b5738', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86591) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 00:31:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39dc6aaf-2ba8-45c3-9085-256ecad88fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0c90416-dbd9-478f-8d97-32efb67796f2', 'volume_size': 1, 'image_id': 'ec9fb051-b905-4a69-8ea1-38b40bf755ec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ec9fb051-b905-4a69-8ea1-38b40bf755ec', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '940813c0b9739d9130fca3837c3b5738', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '703ec8c8617243128fd8c1be4947168d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ad25c04bda2ca3401afe60d99bd0319d2c723f289d61f88e17ddaa6c66e79288797ef5f4392219cccf5f0356d8c41cfbe77bd3379bf90ccf3bdeb900d68db8a3', 'id': 'ec9fb051-b905-4a69-8ea1-38b40bf755ec', 'created_at': datetime.datetime(2026, 9, 22, 22, 30, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 30, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ec9fb051-b905-4a69-8ea1-38b40bf755ec/file', 'properties': {}}, 'image_service': }' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac91ec3e-c7a8-4e3a-b72f-dbe1546d5618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:05 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] Volume volume-f0c90416-dbd9-478f-8d97-32efb67796f2 (f0c90416-dbd9-478f-8d97-32efb67796f2): created successfully Sep 23 00:31:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac91ec3e-c7a8-4e3a-b72f-dbe1546d5618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] Flow 'volume_create_manager' (21f9cea2-0d3d-44a8-85f0-88c9959aed9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:05 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-fadde25f-3fd3-4b11-a9ad-36dafb245e9a tempest-VolumeImageDependencyTests-1153495141 None] Created volume successfully. Sep 23 00:31:06 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-bcb87243-f6f8-4b98-9623-11f7cb597456 tempest-VolumeImageDependencyTests-1153495141 None] Acquiring lock "cinder-f0c90416-dbd9-478f-8d97-32efb67796f2-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:06 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-bcb87243-f6f8-4b98-9623-11f7cb597456 tempest-VolumeImageDependencyTests-1153495141 None] Lock "cinder-f0c90416-dbd9-478f-8d97-32efb67796f2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:06 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-bcb87243-f6f8-4b98-9623-11f7cb597456 tempest-VolumeImageDependencyTests-1153495141 None] Acquiring lock "cinder-quobyte-f0c90416-dbd9-478f-8d97-32efb67796f2" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:06 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-bcb87243-f6f8-4b98-9623-11f7cb597456 tempest-VolumeImageDependencyTests-1153495141 None] Lock "cinder-quobyte-f0c90416-dbd9-478f-8d97-32efb67796f2" acquired by "delete_volume" :: waited 0.016s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:06 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[93689aaf-48b4-47ee-9e7d-1dac029269e7]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bcb87243-f6f8-4b98-9623-11f7cb597456 tempest-VolumeImageDependencyTests-1153495141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0c90416-dbd9-478f-8d97-32efb67796f2 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:06 devstack sudo[104705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0c90416-dbd9-478f-8d97-32efb67796f2 Sep 23 00:31:06 devstack sudo[104705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:06 devstack sudo[104705]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bcb87243-f6f8-4b98-9623-11f7cb597456 tempest-VolumeImageDependencyTests-1153495141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0c90416-dbd9-478f-8d97-32efb67796f2" returned: 0 in 0.434s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bcb87243-f6f8-4b98-9623-11f7cb597456 tempest-VolumeImageDependencyTests-1153495141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0c90416-dbd9-478f-8d97-32efb67796f2 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:06 devstack sudo[104710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0c90416-dbd9-478f-8d97-32efb67796f2 Sep 23 00:31:06 devstack sudo[104710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:07 devstack sudo[104710]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bcb87243-f6f8-4b98-9623-11f7cb597456 tempest-VolumeImageDependencyTests-1153495141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-f0c90416-dbd9-478f-8d97-32efb67796f2" returned: 0 in 0.282s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:07 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-bcb87243-f6f8-4b98-9623-11f7cb597456 tempest-VolumeImageDependencyTests-1153495141 None] Lock "cinder-quobyte-f0c90416-dbd9-478f-8d97-32efb67796f2" released by "delete_volume" :: held 0.767s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:07 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-bcb87243-f6f8-4b98-9623-11f7cb597456 tempest-VolumeImageDependencyTests-1153495141 None] Created reservations ['d875db14-6bd0-4183-a601-c6d39e0e0b03', '34199e77-bc8f-48ac-8a17-4349c9822bae', 'c29ea83f-32d3-4f88-8b80-68bb89a2f151', '438fa54a-45c8-40af-a504-073c4682d779'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:31:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-bcb87243-f6f8-4b98-9623-11f7cb597456 tempest-VolumeImageDependencyTests-1153495141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-bcb87243-f6f8-4b98-9623-11f7cb597456 tempest-VolumeImageDependencyTests-1153495141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:07 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-bcb87243-f6f8-4b98-9623-11f7cb597456 tempest-VolumeImageDependencyTests-1153495141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:07 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-bcb87243-f6f8-4b98-9623-11f7cb597456 tempest-VolumeImageDependencyTests-1153495141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-bcb87243-f6f8-4b98-9623-11f7cb597456 tempest-VolumeImageDependencyTests-1153495141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bcb87243-f6f8-4b98-9623-11f7cb597456 tempest-VolumeImageDependencyTests-1153495141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:07 devstack sudo[104713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:31:07 devstack sudo[104713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:07 devstack sudo[104713]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-bcb87243-f6f8-4b98-9623-11f7cb597456 tempest-VolumeImageDependencyTests-1153495141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.288s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:07 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-bcb87243-f6f8-4b98-9623-11f7cb597456 tempest-VolumeImageDependencyTests-1153495141 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:31:07 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-bcb87243-f6f8-4b98-9623-11f7cb597456 tempest-VolumeImageDependencyTests-1153495141 None] Deleted volume successfully. Sep 23 00:31:07 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-bcb87243-f6f8-4b98-9623-11f7cb597456 tempest-VolumeImageDependencyTests-1153495141 None] Lock "cinder-f0c90416-dbd9-478f-8d97-32efb67796f2-delete_volume" released by "delete_volume" :: held 1.293s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:16 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ee5f31d-ba25-4325-866b-57bf443cb36d tempest-ProjectReaderTests-52211227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:31:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3ee5f31d-ba25-4325-866b-57bf443cb36d tempest-ProjectReaderTests-52211227 None] Flow 'volume_create_manager' (11074c35-2b57-4d1b-bdad-f77de8d7c7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3ee5f31d-ba25-4325-866b-57bf443cb36d tempest-ProjectReaderTests-52211227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15265159-1de8-48c2-b6f9-0a333b61302f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3ee5f31d-ba25-4325-866b-57bf443cb36d tempest-ProjectReaderTests-52211227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15265159-1de8-48c2-b6f9-0a333b61302f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1217285126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b65b8ef-9264-46a0-8899-11bc4cd66f30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f7543db08c34eb8a6438e5f976970f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:16Z,use_quota=True,user_id='800c289ad53d4684959400fbac917598',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3ee5f31d-ba25-4325-866b-57bf443cb36d tempest-ProjectReaderTests-52211227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6596cf36-1a8f-4631-9344-734e8c058ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3ee5f31d-ba25-4325-866b-57bf443cb36d tempest-ProjectReaderTests-52211227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6596cf36-1a8f-4631-9344-734e8c058ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3ee5f31d-ba25-4325-866b-57bf443cb36d tempest-ProjectReaderTests-52211227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49683aa9-f47d-4586-9a2e-c443f92dee99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3ee5f31d-ba25-4325-866b-57bf443cb36d tempest-ProjectReaderTests-52211227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49683aa9-f47d-4586-9a2e-c443f92dee99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b65b8ef-9264-46a0-8899-11bc4cd66f30', 'volume_name': 'volume-0b65b8ef-9264-46a0-8899-11bc4cd66f30', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3ee5f31d-ba25-4325-866b-57bf443cb36d tempest-ProjectReaderTests-52211227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87cdd6ba-5440-49f9-9c1a-6695cf70ebcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3ee5f31d-ba25-4325-866b-57bf443cb36d tempest-ProjectReaderTests-52211227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87cdd6ba-5440-49f9-9c1a-6695cf70ebcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3ee5f31d-ba25-4325-866b-57bf443cb36d tempest-ProjectReaderTests-52211227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c5280b9-132f-4bcf-8984-8101e5e3bfe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:16 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-3ee5f31d-ba25-4325-866b-57bf443cb36d tempest-ProjectReaderTests-52211227 None] Volume 0b65b8ef-9264-46a0-8899-11bc4cd66f30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b65b8ef-9264-46a0-8899-11bc4cd66f30', 'volume_size': 1} Sep 23 00:31:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-3ee5f31d-ba25-4325-866b-57bf443cb36d tempest-ProjectReaderTests-52211227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-3ee5f31d-ba25-4325-866b-57bf443cb36d tempest-ProjectReaderTests-52211227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-3ee5f31d-ba25-4325-866b-57bf443cb36d tempest-ProjectReaderTests-52211227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1217285126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b65b8ef-9264-46a0-8899-11bc4cd66f30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f7543db08c34eb8a6438e5f976970f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:16Z,use_quota=True,user_id='800c289ad53d4684959400fbac917598',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:31:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-3ee5f31d-ba25-4325-866b-57bf443cb36d tempest-ProjectReaderTests-52211227 None] Creating volume 0b65b8ef-9264-46a0-8899-11bc4cd66f30 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:31:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-3ee5f31d-ba25-4325-866b-57bf443cb36d tempest-ProjectReaderTests-52211227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-3ee5f31d-ba25-4325-866b-57bf443cb36d tempest-ProjectReaderTests-52211227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-3ee5f31d-ba25-4325-866b-57bf443cb36d tempest-ProjectReaderTests-52211227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-3ee5f31d-ba25-4325-866b-57bf443cb36d tempest-ProjectReaderTests-52211227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-3ee5f31d-ba25-4325-866b-57bf443cb36d tempest-ProjectReaderTests-52211227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-3ee5f31d-ba25-4325-866b-57bf443cb36d tempest-ProjectReaderTests-52211227 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:31:16 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-3ee5f31d-ba25-4325-866b-57bf443cb36d tempest-ProjectReaderTests-52211227 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:31:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3ee5f31d-ba25-4325-866b-57bf443cb36d tempest-ProjectReaderTests-52211227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-0b65b8ef-9264-46a0-8899-11bc4cd66f30 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:16 devstack sudo[104725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-0b65b8ef-9264-46a0-8899-11bc4cd66f30 1073741824 Sep 23 00:31:16 devstack sudo[104725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:16 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:31:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:16 devstack sudo[104731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:31:16 devstack sudo[104731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:16 devstack sudo[104725]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3ee5f31d-ba25-4325-866b-57bf443cb36d tempest-ProjectReaderTests-52211227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-0b65b8ef-9264-46a0-8899-11bc4cd66f30 1073741824" returned: 0 in 0.524s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3ee5f31d-ba25-4325-866b-57bf443cb36d tempest-ProjectReaderTests-52211227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-0b65b8ef-9264-46a0-8899-11bc4cd66f30 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:16 devstack sudo[104733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-0b65b8ef-9264-46a0-8899-11bc4cd66f30 Sep 23 00:31:16 devstack sudo[104733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:16 devstack sudo[104731]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.305s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:17 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:31:17 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running periodic task VolumeManager._thread_info {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:31:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] thread count: 29 {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:31:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] thread info: [<_MainThread(MainThread, started 135440660459648)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:31:17 devstack sudo[104733]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3ee5f31d-ba25-4325-866b-57bf443cb36d tempest-ProjectReaderTests-52211227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-0b65b8ef-9264-46a0-8899-11bc4cd66f30" returned: 0 in 0.286s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:17 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-3ee5f31d-ba25-4325-866b-57bf443cb36d tempest-ProjectReaderTests-52211227 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:31:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-3ee5f31d-ba25-4325-866b-57bf443cb36d tempest-ProjectReaderTests-52211227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3ee5f31d-ba25-4325-866b-57bf443cb36d tempest-ProjectReaderTests-52211227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c5280b9-132f-4bcf-8984-8101e5e3bfe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b65b8ef-9264-46a0-8899-11bc4cd66f30', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3ee5f31d-ba25-4325-866b-57bf443cb36d tempest-ProjectReaderTests-52211227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5333f83f-c2e9-4331-bf96-6c6d6c7e2c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:17 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-3ee5f31d-ba25-4325-866b-57bf443cb36d tempest-ProjectReaderTests-52211227 None] Volume volume-0b65b8ef-9264-46a0-8899-11bc4cd66f30 (0b65b8ef-9264-46a0-8899-11bc4cd66f30): created successfully Sep 23 00:31:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3ee5f31d-ba25-4325-866b-57bf443cb36d tempest-ProjectReaderTests-52211227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5333f83f-c2e9-4331-bf96-6c6d6c7e2c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3ee5f31d-ba25-4325-866b-57bf443cb36d tempest-ProjectReaderTests-52211227 None] Flow 'volume_create_manager' (11074c35-2b57-4d1b-bdad-f77de8d7c7dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:17 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-3ee5f31d-ba25-4325-866b-57bf443cb36d tempest-ProjectReaderTests-52211227 None] Created volume successfully. Sep 23 00:31:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-41f4b75a-a1d6-41ce-b348-a2d3830ea472 tempest-ProjectReaderTests-52211227 None] Acquiring lock "cinder-0b65b8ef-9264-46a0-8899-11bc4cd66f30-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-41f4b75a-a1d6-41ce-b348-a2d3830ea472 tempest-ProjectReaderTests-52211227 None] Lock "cinder-0b65b8ef-9264-46a0-8899-11bc4cd66f30-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-41f4b75a-a1d6-41ce-b348-a2d3830ea472 tempest-ProjectReaderTests-52211227 None] Acquiring lock "cinder-quobyte-0b65b8ef-9264-46a0-8899-11bc4cd66f30" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-41f4b75a-a1d6-41ce-b348-a2d3830ea472 tempest-ProjectReaderTests-52211227 None] Lock "cinder-quobyte-0b65b8ef-9264-46a0-8899-11bc4cd66f30" acquired by "delete_volume" :: waited 0.021s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:18 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d65ebf7-0681-4baa-ae1c-14c34afdafed]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-41f4b75a-a1d6-41ce-b348-a2d3830ea472 tempest-ProjectReaderTests-52211227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-0b65b8ef-9264-46a0-8899-11bc4cd66f30 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:18 devstack sudo[104774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-0b65b8ef-9264-46a0-8899-11bc4cd66f30 Sep 23 00:31:18 devstack sudo[104774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:18 devstack sudo[104774]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-41f4b75a-a1d6-41ce-b348-a2d3830ea472 tempest-ProjectReaderTests-52211227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-0b65b8ef-9264-46a0-8899-11bc4cd66f30" returned: 0 in 0.411s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-41f4b75a-a1d6-41ce-b348-a2d3830ea472 tempest-ProjectReaderTests-52211227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-0b65b8ef-9264-46a0-8899-11bc4cd66f30 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:18 devstack sudo[104779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-0b65b8ef-9264-46a0-8899-11bc4cd66f30 Sep 23 00:31:18 devstack sudo[104779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:19 devstack sudo[104779]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-41f4b75a-a1d6-41ce-b348-a2d3830ea472 tempest-ProjectReaderTests-52211227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-0b65b8ef-9264-46a0-8899-11bc4cd66f30" returned: 0 in 0.286s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-41f4b75a-a1d6-41ce-b348-a2d3830ea472 tempest-ProjectReaderTests-52211227 None] Lock "cinder-quobyte-0b65b8ef-9264-46a0-8899-11bc4cd66f30" released by "delete_volume" :: held 0.741s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:19 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-41f4b75a-a1d6-41ce-b348-a2d3830ea472 tempest-ProjectReaderTests-52211227 None] Created reservations ['bb0e481f-0163-41d6-a89c-dbbef43f2e31', '413fe3db-1b16-4abd-91d7-166ad7652878', '59f170bf-a24b-4cfa-b4cf-e11cb88b6374', '87a8d3d3-aff4-494c-8060-3fe2774248cc'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:31:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-41f4b75a-a1d6-41ce-b348-a2d3830ea472 tempest-ProjectReaderTests-52211227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-41f4b75a-a1d6-41ce-b348-a2d3830ea472 tempest-ProjectReaderTests-52211227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:19 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-41f4b75a-a1d6-41ce-b348-a2d3830ea472 tempest-ProjectReaderTests-52211227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:19 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-41f4b75a-a1d6-41ce-b348-a2d3830ea472 tempest-ProjectReaderTests-52211227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-41f4b75a-a1d6-41ce-b348-a2d3830ea472 tempest-ProjectReaderTests-52211227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-41f4b75a-a1d6-41ce-b348-a2d3830ea472 tempest-ProjectReaderTests-52211227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:19 devstack sudo[104782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:31:19 devstack sudo[104782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:19 devstack sudo[104782]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-41f4b75a-a1d6-41ce-b348-a2d3830ea472 tempest-ProjectReaderTests-52211227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.278s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:19 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-41f4b75a-a1d6-41ce-b348-a2d3830ea472 tempest-ProjectReaderTests-52211227 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:31:19 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-41f4b75a-a1d6-41ce-b348-a2d3830ea472 tempest-ProjectReaderTests-52211227 None] Deleted volume successfully. Sep 23 00:31:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-41f4b75a-a1d6-41ce-b348-a2d3830ea472 tempest-ProjectReaderTests-52211227 None] Lock "cinder-0b65b8ef-9264-46a0-8899-11bc4cd66f30-delete_volume" released by "delete_volume" :: held 1.270s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:20 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee77896e-0601-4921-a2d1-d79e300e88de tempest-ProjectReaderTests-52211227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:31:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ee77896e-0601-4921-a2d1-d79e300e88de tempest-ProjectReaderTests-52211227 None] Flow 'volume_create_manager' (81e06383-5f98-40c5-9153-8c4ec605cf7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ee77896e-0601-4921-a2d1-d79e300e88de tempest-ProjectReaderTests-52211227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5009090f-f20e-497b-b6f2-934ae1dbcca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ee77896e-0601-4921-a2d1-d79e300e88de tempest-ProjectReaderTests-52211227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5009090f-f20e-497b-b6f2-934ae1dbcca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2032237767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c422806-9f70-4ff9-b1d2-98e5bd9907c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f7543db08c34eb8a6438e5f976970f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:20Z,use_quota=True,user_id='800c289ad53d4684959400fbac917598',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ee77896e-0601-4921-a2d1-d79e300e88de tempest-ProjectReaderTests-52211227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59862b07-10b0-4e08-bbe4-dbe933559ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ee77896e-0601-4921-a2d1-d79e300e88de tempest-ProjectReaderTests-52211227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59862b07-10b0-4e08-bbe4-dbe933559ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ee77896e-0601-4921-a2d1-d79e300e88de tempest-ProjectReaderTests-52211227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feb4401d-6387-432e-a7b5-eacf202d2780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ee77896e-0601-4921-a2d1-d79e300e88de tempest-ProjectReaderTests-52211227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feb4401d-6387-432e-a7b5-eacf202d2780) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c422806-9f70-4ff9-b1d2-98e5bd9907c8', 'volume_name': 'volume-6c422806-9f70-4ff9-b1d2-98e5bd9907c8', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ee77896e-0601-4921-a2d1-d79e300e88de tempest-ProjectReaderTests-52211227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0bdba5a-1075-4a22-ba4e-7dc551ae4184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ee77896e-0601-4921-a2d1-d79e300e88de tempest-ProjectReaderTests-52211227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0bdba5a-1075-4a22-ba4e-7dc551ae4184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ee77896e-0601-4921-a2d1-d79e300e88de tempest-ProjectReaderTests-52211227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9888ad6-26a1-4dee-90df-d7f9e38c94ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:20 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-ee77896e-0601-4921-a2d1-d79e300e88de tempest-ProjectReaderTests-52211227 None] Volume 6c422806-9f70-4ff9-b1d2-98e5bd9907c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c422806-9f70-4ff9-b1d2-98e5bd9907c8', 'volume_size': 1} Sep 23 00:31:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ee77896e-0601-4921-a2d1-d79e300e88de tempest-ProjectReaderTests-52211227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ee77896e-0601-4921-a2d1-d79e300e88de tempest-ProjectReaderTests-52211227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:20 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ee77896e-0601-4921-a2d1-d79e300e88de tempest-ProjectReaderTests-52211227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2032237767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c422806-9f70-4ff9-b1d2-98e5bd9907c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f7543db08c34eb8a6438e5f976970f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:20Z,use_quota=True,user_id='800c289ad53d4684959400fbac917598',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:31:20 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-ee77896e-0601-4921-a2d1-d79e300e88de tempest-ProjectReaderTests-52211227 None] Creating volume 6c422806-9f70-4ff9-b1d2-98e5bd9907c8 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:31:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ee77896e-0601-4921-a2d1-d79e300e88de tempest-ProjectReaderTests-52211227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ee77896e-0601-4921-a2d1-d79e300e88de tempest-ProjectReaderTests-52211227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:20 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ee77896e-0601-4921-a2d1-d79e300e88de tempest-ProjectReaderTests-52211227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:20 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ee77896e-0601-4921-a2d1-d79e300e88de tempest-ProjectReaderTests-52211227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ee77896e-0601-4921-a2d1-d79e300e88de tempest-ProjectReaderTests-52211227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:20 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ee77896e-0601-4921-a2d1-d79e300e88de tempest-ProjectReaderTests-52211227 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:31:20 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-ee77896e-0601-4921-a2d1-d79e300e88de tempest-ProjectReaderTests-52211227 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:31:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ee77896e-0601-4921-a2d1-d79e300e88de tempest-ProjectReaderTests-52211227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6c422806-9f70-4ff9-b1d2-98e5bd9907c8 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:20 devstack sudo[104785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6c422806-9f70-4ff9-b1d2-98e5bd9907c8 1073741824 Sep 23 00:31:20 devstack sudo[104785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:20 devstack sudo[104785]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ee77896e-0601-4921-a2d1-d79e300e88de tempest-ProjectReaderTests-52211227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6c422806-9f70-4ff9-b1d2-98e5bd9907c8 1073741824" returned: 0 in 0.517s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ee77896e-0601-4921-a2d1-d79e300e88de tempest-ProjectReaderTests-52211227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6c422806-9f70-4ff9-b1d2-98e5bd9907c8 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:20 devstack sudo[104791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6c422806-9f70-4ff9-b1d2-98e5bd9907c8 Sep 23 00:31:20 devstack sudo[104791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:21 devstack sudo[104791]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ee77896e-0601-4921-a2d1-d79e300e88de tempest-ProjectReaderTests-52211227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6c422806-9f70-4ff9-b1d2-98e5bd9907c8" returned: 0 in 0.271s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:21 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ee77896e-0601-4921-a2d1-d79e300e88de tempest-ProjectReaderTests-52211227 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:31:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ee77896e-0601-4921-a2d1-d79e300e88de tempest-ProjectReaderTests-52211227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ee77896e-0601-4921-a2d1-d79e300e88de tempest-ProjectReaderTests-52211227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9888ad6-26a1-4dee-90df-d7f9e38c94ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c422806-9f70-4ff9-b1d2-98e5bd9907c8', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ee77896e-0601-4921-a2d1-d79e300e88de tempest-ProjectReaderTests-52211227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (257c579d-ddfc-4109-912c-fbf22a6631a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:21 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-ee77896e-0601-4921-a2d1-d79e300e88de tempest-ProjectReaderTests-52211227 None] Volume volume-6c422806-9f70-4ff9-b1d2-98e5bd9907c8 (6c422806-9f70-4ff9-b1d2-98e5bd9907c8): created successfully Sep 23 00:31:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ee77896e-0601-4921-a2d1-d79e300e88de tempest-ProjectReaderTests-52211227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (257c579d-ddfc-4109-912c-fbf22a6631a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-ee77896e-0601-4921-a2d1-d79e300e88de tempest-ProjectReaderTests-52211227 None] Flow 'volume_create_manager' (81e06383-5f98-40c5-9153-8c4ec605cf7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:21 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-ee77896e-0601-4921-a2d1-d79e300e88de tempest-ProjectReaderTests-52211227 None] Created volume successfully. Sep 23 00:31:22 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-51798695-c9c7-44a5-920e-b8a7ef4d240f tempest-ProjectReaderTests-52211227 None] Acquiring lock "cinder-6c422806-9f70-4ff9-b1d2-98e5bd9907c8-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:22 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-51798695-c9c7-44a5-920e-b8a7ef4d240f tempest-ProjectReaderTests-52211227 None] Lock "cinder-6c422806-9f70-4ff9-b1d2-98e5bd9907c8-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:22 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-51798695-c9c7-44a5-920e-b8a7ef4d240f tempest-ProjectReaderTests-52211227 None] Acquiring lock "cinder-quobyte-6c422806-9f70-4ff9-b1d2-98e5bd9907c8" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:22 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-51798695-c9c7-44a5-920e-b8a7ef4d240f tempest-ProjectReaderTests-52211227 None] Lock "cinder-quobyte-6c422806-9f70-4ff9-b1d2-98e5bd9907c8" acquired by "delete_volume" :: waited 0.016s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:22 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd993e6-e4f2-476d-8a31-573edef325c5]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-51798695-c9c7-44a5-920e-b8a7ef4d240f tempest-ProjectReaderTests-52211227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6c422806-9f70-4ff9-b1d2-98e5bd9907c8 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:22 devstack sudo[104794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6c422806-9f70-4ff9-b1d2-98e5bd9907c8 Sep 23 00:31:22 devstack sudo[104794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:22 devstack sudo[104794]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-51798695-c9c7-44a5-920e-b8a7ef4d240f tempest-ProjectReaderTests-52211227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6c422806-9f70-4ff9-b1d2-98e5bd9907c8" returned: 0 in 0.408s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-51798695-c9c7-44a5-920e-b8a7ef4d240f tempest-ProjectReaderTests-52211227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6c422806-9f70-4ff9-b1d2-98e5bd9907c8 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:22 devstack sudo[104799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6c422806-9f70-4ff9-b1d2-98e5bd9907c8 Sep 23 00:31:22 devstack sudo[104799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:23 devstack sudo[104799]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-51798695-c9c7-44a5-920e-b8a7ef4d240f tempest-ProjectReaderTests-52211227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6c422806-9f70-4ff9-b1d2-98e5bd9907c8" returned: 0 in 0.262s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:23 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-51798695-c9c7-44a5-920e-b8a7ef4d240f tempest-ProjectReaderTests-52211227 None] Lock "cinder-quobyte-6c422806-9f70-4ff9-b1d2-98e5bd9907c8" released by "delete_volume" :: held 0.714s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:23 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-51798695-c9c7-44a5-920e-b8a7ef4d240f tempest-ProjectReaderTests-52211227 None] Created reservations ['c749eaaa-a448-437f-810d-8bbb72fb3e2e', 'b0cbf014-2f08-458e-89c5-94557fd0a1ec', '9b167ce6-e12b-42fc-b5ca-89fe8106e50f', '1ab5d947-9313-42f3-803f-7c723985cff7'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:31:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-51798695-c9c7-44a5-920e-b8a7ef4d240f tempest-ProjectReaderTests-52211227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-51798695-c9c7-44a5-920e-b8a7ef4d240f tempest-ProjectReaderTests-52211227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:23 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-51798695-c9c7-44a5-920e-b8a7ef4d240f tempest-ProjectReaderTests-52211227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:23 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-51798695-c9c7-44a5-920e-b8a7ef4d240f tempest-ProjectReaderTests-52211227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-51798695-c9c7-44a5-920e-b8a7ef4d240f tempest-ProjectReaderTests-52211227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-51798695-c9c7-44a5-920e-b8a7ef4d240f tempest-ProjectReaderTests-52211227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:23 devstack sudo[104802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:31:23 devstack sudo[104802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:23 devstack sudo[104802]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-51798695-c9c7-44a5-920e-b8a7ef4d240f tempest-ProjectReaderTests-52211227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.263s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:23 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-51798695-c9c7-44a5-920e-b8a7ef4d240f tempest-ProjectReaderTests-52211227 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:31:23 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-51798695-c9c7-44a5-920e-b8a7ef4d240f tempest-ProjectReaderTests-52211227 None] Deleted volume successfully. Sep 23 00:31:23 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-51798695-c9c7-44a5-920e-b8a7ef4d240f tempest-ProjectReaderTests-52211227 None] Lock "cinder-6c422806-9f70-4ff9-b1d2-98e5bd9907c8-delete_volume" released by "delete_volume" :: held 1.195s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:23 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5bb4169-6e78-4348-bbce-f793df953199 tempest-ProjectReaderTests-52211227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:31:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5bb4169-6e78-4348-bbce-f793df953199 tempest-ProjectReaderTests-52211227 None] Flow 'volume_create_manager' (d58da101-8083-4983-b83e-1dc1a70c692b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5bb4169-6e78-4348-bbce-f793df953199 tempest-ProjectReaderTests-52211227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f5d066a-d1f2-4655-ab34-ed71841659a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5bb4169-6e78-4348-bbce-f793df953199 tempest-ProjectReaderTests-52211227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f5d066a-d1f2-4655-ab34-ed71841659a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-116367198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b9d76dc-239f-4781-a6de-b4dfc47106ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f7543db08c34eb8a6438e5f976970f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:24Z,use_quota=True,user_id='800c289ad53d4684959400fbac917598',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5bb4169-6e78-4348-bbce-f793df953199 tempest-ProjectReaderTests-52211227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3065790-8b83-4f4f-ae89-b186460f267c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5bb4169-6e78-4348-bbce-f793df953199 tempest-ProjectReaderTests-52211227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3065790-8b83-4f4f-ae89-b186460f267c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5bb4169-6e78-4348-bbce-f793df953199 tempest-ProjectReaderTests-52211227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd145cc9-a8fa-456a-beae-f1a1b4adc185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5bb4169-6e78-4348-bbce-f793df953199 tempest-ProjectReaderTests-52211227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd145cc9-a8fa-456a-beae-f1a1b4adc185) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b9d76dc-239f-4781-a6de-b4dfc47106ad', 'volume_name': 'volume-6b9d76dc-239f-4781-a6de-b4dfc47106ad', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5bb4169-6e78-4348-bbce-f793df953199 tempest-ProjectReaderTests-52211227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4663ef2b-db28-405e-800c-01f3b3072730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5bb4169-6e78-4348-bbce-f793df953199 tempest-ProjectReaderTests-52211227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4663ef2b-db28-405e-800c-01f3b3072730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5bb4169-6e78-4348-bbce-f793df953199 tempest-ProjectReaderTests-52211227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c8cd69b-588f-4f48-bd34-bb793433c82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:24 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-f5bb4169-6e78-4348-bbce-f793df953199 tempest-ProjectReaderTests-52211227 None] Volume 6b9d76dc-239f-4781-a6de-b4dfc47106ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b9d76dc-239f-4781-a6de-b4dfc47106ad', 'volume_size': 1} Sep 23 00:31:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5bb4169-6e78-4348-bbce-f793df953199 tempest-ProjectReaderTests-52211227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5bb4169-6e78-4348-bbce-f793df953199 tempest-ProjectReaderTests-52211227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:24 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f5bb4169-6e78-4348-bbce-f793df953199 tempest-ProjectReaderTests-52211227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-116367198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b9d76dc-239f-4781-a6de-b4dfc47106ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f7543db08c34eb8a6438e5f976970f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:24Z,use_quota=True,user_id='800c289ad53d4684959400fbac917598',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:31:24 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-f5bb4169-6e78-4348-bbce-f793df953199 tempest-ProjectReaderTests-52211227 None] Creating volume 6b9d76dc-239f-4781-a6de-b4dfc47106ad {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:31:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5bb4169-6e78-4348-bbce-f793df953199 tempest-ProjectReaderTests-52211227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5bb4169-6e78-4348-bbce-f793df953199 tempest-ProjectReaderTests-52211227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:24 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f5bb4169-6e78-4348-bbce-f793df953199 tempest-ProjectReaderTests-52211227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:24 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f5bb4169-6e78-4348-bbce-f793df953199 tempest-ProjectReaderTests-52211227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5bb4169-6e78-4348-bbce-f793df953199 tempest-ProjectReaderTests-52211227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:24 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f5bb4169-6e78-4348-bbce-f793df953199 tempest-ProjectReaderTests-52211227 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:31:24 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-f5bb4169-6e78-4348-bbce-f793df953199 tempest-ProjectReaderTests-52211227 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:31:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f5bb4169-6e78-4348-bbce-f793df953199 tempest-ProjectReaderTests-52211227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6b9d76dc-239f-4781-a6de-b4dfc47106ad 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:24 devstack sudo[104805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6b9d76dc-239f-4781-a6de-b4dfc47106ad 1073741824 Sep 23 00:31:24 devstack sudo[104805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:24 devstack sudo[104805]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f5bb4169-6e78-4348-bbce-f793df953199 tempest-ProjectReaderTests-52211227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6b9d76dc-239f-4781-a6de-b4dfc47106ad 1073741824" returned: 0 in 0.399s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f5bb4169-6e78-4348-bbce-f793df953199 tempest-ProjectReaderTests-52211227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6b9d76dc-239f-4781-a6de-b4dfc47106ad {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:24 devstack sudo[104810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6b9d76dc-239f-4781-a6de-b4dfc47106ad Sep 23 00:31:24 devstack sudo[104810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:24 devstack sudo[104810]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f5bb4169-6e78-4348-bbce-f793df953199 tempest-ProjectReaderTests-52211227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6b9d76dc-239f-4781-a6de-b4dfc47106ad" returned: 0 in 0.237s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:24 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f5bb4169-6e78-4348-bbce-f793df953199 tempest-ProjectReaderTests-52211227 None] <== create_volume: return (675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:31:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f5bb4169-6e78-4348-bbce-f793df953199 tempest-ProjectReaderTests-52211227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.678s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5bb4169-6e78-4348-bbce-f793df953199 tempest-ProjectReaderTests-52211227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c8cd69b-588f-4f48-bd34-bb793433c82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b9d76dc-239f-4781-a6de-b4dfc47106ad', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5bb4169-6e78-4348-bbce-f793df953199 tempest-ProjectReaderTests-52211227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43f5886f-d8f4-43ac-a4c4-f0db178747e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:24 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-f5bb4169-6e78-4348-bbce-f793df953199 tempest-ProjectReaderTests-52211227 None] Volume volume-6b9d76dc-239f-4781-a6de-b4dfc47106ad (6b9d76dc-239f-4781-a6de-b4dfc47106ad): created successfully Sep 23 00:31:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5bb4169-6e78-4348-bbce-f793df953199 tempest-ProjectReaderTests-52211227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43f5886f-d8f4-43ac-a4c4-f0db178747e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-f5bb4169-6e78-4348-bbce-f793df953199 tempest-ProjectReaderTests-52211227 None] Flow 'volume_create_manager' (d58da101-8083-4983-b83e-1dc1a70c692b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:24 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-f5bb4169-6e78-4348-bbce-f793df953199 tempest-ProjectReaderTests-52211227 None] Created volume successfully. Sep 23 00:31:25 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ce9fe2f9-eeed-43f2-8532-252f921f787c tempest-ProjectReaderTests-52211227 None] Acquiring lock "cinder-6b9d76dc-239f-4781-a6de-b4dfc47106ad-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:25 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ce9fe2f9-eeed-43f2-8532-252f921f787c tempest-ProjectReaderTests-52211227 None] Lock "cinder-6b9d76dc-239f-4781-a6de-b4dfc47106ad-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:25 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ce9fe2f9-eeed-43f2-8532-252f921f787c tempest-ProjectReaderTests-52211227 None] Acquiring lock "cinder-quobyte-6b9d76dc-239f-4781-a6de-b4dfc47106ad" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:25 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ce9fe2f9-eeed-43f2-8532-252f921f787c tempest-ProjectReaderTests-52211227 None] Lock "cinder-quobyte-6b9d76dc-239f-4781-a6de-b4dfc47106ad" acquired by "delete_volume" :: waited 0.015s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:25 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a62743d-7a19-4ecd-a13a-d151ff1f0a33]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ce9fe2f9-eeed-43f2-8532-252f921f787c tempest-ProjectReaderTests-52211227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6b9d76dc-239f-4781-a6de-b4dfc47106ad {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:25 devstack sudo[104813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6b9d76dc-239f-4781-a6de-b4dfc47106ad Sep 23 00:31:25 devstack sudo[104813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:25 devstack sudo[104813]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ce9fe2f9-eeed-43f2-8532-252f921f787c tempest-ProjectReaderTests-52211227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6b9d76dc-239f-4781-a6de-b4dfc47106ad" returned: 0 in 0.397s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ce9fe2f9-eeed-43f2-8532-252f921f787c tempest-ProjectReaderTests-52211227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6b9d76dc-239f-4781-a6de-b4dfc47106ad {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:25 devstack sudo[104819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6b9d76dc-239f-4781-a6de-b4dfc47106ad Sep 23 00:31:25 devstack sudo[104819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:25 devstack sudo[104819]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ce9fe2f9-eeed-43f2-8532-252f921f787c tempest-ProjectReaderTests-52211227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6b9d76dc-239f-4781-a6de-b4dfc47106ad" returned: 0 in 0.255s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:25 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ce9fe2f9-eeed-43f2-8532-252f921f787c tempest-ProjectReaderTests-52211227 None] Lock "cinder-quobyte-6b9d76dc-239f-4781-a6de-b4dfc47106ad" released by "delete_volume" :: held 0.711s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:25 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-ce9fe2f9-eeed-43f2-8532-252f921f787c tempest-ProjectReaderTests-52211227 None] Created reservations ['c77c8fb8-2245-4827-ab96-fa878940fdcb', '5c3a37f5-1272-4cb5-bc0b-510aa88c75a3', 'b78c940d-5de3-4eb4-bfa0-f10ec47060b0', '3e8945b4-cca6-423c-91bb-b5ca26adb151'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:31:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ce9fe2f9-eeed-43f2-8532-252f921f787c tempest-ProjectReaderTests-52211227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ce9fe2f9-eeed-43f2-8532-252f921f787c tempest-ProjectReaderTests-52211227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:25 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ce9fe2f9-eeed-43f2-8532-252f921f787c tempest-ProjectReaderTests-52211227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:25 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ce9fe2f9-eeed-43f2-8532-252f921f787c tempest-ProjectReaderTests-52211227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ce9fe2f9-eeed-43f2-8532-252f921f787c tempest-ProjectReaderTests-52211227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ce9fe2f9-eeed-43f2-8532-252f921f787c tempest-ProjectReaderTests-52211227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:25 devstack sudo[104822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:31:25 devstack sudo[104822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:26 devstack sudo[104822]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ce9fe2f9-eeed-43f2-8532-252f921f787c tempest-ProjectReaderTests-52211227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.288s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:26 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-ce9fe2f9-eeed-43f2-8532-252f921f787c tempest-ProjectReaderTests-52211227 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:31:26 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-ce9fe2f9-eeed-43f2-8532-252f921f787c tempest-ProjectReaderTests-52211227 None] Deleted volume successfully. Sep 23 00:31:26 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ce9fe2f9-eeed-43f2-8532-252f921f787c tempest-ProjectReaderTests-52211227 None] Lock "cinder-6b9d76dc-239f-4781-a6de-b4dfc47106ad-delete_volume" released by "delete_volume" :: held 1.223s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:26 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-76c470f1-86d4-4900-a622-f49b43fc429f tempest-ProjectReaderTests-52211227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:31:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-76c470f1-86d4-4900-a622-f49b43fc429f tempest-ProjectReaderTests-52211227 None] Flow 'volume_create_manager' (e00fecac-a3e9-4d37-ba12-fa0b29a4e874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-76c470f1-86d4-4900-a622-f49b43fc429f tempest-ProjectReaderTests-52211227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (585579eb-5519-4fab-aecf-36b5ba2c683e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-76c470f1-86d4-4900-a622-f49b43fc429f tempest-ProjectReaderTests-52211227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (585579eb-5519-4fab-aecf-36b5ba2c683e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1901348448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ca42887-f58a-43c5-8023-fb4e01639209,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f7543db08c34eb8a6438e5f976970f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:27Z,use_quota=True,user_id='800c289ad53d4684959400fbac917598',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-76c470f1-86d4-4900-a622-f49b43fc429f tempest-ProjectReaderTests-52211227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62a816d8-a1a1-4172-8d5a-eca8f5095ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-76c470f1-86d4-4900-a622-f49b43fc429f tempest-ProjectReaderTests-52211227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62a816d8-a1a1-4172-8d5a-eca8f5095ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-76c470f1-86d4-4900-a622-f49b43fc429f tempest-ProjectReaderTests-52211227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18a48359-26c7-436a-ac90-c2b6fa96382b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-76c470f1-86d4-4900-a622-f49b43fc429f tempest-ProjectReaderTests-52211227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18a48359-26c7-436a-ac90-c2b6fa96382b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ca42887-f58a-43c5-8023-fb4e01639209', 'volume_name': 'volume-6ca42887-f58a-43c5-8023-fb4e01639209', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-76c470f1-86d4-4900-a622-f49b43fc429f tempest-ProjectReaderTests-52211227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25568e38-d7aa-44ee-bc99-13f875a89f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-76c470f1-86d4-4900-a622-f49b43fc429f tempest-ProjectReaderTests-52211227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25568e38-d7aa-44ee-bc99-13f875a89f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:26 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-76c470f1-86d4-4900-a622-f49b43fc429f tempest-ProjectReaderTests-52211227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7e8a1af-be94-4b40-9243-cb5bb71b2b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:26 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-76c470f1-86d4-4900-a622-f49b43fc429f tempest-ProjectReaderTests-52211227 None] Volume 6ca42887-f58a-43c5-8023-fb4e01639209: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ca42887-f58a-43c5-8023-fb4e01639209', 'volume_size': 1} Sep 23 00:31:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-76c470f1-86d4-4900-a622-f49b43fc429f tempest-ProjectReaderTests-52211227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-76c470f1-86d4-4900-a622-f49b43fc429f tempest-ProjectReaderTests-52211227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:26 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-76c470f1-86d4-4900-a622-f49b43fc429f tempest-ProjectReaderTests-52211227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1901348448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ca42887-f58a-43c5-8023-fb4e01639209,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f7543db08c34eb8a6438e5f976970f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:27Z,use_quota=True,user_id='800c289ad53d4684959400fbac917598',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:31:26 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-76c470f1-86d4-4900-a622-f49b43fc429f tempest-ProjectReaderTests-52211227 None] Creating volume 6ca42887-f58a-43c5-8023-fb4e01639209 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:31:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-76c470f1-86d4-4900-a622-f49b43fc429f tempest-ProjectReaderTests-52211227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-76c470f1-86d4-4900-a622-f49b43fc429f tempest-ProjectReaderTests-52211227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:26 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-76c470f1-86d4-4900-a622-f49b43fc429f tempest-ProjectReaderTests-52211227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:26 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-76c470f1-86d4-4900-a622-f49b43fc429f tempest-ProjectReaderTests-52211227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-76c470f1-86d4-4900-a622-f49b43fc429f tempest-ProjectReaderTests-52211227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:26 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-76c470f1-86d4-4900-a622-f49b43fc429f tempest-ProjectReaderTests-52211227 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:31:26 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-76c470f1-86d4-4900-a622-f49b43fc429f tempest-ProjectReaderTests-52211227 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:31:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-76c470f1-86d4-4900-a622-f49b43fc429f tempest-ProjectReaderTests-52211227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6ca42887-f58a-43c5-8023-fb4e01639209 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:26 devstack sudo[104825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6ca42887-f58a-43c5-8023-fb4e01639209 1073741824 Sep 23 00:31:26 devstack sudo[104825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:27 devstack sudo[104825]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-76c470f1-86d4-4900-a622-f49b43fc429f tempest-ProjectReaderTests-52211227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6ca42887-f58a-43c5-8023-fb4e01639209 1073741824" returned: 0 in 0.459s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-76c470f1-86d4-4900-a622-f49b43fc429f tempest-ProjectReaderTests-52211227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6ca42887-f58a-43c5-8023-fb4e01639209 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:27 devstack sudo[104832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6ca42887-f58a-43c5-8023-fb4e01639209 Sep 23 00:31:27 devstack sudo[104832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:27 devstack sudo[104832]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-76c470f1-86d4-4900-a622-f49b43fc429f tempest-ProjectReaderTests-52211227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6ca42887-f58a-43c5-8023-fb4e01639209" returned: 0 in 0.258s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:27 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-76c470f1-86d4-4900-a622-f49b43fc429f tempest-ProjectReaderTests-52211227 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:31:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-76c470f1-86d4-4900-a622-f49b43fc429f tempest-ProjectReaderTests-52211227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:27 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-76c470f1-86d4-4900-a622-f49b43fc429f tempest-ProjectReaderTests-52211227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7e8a1af-be94-4b40-9243-cb5bb71b2b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ca42887-f58a-43c5-8023-fb4e01639209', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:27 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-76c470f1-86d4-4900-a622-f49b43fc429f tempest-ProjectReaderTests-52211227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c63251ce-d883-4322-b406-c6f0ba2cf4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:27 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-76c470f1-86d4-4900-a622-f49b43fc429f tempest-ProjectReaderTests-52211227 None] Volume volume-6ca42887-f58a-43c5-8023-fb4e01639209 (6ca42887-f58a-43c5-8023-fb4e01639209): created successfully Sep 23 00:31:27 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-76c470f1-86d4-4900-a622-f49b43fc429f tempest-ProjectReaderTests-52211227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c63251ce-d883-4322-b406-c6f0ba2cf4ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:27 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-76c470f1-86d4-4900-a622-f49b43fc429f tempest-ProjectReaderTests-52211227 None] Flow 'volume_create_manager' (e00fecac-a3e9-4d37-ba12-fa0b29a4e874) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:27 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-76c470f1-86d4-4900-a622-f49b43fc429f tempest-ProjectReaderTests-52211227 None] Created volume successfully. Sep 23 00:31:28 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-37b36370-f5a1-454f-a6bb-28d22fcf8703 tempest-ProjectReaderTests-52211227 None] Acquiring lock "cinder-6ca42887-f58a-43c5-8023-fb4e01639209-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:28 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-37b36370-f5a1-454f-a6bb-28d22fcf8703 tempest-ProjectReaderTests-52211227 None] Lock "cinder-6ca42887-f58a-43c5-8023-fb4e01639209-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:28 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-37b36370-f5a1-454f-a6bb-28d22fcf8703 tempest-ProjectReaderTests-52211227 None] Acquiring lock "cinder-quobyte-6ca42887-f58a-43c5-8023-fb4e01639209" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:28 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-37b36370-f5a1-454f-a6bb-28d22fcf8703 tempest-ProjectReaderTests-52211227 None] Lock "cinder-quobyte-6ca42887-f58a-43c5-8023-fb4e01639209" acquired by "delete_volume" :: waited 0.017s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:29 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[4372fb15-6a7e-467f-be51-ac107bc73587]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-37b36370-f5a1-454f-a6bb-28d22fcf8703 tempest-ProjectReaderTests-52211227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6ca42887-f58a-43c5-8023-fb4e01639209 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:29 devstack sudo[104837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6ca42887-f58a-43c5-8023-fb4e01639209 Sep 23 00:31:29 devstack sudo[104837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:29 devstack sudo[104837]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-37b36370-f5a1-454f-a6bb-28d22fcf8703 tempest-ProjectReaderTests-52211227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6ca42887-f58a-43c5-8023-fb4e01639209" returned: 0 in 0.389s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-37b36370-f5a1-454f-a6bb-28d22fcf8703 tempest-ProjectReaderTests-52211227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6ca42887-f58a-43c5-8023-fb4e01639209 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:29 devstack sudo[104842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6ca42887-f58a-43c5-8023-fb4e01639209 Sep 23 00:31:29 devstack sudo[104842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:29 devstack sudo[104842]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-37b36370-f5a1-454f-a6bb-28d22fcf8703 tempest-ProjectReaderTests-52211227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-6ca42887-f58a-43c5-8023-fb4e01639209" returned: 0 in 0.275s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:29 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-37b36370-f5a1-454f-a6bb-28d22fcf8703 tempest-ProjectReaderTests-52211227 None] Lock "cinder-quobyte-6ca42887-f58a-43c5-8023-fb4e01639209" released by "delete_volume" :: held 0.713s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:29 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-37b36370-f5a1-454f-a6bb-28d22fcf8703 tempest-ProjectReaderTests-52211227 None] Created reservations ['b1abd307-3f4a-4e76-9840-a9c7b94d5b3f', '48a37c93-d6c9-4894-b7d9-efa26cfb3eac', 'cbcd7f97-13f3-4849-aefb-4d47a537fd99', 'b6fc8680-c6f1-4354-8c08-55031e5ee83e'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:31:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-37b36370-f5a1-454f-a6bb-28d22fcf8703 tempest-ProjectReaderTests-52211227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-37b36370-f5a1-454f-a6bb-28d22fcf8703 tempest-ProjectReaderTests-52211227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:29 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-37b36370-f5a1-454f-a6bb-28d22fcf8703 tempest-ProjectReaderTests-52211227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:29 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-37b36370-f5a1-454f-a6bb-28d22fcf8703 tempest-ProjectReaderTests-52211227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-37b36370-f5a1-454f-a6bb-28d22fcf8703 tempest-ProjectReaderTests-52211227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-37b36370-f5a1-454f-a6bb-28d22fcf8703 tempest-ProjectReaderTests-52211227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:29 devstack sudo[104845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:31:29 devstack sudo[104845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:30 devstack sudo[104845]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-37b36370-f5a1-454f-a6bb-28d22fcf8703 tempest-ProjectReaderTests-52211227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.290s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:30 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-37b36370-f5a1-454f-a6bb-28d22fcf8703 tempest-ProjectReaderTests-52211227 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:31:30 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-37b36370-f5a1-454f-a6bb-28d22fcf8703 tempest-ProjectReaderTests-52211227 None] Deleted volume successfully. Sep 23 00:31:30 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-37b36370-f5a1-454f-a6bb-28d22fcf8703 tempest-ProjectReaderTests-52211227 None] Lock "cinder-6ca42887-f58a-43c5-8023-fb4e01639209-delete_volume" released by "delete_volume" :: held 1.245s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:39 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:UPDATE=55,cinder:SELECT=38,cinder:INSERT=17,cinder:DELETE=5 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:31:40 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=44,cinder:INSERT=17,cinder:UPDATE=59,cinder:DELETE=5 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:31:43 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b998a35-7f75-4423-8180-cf9d76e5c912 tempest-CreateVolumesFromImageTest-111102826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:31:43 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1b998a35-7f75-4423-8180-cf9d76e5c912 tempest-CreateVolumesFromImageTest-111102826 None] Flow 'volume_create_manager' (5818a42d-6746-45dd-95f7-1d278c22f359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:43 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1b998a35-7f75-4423-8180-cf9d76e5c912 tempest-CreateVolumesFromImageTest-111102826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5af9f18-9e86-4942-9085-9c6584377ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1b998a35-7f75-4423-8180-cf9d76e5c912 tempest-CreateVolumesFromImageTest-111102826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5af9f18-9e86-4942-9085-9c6584377ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1715147662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db59e5f1-33b2-4650-84be-6798a2d09706,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75169b4793fb4d3798d2759eb36eb5ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:44Z,use_quota=True,user_id='19dd697bd3ee4c09a7261b6a65b446ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1b998a35-7f75-4423-8180-cf9d76e5c912 tempest-CreateVolumesFromImageTest-111102826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6da04c10-2171-4831-9e8d-c85b366ad3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1b998a35-7f75-4423-8180-cf9d76e5c912 tempest-CreateVolumesFromImageTest-111102826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6da04c10-2171-4831-9e8d-c85b366ad3ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1b998a35-7f75-4423-8180-cf9d76e5c912 tempest-CreateVolumesFromImageTest-111102826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73f55ebf-591c-40ad-bc35-15c52a6fef64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1b998a35-7f75-4423-8180-cf9d76e5c912 tempest-CreateVolumesFromImageTest-111102826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73f55ebf-591c-40ad-bc35-15c52a6fef64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db59e5f1-33b2-4650-84be-6798a2d09706', 'volume_name': 'volume-db59e5f1-33b2-4650-84be-6798a2d09706', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1b998a35-7f75-4423-8180-cf9d76e5c912 tempest-CreateVolumesFromImageTest-111102826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c541775-beb0-46eb-b9fb-0f469109a229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1b998a35-7f75-4423-8180-cf9d76e5c912 tempest-CreateVolumesFromImageTest-111102826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c541775-beb0-46eb-b9fb-0f469109a229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1b998a35-7f75-4423-8180-cf9d76e5c912 tempest-CreateVolumesFromImageTest-111102826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb1446fe-ba44-4970-9f32-ce10911e85f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:44 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-1b998a35-7f75-4423-8180-cf9d76e5c912 tempest-CreateVolumesFromImageTest-111102826 None] Volume db59e5f1-33b2-4650-84be-6798a2d09706: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db59e5f1-33b2-4650-84be-6798a2d09706', 'volume_size': 1} Sep 23 00:31:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1b998a35-7f75-4423-8180-cf9d76e5c912 tempest-CreateVolumesFromImageTest-111102826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1b998a35-7f75-4423-8180-cf9d76e5c912 tempest-CreateVolumesFromImageTest-111102826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:44 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1b998a35-7f75-4423-8180-cf9d76e5c912 tempest-CreateVolumesFromImageTest-111102826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1715147662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db59e5f1-33b2-4650-84be-6798a2d09706,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75169b4793fb4d3798d2759eb36eb5ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:44Z,use_quota=True,user_id='19dd697bd3ee4c09a7261b6a65b446ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:31:44 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-1b998a35-7f75-4423-8180-cf9d76e5c912 tempest-CreateVolumesFromImageTest-111102826 None] Creating volume db59e5f1-33b2-4650-84be-6798a2d09706 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:31:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1b998a35-7f75-4423-8180-cf9d76e5c912 tempest-CreateVolumesFromImageTest-111102826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1b998a35-7f75-4423-8180-cf9d76e5c912 tempest-CreateVolumesFromImageTest-111102826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:44 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1b998a35-7f75-4423-8180-cf9d76e5c912 tempest-CreateVolumesFromImageTest-111102826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:44 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1b998a35-7f75-4423-8180-cf9d76e5c912 tempest-CreateVolumesFromImageTest-111102826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1b998a35-7f75-4423-8180-cf9d76e5c912 tempest-CreateVolumesFromImageTest-111102826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:44 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1b998a35-7f75-4423-8180-cf9d76e5c912 tempest-CreateVolumesFromImageTest-111102826 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:31:44 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-1b998a35-7f75-4423-8180-cf9d76e5c912 tempest-CreateVolumesFromImageTest-111102826 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:31:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1b998a35-7f75-4423-8180-cf9d76e5c912 tempest-CreateVolumesFromImageTest-111102826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db59e5f1-33b2-4650-84be-6798a2d09706 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:44 devstack sudo[104885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db59e5f1-33b2-4650-84be-6798a2d09706 1073741824 Sep 23 00:31:44 devstack sudo[104885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:44 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-c56c3b84-3103-4497-9cf7-b36898832ce0 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:31:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c56c3b84-3103-4497-9cf7-b36898832ce0 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Flow 'volume_create_manager' (c394839b-126b-4591-b4a2-ab9973c72f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c56c3b84-3103-4497-9cf7-b36898832ce0 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (047eaae4-825c-4229-b2ec-da3aa1652f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c56c3b84-3103-4497-9cf7-b36898832ce0 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (047eaae4-825c-4229-b2ec-da3aa1652f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1749386521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=982cf9b5-7c4d-497f-917d-e13b36a38e8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3130d1b5f264f9e990b49bceefd9339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:44Z,use_quota=True,user_id='1dd39020b759450aaad6d06a652b808b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c56c3b84-3103-4497-9cf7-b36898832ce0 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d4a8392-a516-4920-a8e0-b54294738678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c56c3b84-3103-4497-9cf7-b36898832ce0 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d4a8392-a516-4920-a8e0-b54294738678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c56c3b84-3103-4497-9cf7-b36898832ce0 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d460fd52-2ae3-408a-84ad-3855d3c0acaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c56c3b84-3103-4497-9cf7-b36898832ce0 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d460fd52-2ae3-408a-84ad-3855d3c0acaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '982cf9b5-7c4d-497f-917d-e13b36a38e8e', 'volume_name': 'volume-982cf9b5-7c4d-497f-917d-e13b36a38e8e', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c56c3b84-3103-4497-9cf7-b36898832ce0 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b53859de-c71f-4ee7-9ed0-588ca400d75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c56c3b84-3103-4497-9cf7-b36898832ce0 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b53859de-c71f-4ee7-9ed0-588ca400d75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c56c3b84-3103-4497-9cf7-b36898832ce0 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b5e8854-1dd1-4fc5-b827-e28e9d62eafc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:44 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-c56c3b84-3103-4497-9cf7-b36898832ce0 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Volume 982cf9b5-7c4d-497f-917d-e13b36a38e8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-982cf9b5-7c4d-497f-917d-e13b36a38e8e', 'volume_size': 1} Sep 23 00:31:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c56c3b84-3103-4497-9cf7-b36898832ce0 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:44 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9ac2615-f500-42dc-a379-963838394a08 tempest-CreateVolumesFromImageTest-111102826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:31:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a9ac2615-f500-42dc-a379-963838394a08 tempest-CreateVolumesFromImageTest-111102826 None] Flow 'volume_create_manager' (5afb5ec5-3693-40a8-b9d6-667de98a4547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a9ac2615-f500-42dc-a379-963838394a08 tempest-CreateVolumesFromImageTest-111102826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (057334eb-673a-40dc-aa39-02754ace88b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a9ac2615-f500-42dc-a379-963838394a08 tempest-CreateVolumesFromImageTest-111102826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (057334eb-673a-40dc-aa39-02754ace88b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1589019860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5babfd7-a5cb-40f4-9109-060f9873c265,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75169b4793fb4d3798d2759eb36eb5ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:45Z,use_quota=True,user_id='19dd697bd3ee4c09a7261b6a65b446ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a9ac2615-f500-42dc-a379-963838394a08 tempest-CreateVolumesFromImageTest-111102826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfc6194c-fffb-4ec8-bffa-3e1f119bb3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a9ac2615-f500-42dc-a379-963838394a08 tempest-CreateVolumesFromImageTest-111102826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfc6194c-fffb-4ec8-bffa-3e1f119bb3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a9ac2615-f500-42dc-a379-963838394a08 tempest-CreateVolumesFromImageTest-111102826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d288733-5396-480e-8b14-8c6a7ad3f282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a9ac2615-f500-42dc-a379-963838394a08 tempest-CreateVolumesFromImageTest-111102826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d288733-5396-480e-8b14-8c6a7ad3f282) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5babfd7-a5cb-40f4-9109-060f9873c265', 'volume_name': 'volume-d5babfd7-a5cb-40f4-9109-060f9873c265', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a9ac2615-f500-42dc-a379-963838394a08 tempest-CreateVolumesFromImageTest-111102826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67940bea-5c81-4446-a96f-e88c24ee4bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a9ac2615-f500-42dc-a379-963838394a08 tempest-CreateVolumesFromImageTest-111102826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67940bea-5c81-4446-a96f-e88c24ee4bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:44 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a9ac2615-f500-42dc-a379-963838394a08 tempest-CreateVolumesFromImageTest-111102826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d63e127c-71c5-4396-8885-1f502f8ef070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:44 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-a9ac2615-f500-42dc-a379-963838394a08 tempest-CreateVolumesFromImageTest-111102826 None] Volume d5babfd7-a5cb-40f4-9109-060f9873c265: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5babfd7-a5cb-40f4-9109-060f9873c265', 'volume_size': 1} Sep 23 00:31:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a9ac2615-f500-42dc-a379-963838394a08 tempest-CreateVolumesFromImageTest-111102826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:44 devstack sudo[104885]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1b998a35-7f75-4423-8180-cf9d76e5c912 tempest-CreateVolumesFromImageTest-111102826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db59e5f1-33b2-4650-84be-6798a2d09706 1073741824" returned: 0 in 0.749s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1b998a35-7f75-4423-8180-cf9d76e5c912 tempest-CreateVolumesFromImageTest-111102826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db59e5f1-33b2-4650-84be-6798a2d09706 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:44 devstack sudo[104891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db59e5f1-33b2-4650-84be-6798a2d09706 Sep 23 00:31:44 devstack sudo[104891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:45 devstack sudo[104891]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:45 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa6ffa5b-ea5b-4efd-85e8-0be5921e3132 tempest-CreateVolumesFromImageTest-111102826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:31:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-aa6ffa5b-ea5b-4efd-85e8-0be5921e3132 tempest-CreateVolumesFromImageTest-111102826 None] Flow 'volume_create_manager' (7e536bd2-7b02-475a-aec3-22f3bed96ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-aa6ffa5b-ea5b-4efd-85e8-0be5921e3132 tempest-CreateVolumesFromImageTest-111102826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13b13583-7e52-4995-aef5-b69d9e99fd54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1b998a35-7f75-4423-8180-cf9d76e5c912 tempest-CreateVolumesFromImageTest-111102826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db59e5f1-33b2-4650-84be-6798a2d09706" returned: 0 in 0.502s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:45 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1b998a35-7f75-4423-8180-cf9d76e5c912 tempest-CreateVolumesFromImageTest-111102826 None] <== create_volume: return (1339ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:31:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1b998a35-7f75-4423-8180-cf9d76e5c912 tempest-CreateVolumesFromImageTest-111102826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.342s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c56c3b84-3103-4497-9cf7-b36898832ce0 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.952s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:45 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c56c3b84-3103-4497-9cf7-b36898832ce0 tempest-CreateVolumesFromSnapshotTest-1109491162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1749386521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=982cf9b5-7c4d-497f-917d-e13b36a38e8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3130d1b5f264f9e990b49bceefd9339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:44Z,use_quota=True,user_id='1dd39020b759450aaad6d06a652b808b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:31:45 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-c56c3b84-3103-4497-9cf7-b36898832ce0 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Creating volume 982cf9b5-7c4d-497f-917d-e13b36a38e8e {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:31:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c56c3b84-3103-4497-9cf7-b36898832ce0 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c56c3b84-3103-4497-9cf7-b36898832ce0 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:45 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c56c3b84-3103-4497-9cf7-b36898832ce0 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:45 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c56c3b84-3103-4497-9cf7-b36898832ce0 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c56c3b84-3103-4497-9cf7-b36898832ce0 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:45 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c56c3b84-3103-4497-9cf7-b36898832ce0 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:31:45 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-c56c3b84-3103-4497-9cf7-b36898832ce0 tempest-CreateVolumesFromSnapshotTest-1109491162 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:31:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c56c3b84-3103-4497-9cf7-b36898832ce0 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-982cf9b5-7c4d-497f-917d-e13b36a38e8e 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:45 devstack sudo[104894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-982cf9b5-7c4d-497f-917d-e13b36a38e8e 1073741824 Sep 23 00:31:45 devstack sudo[104894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-aa6ffa5b-ea5b-4efd-85e8-0be5921e3132 tempest-CreateVolumesFromImageTest-111102826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13b13583-7e52-4995-aef5-b69d9e99fd54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-95318225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=002cfb37-e176-41dc-b637-a22948478bf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75169b4793fb4d3798d2759eb36eb5ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:45Z,use_quota=True,user_id='19dd697bd3ee4c09a7261b6a65b446ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-aa6ffa5b-ea5b-4efd-85e8-0be5921e3132 tempest-CreateVolumesFromImageTest-111102826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67de1b03-c13f-4628-ad99-e66137185b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-aa6ffa5b-ea5b-4efd-85e8-0be5921e3132 tempest-CreateVolumesFromImageTest-111102826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67de1b03-c13f-4628-ad99-e66137185b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-aa6ffa5b-ea5b-4efd-85e8-0be5921e3132 tempest-CreateVolumesFromImageTest-111102826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fb27111-fdf7-4ba7-885d-62d4b3fce842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-aa6ffa5b-ea5b-4efd-85e8-0be5921e3132 tempest-CreateVolumesFromImageTest-111102826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fb27111-fdf7-4ba7-885d-62d4b3fce842) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '002cfb37-e176-41dc-b637-a22948478bf2', 'volume_name': 'volume-002cfb37-e176-41dc-b637-a22948478bf2', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-aa6ffa5b-ea5b-4efd-85e8-0be5921e3132 tempest-CreateVolumesFromImageTest-111102826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa557ecf-c786-4b5e-adb1-50e9426c0e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-aa6ffa5b-ea5b-4efd-85e8-0be5921e3132 tempest-CreateVolumesFromImageTest-111102826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa557ecf-c786-4b5e-adb1-50e9426c0e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-aa6ffa5b-ea5b-4efd-85e8-0be5921e3132 tempest-CreateVolumesFromImageTest-111102826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4828790e-a9ab-41c4-9e79-aee0d119fc5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:45 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-aa6ffa5b-ea5b-4efd-85e8-0be5921e3132 tempest-CreateVolumesFromImageTest-111102826 None] Volume 002cfb37-e176-41dc-b637-a22948478bf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-002cfb37-e176-41dc-b637-a22948478bf2', 'volume_size': 1} Sep 23 00:31:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-aa6ffa5b-ea5b-4efd-85e8-0be5921e3132 tempest-CreateVolumesFromImageTest-111102826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1b998a35-7f75-4423-8180-cf9d76e5c912 tempest-CreateVolumesFromImageTest-111102826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb1446fe-ba44-4970-9f32-ce10911e85f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db59e5f1-33b2-4650-84be-6798a2d09706', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1b998a35-7f75-4423-8180-cf9d76e5c912 tempest-CreateVolumesFromImageTest-111102826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1438b821-1432-4f2a-b87d-ff22de792ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:45 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-1b998a35-7f75-4423-8180-cf9d76e5c912 tempest-CreateVolumesFromImageTest-111102826 None] Volume volume-db59e5f1-33b2-4650-84be-6798a2d09706 (db59e5f1-33b2-4650-84be-6798a2d09706): created successfully Sep 23 00:31:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1b998a35-7f75-4423-8180-cf9d76e5c912 tempest-CreateVolumesFromImageTest-111102826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1438b821-1432-4f2a-b87d-ff22de792ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1b998a35-7f75-4423-8180-cf9d76e5c912 tempest-CreateVolumesFromImageTest-111102826 None] Flow 'volume_create_manager' (5818a42d-6746-45dd-95f7-1d278c22f359) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:45 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-1b998a35-7f75-4423-8180-cf9d76e5c912 tempest-CreateVolumesFromImageTest-111102826 None] Created volume successfully. Sep 23 00:31:46 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f9ad52f-a030-4815-b314-ab6914b81493 tempest-CreateVolumesFromImageTest-111102826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:31:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6f9ad52f-a030-4815-b314-ab6914b81493 tempest-CreateVolumesFromImageTest-111102826 None] Flow 'volume_create_manager' (fa306634-bedf-430e-98f2-9df845f2eb5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6f9ad52f-a030-4815-b314-ab6914b81493 tempest-CreateVolumesFromImageTest-111102826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c3a1ea9-24f1-4e62-9037-6adf0a09400c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:46 devstack sudo[104894]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c56c3b84-3103-4497-9cf7-b36898832ce0 tempest-CreateVolumesFromSnapshotTest-1109491162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-982cf9b5-7c4d-497f-917d-e13b36a38e8e 1073741824" returned: 0 in 0.734s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6f9ad52f-a030-4815-b314-ab6914b81493 tempest-CreateVolumesFromImageTest-111102826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c3a1ea9-24f1-4e62-9037-6adf0a09400c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1002418077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fe1a53b-ec51-4a31-bcac-5d5b4a92843d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75169b4793fb4d3798d2759eb36eb5ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:46Z,use_quota=True,user_id='19dd697bd3ee4c09a7261b6a65b446ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6f9ad52f-a030-4815-b314-ab6914b81493 tempest-CreateVolumesFromImageTest-111102826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (864c81cb-c6fd-4b28-9650-c59b229aef32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6f9ad52f-a030-4815-b314-ab6914b81493 tempest-CreateVolumesFromImageTest-111102826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (864c81cb-c6fd-4b28-9650-c59b229aef32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6f9ad52f-a030-4815-b314-ab6914b81493 tempest-CreateVolumesFromImageTest-111102826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7474a8c5-ae68-428d-b7c8-b9ccb4f5d0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6f9ad52f-a030-4815-b314-ab6914b81493 tempest-CreateVolumesFromImageTest-111102826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7474a8c5-ae68-428d-b7c8-b9ccb4f5d0da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fe1a53b-ec51-4a31-bcac-5d5b4a92843d', 'volume_name': 'volume-1fe1a53b-ec51-4a31-bcac-5d5b4a92843d', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6f9ad52f-a030-4815-b314-ab6914b81493 tempest-CreateVolumesFromImageTest-111102826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a8432e1-1556-41e3-9e45-c65307e5b542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6f9ad52f-a030-4815-b314-ab6914b81493 tempest-CreateVolumesFromImageTest-111102826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a8432e1-1556-41e3-9e45-c65307e5b542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6f9ad52f-a030-4815-b314-ab6914b81493 tempest-CreateVolumesFromImageTest-111102826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cab495fa-a23b-42cd-b65b-59e393188909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:46 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-6f9ad52f-a030-4815-b314-ab6914b81493 tempest-CreateVolumesFromImageTest-111102826 None] Volume 1fe1a53b-ec51-4a31-bcac-5d5b4a92843d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fe1a53b-ec51-4a31-bcac-5d5b4a92843d', 'volume_size': 1} Sep 23 00:31:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6f9ad52f-a030-4815-b314-ab6914b81493 tempest-CreateVolumesFromImageTest-111102826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c56c3b84-3103-4497-9cf7-b36898832ce0 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-982cf9b5-7c4d-497f-917d-e13b36a38e8e {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:46 devstack sudo[104900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-982cf9b5-7c4d-497f-917d-e13b36a38e8e Sep 23 00:31:46 devstack sudo[104900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:46 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-936931dd-d58a-45d9-9286-501f59947664 tempest-CreateVolumesFromImageTest-111102826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:31:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-936931dd-d58a-45d9-9286-501f59947664 tempest-CreateVolumesFromImageTest-111102826 None] Flow 'volume_create_manager' (2dff5547-7f58-475e-8b5c-136ad6fcbd09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-936931dd-d58a-45d9-9286-501f59947664 tempest-CreateVolumesFromImageTest-111102826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40cd5893-f94a-423b-bde6-4a45346e1a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:46 devstack sudo[104900]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c56c3b84-3103-4497-9cf7-b36898832ce0 tempest-CreateVolumesFromSnapshotTest-1109491162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-982cf9b5-7c4d-497f-917d-e13b36a38e8e" returned: 0 in 0.343s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c56c3b84-3103-4497-9cf7-b36898832ce0 tempest-CreateVolumesFromSnapshotTest-1109491162 None] <== create_volume: return (1262ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:31:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c56c3b84-3103-4497-9cf7-b36898832ce0 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.266s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a9ac2615-f500-42dc-a379-963838394a08 tempest-CreateVolumesFromImageTest-111102826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.901s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a9ac2615-f500-42dc-a379-963838394a08 tempest-CreateVolumesFromImageTest-111102826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1589019860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5babfd7-a5cb-40f4-9109-060f9873c265,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75169b4793fb4d3798d2759eb36eb5ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:45Z,use_quota=True,user_id='19dd697bd3ee4c09a7261b6a65b446ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:31:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-a9ac2615-f500-42dc-a379-963838394a08 tempest-CreateVolumesFromImageTest-111102826 None] Creating volume d5babfd7-a5cb-40f4-9109-060f9873c265 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:31:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a9ac2615-f500-42dc-a379-963838394a08 tempest-CreateVolumesFromImageTest-111102826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a9ac2615-f500-42dc-a379-963838394a08 tempest-CreateVolumesFromImageTest-111102826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a9ac2615-f500-42dc-a379-963838394a08 tempest-CreateVolumesFromImageTest-111102826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a9ac2615-f500-42dc-a379-963838394a08 tempest-CreateVolumesFromImageTest-111102826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a9ac2615-f500-42dc-a379-963838394a08 tempest-CreateVolumesFromImageTest-111102826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a9ac2615-f500-42dc-a379-963838394a08 tempest-CreateVolumesFromImageTest-111102826 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:31:46 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-a9ac2615-f500-42dc-a379-963838394a08 tempest-CreateVolumesFromImageTest-111102826 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:31:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a9ac2615-f500-42dc-a379-963838394a08 tempest-CreateVolumesFromImageTest-111102826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d5babfd7-a5cb-40f4-9109-060f9873c265 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-936931dd-d58a-45d9-9286-501f59947664 tempest-CreateVolumesFromImageTest-111102826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40cd5893-f94a-423b-bde6-4a45346e1a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-500478446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afe44c0a-ce72-493e-bbcc-668d6988d196,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75169b4793fb4d3798d2759eb36eb5ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:47Z,use_quota=True,user_id='19dd697bd3ee4c09a7261b6a65b446ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-936931dd-d58a-45d9-9286-501f59947664 tempest-CreateVolumesFromImageTest-111102826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ae0d88a-3762-4d90-a0e7-0b05b8448e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:46 devstack sudo[104903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d5babfd7-a5cb-40f4-9109-060f9873c265 1073741824 Sep 23 00:31:46 devstack sudo[104903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-936931dd-d58a-45d9-9286-501f59947664 tempest-CreateVolumesFromImageTest-111102826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ae0d88a-3762-4d90-a0e7-0b05b8448e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-936931dd-d58a-45d9-9286-501f59947664 tempest-CreateVolumesFromImageTest-111102826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e99eb8e-4f13-4dd9-99a3-fd00c75f1a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-936931dd-d58a-45d9-9286-501f59947664 tempest-CreateVolumesFromImageTest-111102826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e99eb8e-4f13-4dd9-99a3-fd00c75f1a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afe44c0a-ce72-493e-bbcc-668d6988d196', 'volume_name': 'volume-afe44c0a-ce72-493e-bbcc-668d6988d196', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-936931dd-d58a-45d9-9286-501f59947664 tempest-CreateVolumesFromImageTest-111102826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bdf1cfd-21b7-4eaa-8097-c45acfeee70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-936931dd-d58a-45d9-9286-501f59947664 tempest-CreateVolumesFromImageTest-111102826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bdf1cfd-21b7-4eaa-8097-c45acfeee70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-936931dd-d58a-45d9-9286-501f59947664 tempest-CreateVolumesFromImageTest-111102826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b09c92e-987f-4827-9628-c7f7c1e55ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:46 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-936931dd-d58a-45d9-9286-501f59947664 tempest-CreateVolumesFromImageTest-111102826 None] Volume afe44c0a-ce72-493e-bbcc-668d6988d196: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afe44c0a-ce72-493e-bbcc-668d6988d196', 'volume_size': 1} Sep 23 00:31:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-936931dd-d58a-45d9-9286-501f59947664 tempest-CreateVolumesFromImageTest-111102826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c56c3b84-3103-4497-9cf7-b36898832ce0 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b5e8854-1dd1-4fc5-b827-e28e9d62eafc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-982cf9b5-7c4d-497f-917d-e13b36a38e8e', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c56c3b84-3103-4497-9cf7-b36898832ce0 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e6a2f19-57dc-4130-a7bd-8bc2cd024234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:46 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-c56c3b84-3103-4497-9cf7-b36898832ce0 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Volume volume-982cf9b5-7c4d-497f-917d-e13b36a38e8e (982cf9b5-7c4d-497f-917d-e13b36a38e8e): created successfully Sep 23 00:31:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c56c3b84-3103-4497-9cf7-b36898832ce0 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e6a2f19-57dc-4130-a7bd-8bc2cd024234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c56c3b84-3103-4497-9cf7-b36898832ce0 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Flow 'volume_create_manager' (c394839b-126b-4591-b4a2-ab9973c72f4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:46 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-c56c3b84-3103-4497-9cf7-b36898832ce0 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Created volume successfully. Sep 23 00:31:47 devstack sudo[104903]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a9ac2615-f500-42dc-a379-963838394a08 tempest-CreateVolumesFromImageTest-111102826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d5babfd7-a5cb-40f4-9109-060f9873c265 1073741824" returned: 0 in 0.564s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a9ac2615-f500-42dc-a379-963838394a08 tempest-CreateVolumesFromImageTest-111102826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d5babfd7-a5cb-40f4-9109-060f9873c265 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:47 devstack sudo[104909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d5babfd7-a5cb-40f4-9109-060f9873c265 Sep 23 00:31:47 devstack sudo[104909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:47 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:31:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] Flow 'volume_create_manager' (b6d0c438-624f-41a8-b91f-fe29f021b7ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:47 devstack sudo[104909]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e469f15-4c91-4fc1-8a5f-ad4ac922cdbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a9ac2615-f500-42dc-a379-963838394a08 tempest-CreateVolumesFromImageTest-111102826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d5babfd7-a5cb-40f4-9109-060f9873c265" returned: 0 in 0.421s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:47 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a9ac2615-f500-42dc-a379-963838394a08 tempest-CreateVolumesFromImageTest-111102826 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:31:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a9ac2615-f500-42dc-a379-963838394a08 tempest-CreateVolumesFromImageTest-111102826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-aa6ffa5b-ea5b-4efd-85e8-0be5921e3132 tempest-CreateVolumesFromImageTest-111102826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.088s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:47 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-aa6ffa5b-ea5b-4efd-85e8-0be5921e3132 tempest-CreateVolumesFromImageTest-111102826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-95318225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=002cfb37-e176-41dc-b637-a22948478bf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75169b4793fb4d3798d2759eb36eb5ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:45Z,use_quota=True,user_id='19dd697bd3ee4c09a7261b6a65b446ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:31:47 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-aa6ffa5b-ea5b-4efd-85e8-0be5921e3132 tempest-CreateVolumesFromImageTest-111102826 None] Creating volume 002cfb37-e176-41dc-b637-a22948478bf2 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:31:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-aa6ffa5b-ea5b-4efd-85e8-0be5921e3132 tempest-CreateVolumesFromImageTest-111102826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-aa6ffa5b-ea5b-4efd-85e8-0be5921e3132 tempest-CreateVolumesFromImageTest-111102826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:47 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-aa6ffa5b-ea5b-4efd-85e8-0be5921e3132 tempest-CreateVolumesFromImageTest-111102826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:47 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-aa6ffa5b-ea5b-4efd-85e8-0be5921e3132 tempest-CreateVolumesFromImageTest-111102826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-aa6ffa5b-ea5b-4efd-85e8-0be5921e3132 tempest-CreateVolumesFromImageTest-111102826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:47 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-aa6ffa5b-ea5b-4efd-85e8-0be5921e3132 tempest-CreateVolumesFromImageTest-111102826 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:31:47 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-aa6ffa5b-ea5b-4efd-85e8-0be5921e3132 tempest-CreateVolumesFromImageTest-111102826 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:31:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-aa6ffa5b-ea5b-4efd-85e8-0be5921e3132 tempest-CreateVolumesFromImageTest-111102826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-002cfb37-e176-41dc-b637-a22948478bf2 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e469f15-4c91-4fc1-8a5f-ad4ac922cdbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:47Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=184ef56e-79e6-465e-bd7e-ec2deb62c232,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00c87d0dd4264be2bf01894606547705',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:48Z,use_quota=True,user_id='25c9375a66a64016992b9e10ce1fd8eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (257dcad2-53d2-473c-be52-bdd65c92f9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (257dcad2-53d2-473c-be52-bdd65c92f9c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:47 devstack sudo[104913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-002cfb37-e176-41dc-b637-a22948478bf2 1073741824 Sep 23 00:31:47 devstack sudo[104913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7103bab1-ceea-4375-a1ee-7ea9ea56e96a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:47 devstack cinder-volume[86591]: DEBUG cinder.image.glance [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] Creating Keystone auth plugin from conf {{(pid=86591) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 00:31:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a9ac2615-f500-42dc-a379-963838394a08 tempest-CreateVolumesFromImageTest-111102826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d63e127c-71c5-4396-8885-1f502f8ef070) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5babfd7-a5cb-40f4-9109-060f9873c265', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a9ac2615-f500-42dc-a379-963838394a08 tempest-CreateVolumesFromImageTest-111102826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d57f008d-be7b-43f8-a0e7-eb1bd4b8ea64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:47 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-a9ac2615-f500-42dc-a379-963838394a08 tempest-CreateVolumesFromImageTest-111102826 None] Volume volume-d5babfd7-a5cb-40f4-9109-060f9873c265 (d5babfd7-a5cb-40f4-9109-060f9873c265): created successfully Sep 23 00:31:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a9ac2615-f500-42dc-a379-963838394a08 tempest-CreateVolumesFromImageTest-111102826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d57f008d-be7b-43f8-a0e7-eb1bd4b8ea64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a9ac2615-f500-42dc-a379-963838394a08 tempest-CreateVolumesFromImageTest-111102826 None] Flow 'volume_create_manager' (5afb5ec5-3693-40a8-b9d6-667de98a4547) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-3078f4b4-28cd-4fe9-9437-2dd4d6dec928 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:47 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-a9ac2615-f500-42dc-a379-963838394a08 tempest-CreateVolumesFromImageTest-111102826 None] Created volume successfully. Sep 23 00:31:48 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7103bab1-ceea-4375-a1ee-7ea9ea56e96a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '184ef56e-79e6-465e-bd7e-ec2deb62c232', 'volume_name': 'volume-184ef56e-79e6-465e-bd7e-ec2deb62c232', 'volume_size': 1, 'image_id': '4d8c0e61-5fb9-4d40-a303-cf0f508fc38c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4d8c0e61-5fb9-4d40-a303-cf0f508fc38c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e89525ed9cbcfa9b8ebec548777862e7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '00c87d0dd4264be2bf01894606547705', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2b051138029422e60d0f3e88a671462a8cea8e4ab6584fb248679b7183d84b5e84b6c40e47edd940f96c75c75963013821eef681b55f816b2985da727aff1474', 'id': '4d8c0e61-5fb9-4d40-a303-cf0f508fc38c', 'created_at': datetime.datetime(2026, 9, 22, 22, 31, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 31, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4d8c0e61-5fb9-4d40-a303-cf0f508fc38c/file', 'properties': {}}, 'image_service': }' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:48 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (447d3c6c-62a8-4ad4-9e36-e11593504d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:48 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (447d3c6c-62a8-4ad4-9e36-e11593504d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:48 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c06fdb6-5ef0-46fc-9baa-7f4b1b7cbc03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:48 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] Volume 184ef56e-79e6-465e-bd7e-ec2deb62c232: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-184ef56e-79e6-465e-bd7e-ec2deb62c232', 'volume_size': 1, 'image_id': '4d8c0e61-5fb9-4d40-a303-cf0f508fc38c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4d8c0e61-5fb9-4d40-a303-cf0f508fc38c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e89525ed9cbcfa9b8ebec548777862e7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '00c87d0dd4264be2bf01894606547705', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2b051138029422e60d0f3e88a671462a8cea8e4ab6584fb248679b7183d84b5e84b6c40e47edd940f96c75c75963013821eef681b55f816b2985da727aff1474', 'id': '4d8c0e61-5fb9-4d40-a303-cf0f508fc38c', 'created_at': datetime.datetime(2026, 9, 22, 22, 31, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 31, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4d8c0e61-5fb9-4d40-a303-cf0f508fc38c/file', 'properties': {}}, 'image_service': } Sep 23 00:31:48 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] Trying to clone 184ef56e-79e6-465e-bd7e-ec2deb62c232 from image 4d8c0e61-5fb9-4d40-a303-cf0f508fc38c at location (None, [{'url': 'file:///opt/stack/data/glance/images/4d8c0e61-5fb9-4d40-a303-cf0f508fc38c', 'metadata': {}}]). {{(pid=86591) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 00:31:48 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4d8c0e61-5fb9-4d40-a303-cf0f508fc38c_18vm5it3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86591) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 00:31:48 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] Image download 0.00 MB at 0.00 MB/s Sep 23 00:31:48 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a6844f-f6c6-4f27-a888-08ae8bb553c6]: (4, 'raw') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4d8c0e61-5fb9-4d40-a303-cf0f508fc38c_18vm5it3devstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:48 devstack sudo[104913]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-aa6ffa5b-ea5b-4efd-85e8-0be5921e3132 tempest-CreateVolumesFromImageTest-111102826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-002cfb37-e176-41dc-b637-a22948478bf2 1073741824" returned: 0 in 0.649s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-aa6ffa5b-ea5b-4efd-85e8-0be5921e3132 tempest-CreateVolumesFromImageTest-111102826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-002cfb37-e176-41dc-b637-a22948478bf2 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:48 devstack sudo[104920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-002cfb37-e176-41dc-b637-a22948478bf2 Sep 23 00:31:48 devstack sudo[104920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:48 devstack sudo[104919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4d8c0e61-5fb9-4d40-a303-cf0f508fc38c_18vm5it3devstack@QuobyteHD Sep 23 00:31:48 devstack sudo[104919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:48 devstack sudo[104919]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4d8c0e61-5fb9-4d40-a303-cf0f508fc38c_18vm5it3devstack@QuobyteHD" returned: 0 in 0.444s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4d8c0e61-5fb9-4d40-a303-cf0f508fc38c_18vm5it3devstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:48 devstack sudo[104920]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-aa6ffa5b-ea5b-4efd-85e8-0be5921e3132 tempest-CreateVolumesFromImageTest-111102826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-002cfb37-e176-41dc-b637-a22948478bf2" returned: 0 in 0.407s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:48 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-aa6ffa5b-ea5b-4efd-85e8-0be5921e3132 tempest-CreateVolumesFromImageTest-111102826 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:31:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-aa6ffa5b-ea5b-4efd-85e8-0be5921e3132 tempest-CreateVolumesFromImageTest-111102826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6f9ad52f-a030-4815-b314-ab6914b81493 tempest-CreateVolumesFromImageTest-111102826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.587s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:48 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6f9ad52f-a030-4815-b314-ab6914b81493 tempest-CreateVolumesFromImageTest-111102826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1002418077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fe1a53b-ec51-4a31-bcac-5d5b4a92843d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75169b4793fb4d3798d2759eb36eb5ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:46Z,use_quota=True,user_id='19dd697bd3ee4c09a7261b6a65b446ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:31:48 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-6f9ad52f-a030-4815-b314-ab6914b81493 tempest-CreateVolumesFromImageTest-111102826 None] Creating volume 1fe1a53b-ec51-4a31-bcac-5d5b4a92843d {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:31:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6f9ad52f-a030-4815-b314-ab6914b81493 tempest-CreateVolumesFromImageTest-111102826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6f9ad52f-a030-4815-b314-ab6914b81493 tempest-CreateVolumesFromImageTest-111102826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:48 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6f9ad52f-a030-4815-b314-ab6914b81493 tempest-CreateVolumesFromImageTest-111102826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:48 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6f9ad52f-a030-4815-b314-ab6914b81493 tempest-CreateVolumesFromImageTest-111102826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6f9ad52f-a030-4815-b314-ab6914b81493 tempest-CreateVolumesFromImageTest-111102826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:48 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6f9ad52f-a030-4815-b314-ab6914b81493 tempest-CreateVolumesFromImageTest-111102826 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:31:48 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-6f9ad52f-a030-4815-b314-ab6914b81493 tempest-CreateVolumesFromImageTest-111102826 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:31:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6f9ad52f-a030-4815-b314-ab6914b81493 tempest-CreateVolumesFromImageTest-111102826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1fe1a53b-ec51-4a31-bcac-5d5b4a92843d 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:48 devstack sudo[104927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1fe1a53b-ec51-4a31-bcac-5d5b4a92843d 1073741824 Sep 23 00:31:48 devstack sudo[104927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:48 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-aa6ffa5b-ea5b-4efd-85e8-0be5921e3132 tempest-CreateVolumesFromImageTest-111102826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4828790e-a9ab-41c4-9e79-aee0d119fc5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-002cfb37-e176-41dc-b637-a22948478bf2', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:48 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-aa6ffa5b-ea5b-4efd-85e8-0be5921e3132 tempest-CreateVolumesFromImageTest-111102826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34d7f216-63c1-4e76-9300-f4fdf022e6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:48 devstack sudo[104926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4d8c0e61-5fb9-4d40-a303-cf0f508fc38c_18vm5it3devstack@QuobyteHD Sep 23 00:31:48 devstack sudo[104926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:48 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-aa6ffa5b-ea5b-4efd-85e8-0be5921e3132 tempest-CreateVolumesFromImageTest-111102826 None] Volume volume-002cfb37-e176-41dc-b637-a22948478bf2 (002cfb37-e176-41dc-b637-a22948478bf2): created successfully Sep 23 00:31:48 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-aa6ffa5b-ea5b-4efd-85e8-0be5921e3132 tempest-CreateVolumesFromImageTest-111102826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34d7f216-63c1-4e76-9300-f4fdf022e6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:48 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-aa6ffa5b-ea5b-4efd-85e8-0be5921e3132 tempest-CreateVolumesFromImageTest-111102826 None] Flow 'volume_create_manager' (7e536bd2-7b02-475a-aec3-22f3bed96ca2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:49 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-aa6ffa5b-ea5b-4efd-85e8-0be5921e3132 tempest-CreateVolumesFromImageTest-111102826 None] Created volume successfully. Sep 23 00:31:49 devstack sudo[104926]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4d8c0e61-5fb9-4d40-a303-cf0f508fc38c_18vm5it3devstack@QuobyteHD" returned: 1 in 0.439s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4d8c0e61-5fb9-4d40-a303-cf0f508fc38c_18vm5it3devstack@QuobyteHD' failed. Not Retrying. {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:31:49 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] Temporary image 4d8c0e61-5fb9-4d40-a303-cf0f508fc38c is fetched for user 25c9375a66a64016992b9e10ce1fd8eb. {{(pid=86591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 00:31:49 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[f988470b-1841-4e51-8d12-db27e6fa7404]: (4, 'raw') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4d8c0e61-5fb9-4d40-a303-cf0f508fc38c_18vm5it3devstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:49 devstack sudo[104936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4d8c0e61-5fb9-4d40-a303-cf0f508fc38c_18vm5it3devstack@QuobyteHD Sep 23 00:31:49 devstack sudo[104936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:49 devstack sudo[104927]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6f9ad52f-a030-4815-b314-ab6914b81493 tempest-CreateVolumesFromImageTest-111102826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1fe1a53b-ec51-4a31-bcac-5d5b4a92843d 1073741824" returned: 0 in 0.648s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6f9ad52f-a030-4815-b314-ab6914b81493 tempest-CreateVolumesFromImageTest-111102826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1fe1a53b-ec51-4a31-bcac-5d5b4a92843d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:49 devstack sudo[104939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1fe1a53b-ec51-4a31-bcac-5d5b4a92843d Sep 23 00:31:49 devstack sudo[104939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:49 devstack sudo[104936]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4d8c0e61-5fb9-4d40-a303-cf0f508fc38c_18vm5it3devstack@QuobyteHD" returned: 0 in 0.457s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4d8c0e61-5fb9-4d40-a303-cf0f508fc38c_18vm5it3devstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:49 devstack sudo[104943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4d8c0e61-5fb9-4d40-a303-cf0f508fc38c_18vm5it3devstack@QuobyteHD Sep 23 00:31:49 devstack sudo[104943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:49 devstack sudo[104939]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6f9ad52f-a030-4815-b314-ab6914b81493 tempest-CreateVolumesFromImageTest-111102826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1fe1a53b-ec51-4a31-bcac-5d5b4a92843d" returned: 0 in 0.369s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:49 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6f9ad52f-a030-4815-b314-ab6914b81493 tempest-CreateVolumesFromImageTest-111102826 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:31:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6f9ad52f-a030-4815-b314-ab6914b81493 tempest-CreateVolumesFromImageTest-111102826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-936931dd-d58a-45d9-9286-501f59947664 tempest-CreateVolumesFromImageTest-111102826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.195s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:49 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-936931dd-d58a-45d9-9286-501f59947664 tempest-CreateVolumesFromImageTest-111102826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-500478446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afe44c0a-ce72-493e-bbcc-668d6988d196,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75169b4793fb4d3798d2759eb36eb5ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:47Z,use_quota=True,user_id='19dd697bd3ee4c09a7261b6a65b446ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:31:49 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-936931dd-d58a-45d9-9286-501f59947664 tempest-CreateVolumesFromImageTest-111102826 None] Creating volume afe44c0a-ce72-493e-bbcc-668d6988d196 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:31:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-936931dd-d58a-45d9-9286-501f59947664 tempest-CreateVolumesFromImageTest-111102826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-936931dd-d58a-45d9-9286-501f59947664 tempest-CreateVolumesFromImageTest-111102826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:49 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-936931dd-d58a-45d9-9286-501f59947664 tempest-CreateVolumesFromImageTest-111102826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:49 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-936931dd-d58a-45d9-9286-501f59947664 tempest-CreateVolumesFromImageTest-111102826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-936931dd-d58a-45d9-9286-501f59947664 tempest-CreateVolumesFromImageTest-111102826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:49 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-936931dd-d58a-45d9-9286-501f59947664 tempest-CreateVolumesFromImageTest-111102826 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:31:49 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-936931dd-d58a-45d9-9286-501f59947664 tempest-CreateVolumesFromImageTest-111102826 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:31:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-936931dd-d58a-45d9-9286-501f59947664 tempest-CreateVolumesFromImageTest-111102826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-afe44c0a-ce72-493e-bbcc-668d6988d196 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6f9ad52f-a030-4815-b314-ab6914b81493 tempest-CreateVolumesFromImageTest-111102826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cab495fa-a23b-42cd-b65b-59e393188909) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fe1a53b-ec51-4a31-bcac-5d5b4a92843d', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:50 devstack sudo[104946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-afe44c0a-ce72-493e-bbcc-668d6988d196 1073741824 Sep 23 00:31:50 devstack sudo[104946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6f9ad52f-a030-4815-b314-ab6914b81493 tempest-CreateVolumesFromImageTest-111102826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f75832f-e9e4-4d41-bfe5-8819950e4227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:50 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:31:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Flow 'volume_create_manager' (0a69ea9c-e901-464a-981b-bf5f5b21548f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (645b8f1c-b8a0-4bfd-8b60-30b1b7a4d3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:50 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-6f9ad52f-a030-4815-b314-ab6914b81493 tempest-CreateVolumesFromImageTest-111102826 None] Volume volume-1fe1a53b-ec51-4a31-bcac-5d5b4a92843d (1fe1a53b-ec51-4a31-bcac-5d5b4a92843d): created successfully Sep 23 00:31:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6f9ad52f-a030-4815-b314-ab6914b81493 tempest-CreateVolumesFromImageTest-111102826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f75832f-e9e4-4d41-bfe5-8819950e4227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-6f9ad52f-a030-4815-b314-ab6914b81493 tempest-CreateVolumesFromImageTest-111102826 None] Flow 'volume_create_manager' (fa306634-bedf-430e-98f2-9df845f2eb5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (645b8f1c-b8a0-4bfd-8b60-30b1b7a4d3e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f73115d-30c9-4bcd-813c-5fa88b3bd898,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d66d3b96c8a94649a6e45489c8f224ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:50Z,use_quota=True,user_id='f1b9b8178d4246dca7c79efdd27c390d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa343a75-e9af-4098-a972-a5ee5b9d741f),volume_type_id=aa343a75-e9af-4098-a972-a5ee5b9d741f)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27dcd9c6-1e50-4df4-a4c7-7f511bc26f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27dcd9c6-1e50-4df4-a4c7-7f511bc26f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01b7778d-ecd6-4ac9-b312-f080a9542335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:50 devstack cinder-volume[86591]: DEBUG cinder.image.glance [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Creating Keystone auth plugin from conf {{(pid=86591) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 00:31:50 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-6f9ad52f-a030-4815-b314-ab6914b81493 tempest-CreateVolumesFromImageTest-111102826 None] Created volume successfully. Sep 23 00:31:50 devstack sudo[104943]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4d8c0e61-5fb9-4d40-a303-cf0f508fc38c_18vm5it3devstack@QuobyteHD" returned: 1 in 0.368s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4d8c0e61-5fb9-4d40-a303-cf0f508fc38c_18vm5it3devstack@QuobyteHD' failed. Not Retrying. {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:31:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01b7778d-ecd6-4ac9-b312-f080a9542335) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3f73115d-30c9-4bcd-813c-5fa88b3bd898', 'volume_name': 'volume-3f73115d-30c9-4bcd-813c-5fa88b3bd898', 'volume_size': 1, 'image_id': '66a58d32-4194-441d-a910-0ebf7286e8c9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/66a58d32-4194-441d-a910-0ebf7286e8c9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e5d6a0a5f549a3740ec3d52cceab93e4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd66d3b96c8a94649a6e45489c8f224ad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fa197e54b240b882de4d62b31a354fa310e84dd01cfcf898c39879b1383b17efe3e275d9e8e84c4bd27645e7ff8e6c2605015d46cd0752d3268b2c91a5a57e49', 'id': '66a58d32-4194-441d-a910-0ebf7286e8c9', 'created_at': datetime.datetime(2026, 9, 22, 22, 31, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 31, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/66a58d32-4194-441d-a910-0ebf7286e8c9/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cac7ac0-ffaa-4545-8b20-e9aeac3bb31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cac7ac0-ffaa-4545-8b20-e9aeac3bb31f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (209e0a85-4f5d-49ab-a1af-40f026c7c035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:50 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Volume 3f73115d-30c9-4bcd-813c-5fa88b3bd898: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3f73115d-30c9-4bcd-813c-5fa88b3bd898', 'volume_size': 1, 'image_id': '66a58d32-4194-441d-a910-0ebf7286e8c9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/66a58d32-4194-441d-a910-0ebf7286e8c9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e5d6a0a5f549a3740ec3d52cceab93e4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd66d3b96c8a94649a6e45489c8f224ad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fa197e54b240b882de4d62b31a354fa310e84dd01cfcf898c39879b1383b17efe3e275d9e8e84c4bd27645e7ff8e6c2605015d46cd0752d3268b2c91a5a57e49', 'id': '66a58d32-4194-441d-a910-0ebf7286e8c9', 'created_at': datetime.datetime(2026, 9, 22, 22, 31, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 31, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/66a58d32-4194-441d-a910-0ebf7286e8c9/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 23 00:31:50 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Trying to clone 3f73115d-30c9-4bcd-813c-5fa88b3bd898 from image 66a58d32-4194-441d-a910-0ebf7286e8c9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/66a58d32-4194-441d-a910-0ebf7286e8c9', 'metadata': {}}]). {{(pid=86591) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 00:31:50 devstack sudo[104946]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-936931dd-d58a-45d9-9286-501f59947664 tempest-CreateVolumesFromImageTest-111102826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-afe44c0a-ce72-493e-bbcc-668d6988d196 1073741824" returned: 0 in 0.456s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:50 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_66a58d32-4194-441d-a910-0ebf7286e8c9_sxxourvtdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86591) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 00:31:50 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Image download 0.00 MB at 0.00 MB/s Sep 23 00:31:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-936931dd-d58a-45d9-9286-501f59947664 tempest-CreateVolumesFromImageTest-111102826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-afe44c0a-ce72-493e-bbcc-668d6988d196 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:50 devstack sudo[104955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-afe44c0a-ce72-493e-bbcc-668d6988d196 Sep 23 00:31:50 devstack sudo[104955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:50 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a33386-a85d-492c-a81c-b2d34ec60611]: (4, 'raw') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_66a58d32-4194-441d-a910-0ebf7286e8c9_sxxourvtdevstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:50 devstack sudo[104957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_66a58d32-4194-441d-a910-0ebf7286e8c9_sxxourvtdevstack@QuobyteHD Sep 23 00:31:50 devstack sudo[104957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:50 devstack sudo[104955]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-936931dd-d58a-45d9-9286-501f59947664 tempest-CreateVolumesFromImageTest-111102826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-afe44c0a-ce72-493e-bbcc-668d6988d196" returned: 0 in 0.295s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:50 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-936931dd-d58a-45d9-9286-501f59947664 tempest-CreateVolumesFromImageTest-111102826 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:31:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-936931dd-d58a-45d9-9286-501f59947664 tempest-CreateVolumesFromImageTest-111102826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-3078f4b4-28cd-4fe9-9437-2dd4d6dec928 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.869s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:50 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-3078f4b4-28cd-4fe9-9437-2dd4d6dec928 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Creating offline snapshot 33466645-a7c6-4fff-9619-e2ec5c1fe6e5 of volume 982cf9b5-7c4d-497f-917d-e13b36a38e8e {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:31:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-936931dd-d58a-45d9-9286-501f59947664 tempest-CreateVolumesFromImageTest-111102826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b09c92e-987f-4827-9628-c7f7c1e55ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afe44c0a-ce72-493e-bbcc-668d6988d196', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-936931dd-d58a-45d9-9286-501f59947664 tempest-CreateVolumesFromImageTest-111102826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9625b932-5ea5-4ebb-968e-9145d71f2ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:50 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e902c5b-cd37-426d-ab13-47fac0260f86]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3078f4b4-28cd-4fe9-9437-2dd4d6dec928 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-982cf9b5-7c4d-497f-917d-e13b36a38e8e {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:50 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-936931dd-d58a-45d9-9286-501f59947664 tempest-CreateVolumesFromImageTest-111102826 None] Volume volume-afe44c0a-ce72-493e-bbcc-668d6988d196 (afe44c0a-ce72-493e-bbcc-668d6988d196): created successfully Sep 23 00:31:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-936931dd-d58a-45d9-9286-501f59947664 tempest-CreateVolumesFromImageTest-111102826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9625b932-5ea5-4ebb-968e-9145d71f2ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:50 devstack sudo[104957]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:50 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-936931dd-d58a-45d9-9286-501f59947664 tempest-CreateVolumesFromImageTest-111102826 None] Flow 'volume_create_manager' (2dff5547-7f58-475e-8b5c-136ad6fcbd09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_66a58d32-4194-441d-a910-0ebf7286e8c9_sxxourvtdevstack@QuobyteHD" returned: 0 in 0.367s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66a58d32-4194-441d-a910-0ebf7286e8c9_sxxourvtdevstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:50 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-936931dd-d58a-45d9-9286-501f59947664 tempest-CreateVolumesFromImageTest-111102826 None] Created volume successfully. Sep 23 00:31:50 devstack sudo[104962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-982cf9b5-7c4d-497f-917d-e13b36a38e8e Sep 23 00:31:50 devstack sudo[104962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:51 devstack sudo[104963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66a58d32-4194-441d-a910-0ebf7286e8c9_sxxourvtdevstack@QuobyteHD Sep 23 00:31:51 devstack sudo[104963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:51 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-916a13b9-cf90-4966-9a80-cd6ea87e446d tempest-CreateVolumesFromImageTest-111102826 None] Acquiring lock "cinder-afe44c0a-ce72-493e-bbcc-668d6988d196-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:51 devstack sudo[104963]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:51 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-916a13b9-cf90-4966-9a80-cd6ea87e446d tempest-CreateVolumesFromImageTest-111102826 None] Lock "cinder-afe44c0a-ce72-493e-bbcc-668d6988d196-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66a58d32-4194-441d-a910-0ebf7286e8c9_sxxourvtdevstack@QuobyteHD" returned: 1 in 0.435s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66a58d32-4194-441d-a910-0ebf7286e8c9_sxxourvtdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:31:51 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Temporary image 66a58d32-4194-441d-a910-0ebf7286e8c9 is fetched for user f1b9b8178d4246dca7c79efdd27c390d. {{(pid=86591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 00:31:51 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-916a13b9-cf90-4966-9a80-cd6ea87e446d tempest-CreateVolumesFromImageTest-111102826 None] Acquiring lock "cinder-quobyte-afe44c0a-ce72-493e-bbcc-668d6988d196" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:51 devstack sudo[104962]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3078f4b4-28cd-4fe9-9437-2dd4d6dec928 tempest-CreateVolumesFromSnapshotTest-1109491162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-982cf9b5-7c4d-497f-917d-e13b36a38e8e" returned: 0 in 0.557s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3078f4b4-28cd-4fe9-9437-2dd4d6dec928 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-982cf9b5-7c4d-497f-917d-e13b36a38e8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-982cf9b5-7c4d-497f-917d-e13b36a38e8e.33466645-a7c6-4fff-9619-e2ec5c1fe6e5 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:51 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-916a13b9-cf90-4966-9a80-cd6ea87e446d tempest-CreateVolumesFromImageTest-111102826 None] Lock "cinder-quobyte-afe44c0a-ce72-493e-bbcc-668d6988d196" acquired by "delete_volume" :: waited 0.041s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:51 devstack sudo[104972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-982cf9b5-7c4d-497f-917d-e13b36a38e8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-982cf9b5-7c4d-497f-917d-e13b36a38e8e.33466645-a7c6-4fff-9619-e2ec5c1fe6e5 1G Sep 23 00:31:51 devstack sudo[104972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:51 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[96eb027e-b62a-473c-abc2-c084b4d62391]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-916a13b9-cf90-4966-9a80-cd6ea87e446d tempest-CreateVolumesFromImageTest-111102826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-afe44c0a-ce72-493e-bbcc-668d6988d196 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:51 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[920528be-721a-419e-853e-a6aac6e09bf8]: (4, 'raw') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_66a58d32-4194-441d-a910-0ebf7286e8c9_sxxourvtdevstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:51 devstack sudo[104974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-afe44c0a-ce72-493e-bbcc-668d6988d196 Sep 23 00:31:51 devstack sudo[104974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:51 devstack sudo[104975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_66a58d32-4194-441d-a910-0ebf7286e8c9_sxxourvtdevstack@QuobyteHD Sep 23 00:31:51 devstack sudo[104975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:51 devstack sudo[104975]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:51 devstack sudo[104972]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_66a58d32-4194-441d-a910-0ebf7286e8c9_sxxourvtdevstack@QuobyteHD" returned: 0 in 0.496s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66a58d32-4194-441d-a910-0ebf7286e8c9_sxxourvtdevstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3078f4b4-28cd-4fe9-9437-2dd4d6dec928 tempest-CreateVolumesFromSnapshotTest-1109491162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-982cf9b5-7c4d-497f-917d-e13b36a38e8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-982cf9b5-7c4d-497f-917d-e13b36a38e8e.33466645-a7c6-4fff-9619-e2ec5c1fe6e5 1G" returned: 0 in 0.591s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3078f4b4-28cd-4fe9-9437-2dd4d6dec928 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-982cf9b5-7c4d-497f-917d-e13b36a38e8e -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-982cf9b5-7c4d-497f-917d-e13b36a38e8e.33466645-a7c6-4fff-9619-e2ec5c1fe6e5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:52 devstack sudo[104974]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-916a13b9-cf90-4966-9a80-cd6ea87e446d tempest-CreateVolumesFromImageTest-111102826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-afe44c0a-ce72-493e-bbcc-668d6988d196" returned: 0 in 0.563s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:52 devstack sudo[104988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-982cf9b5-7c4d-497f-917d-e13b36a38e8e -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-982cf9b5-7c4d-497f-917d-e13b36a38e8e.33466645-a7c6-4fff-9619-e2ec5c1fe6e5 Sep 23 00:31:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-916a13b9-cf90-4966-9a80-cd6ea87e446d tempest-CreateVolumesFromImageTest-111102826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-afe44c0a-ce72-493e-bbcc-668d6988d196 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:52 devstack sudo[104988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:52 devstack sudo[104990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-afe44c0a-ce72-493e-bbcc-668d6988d196 Sep 23 00:31:52 devstack sudo[104990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:52 devstack sudo[104987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66a58d32-4194-441d-a910-0ebf7286e8c9_sxxourvtdevstack@QuobyteHD Sep 23 00:31:52 devstack sudo[104987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:52 devstack sudo[104990]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-916a13b9-cf90-4966-9a80-cd6ea87e446d tempest-CreateVolumesFromImageTest-111102826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-afe44c0a-ce72-493e-bbcc-668d6988d196" returned: 0 in 0.292s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:52 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-916a13b9-cf90-4966-9a80-cd6ea87e446d tempest-CreateVolumesFromImageTest-111102826 None] Lock "cinder-quobyte-afe44c0a-ce72-493e-bbcc-668d6988d196" released by "delete_volume" :: held 0.916s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:52 devstack sudo[104987]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66a58d32-4194-441d-a910-0ebf7286e8c9_sxxourvtdevstack@QuobyteHD" returned: 1 in 0.383s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66a58d32-4194-441d-a910-0ebf7286e8c9_sxxourvtdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:31:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:52 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-916a13b9-cf90-4966-9a80-cd6ea87e446d tempest-CreateVolumesFromImageTest-111102826 None] Created reservations ['7cfa1624-ea6c-4069-898a-75a88a24aca0', 'cc836728-f2f8-4f10-b170-bbd8eb5699a0', '783aa587-0265-44c2-8f5e-90ee12dbc1ee', 'f95aa022-9305-49a4-acf8-38f7f57c2a43'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:31:52 devstack sudo[104988]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3078f4b4-28cd-4fe9-9437-2dd4d6dec928 tempest-CreateVolumesFromSnapshotTest-1109491162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-982cf9b5-7c4d-497f-917d-e13b36a38e8e -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-982cf9b5-7c4d-497f-917d-e13b36a38e8e.33466645-a7c6-4fff-9619-e2ec5c1fe6e5" returned: 0 in 0.440s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:52 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-3078f4b4-28cd-4fe9-9437-2dd4d6dec928 tempest-CreateVolumesFromSnapshotTest-1109491162 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-982cf9b5-7c4d-497f-917d-e13b36a38e8e.33466645-a7c6-4fff-9619-e2ec5c1fe6e5 is being set with open permissions: ugo+rw Sep 23 00:31:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3078f4b4-28cd-4fe9-9437-2dd4d6dec928 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-982cf9b5-7c4d-497f-917d-e13b36a38e8e.33466645-a7c6-4fff-9619-e2ec5c1fe6e5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:52 devstack sudo[105000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-982cf9b5-7c4d-497f-917d-e13b36a38e8e.33466645-a7c6-4fff-9619-e2ec5c1fe6e5 Sep 23 00:31:52 devstack sudo[105000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-916a13b9-cf90-4966-9a80-cd6ea87e446d tempest-CreateVolumesFromImageTest-111102826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-916a13b9-cf90-4966-9a80-cd6ea87e446d tempest-CreateVolumesFromImageTest-111102826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:52 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-916a13b9-cf90-4966-9a80-cd6ea87e446d tempest-CreateVolumesFromImageTest-111102826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:52 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-916a13b9-cf90-4966-9a80-cd6ea87e446d tempest-CreateVolumesFromImageTest-111102826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-916a13b9-cf90-4966-9a80-cd6ea87e446d tempest-CreateVolumesFromImageTest-111102826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-916a13b9-cf90-4966-9a80-cd6ea87e446d tempest-CreateVolumesFromImageTest-111102826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:52 devstack sudo[105002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:31:52 devstack sudo[105002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:52 devstack sudo[105000]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3078f4b4-28cd-4fe9-9437-2dd4d6dec928 tempest-CreateVolumesFromSnapshotTest-1109491162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-982cf9b5-7c4d-497f-917d-e13b36a38e8e.33466645-a7c6-4fff-9619-e2ec5c1fe6e5" returned: 0 in 0.298s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3078f4b4-28cd-4fe9-9437-2dd4d6dec928 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-982cf9b5-7c4d-497f-917d-e13b36a38e8e.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:52 devstack sudo[105002]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-916a13b9-cf90-4966-9a80-cd6ea87e446d tempest-CreateVolumesFromImageTest-111102826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.275s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:52 devstack sudo[105006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-982cf9b5-7c4d-497f-917d-e13b36a38e8e.info Sep 23 00:31:52 devstack sudo[105006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:52 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-916a13b9-cf90-4966-9a80-cd6ea87e446d tempest-CreateVolumesFromImageTest-111102826 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:31:52 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-916a13b9-cf90-4966-9a80-cd6ea87e446d tempest-CreateVolumesFromImageTest-111102826 None] Deleted volume successfully. Sep 23 00:31:52 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-916a13b9-cf90-4966-9a80-cd6ea87e446d tempest-CreateVolumesFromImageTest-111102826 None] Lock "cinder-afe44c0a-ce72-493e-bbcc-668d6988d196-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:53 devstack sudo[105006]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3078f4b4-28cd-4fe9-9437-2dd4d6dec928 tempest-CreateVolumesFromSnapshotTest-1109491162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-982cf9b5-7c4d-497f-917d-e13b36a38e8e.info" returned: 0 in 0.333s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:53 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-3078f4b4-28cd-4fe9-9437-2dd4d6dec928 tempest-CreateVolumesFromSnapshotTest-1109491162 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-982cf9b5-7c4d-497f-917d-e13b36a38e8e.info is being set with open permissions: ugo+rw Sep 23 00:31:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3078f4b4-28cd-4fe9-9437-2dd4d6dec928 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-982cf9b5-7c4d-497f-917d-e13b36a38e8e.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:53 devstack sudo[105009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-982cf9b5-7c4d-497f-917d-e13b36a38e8e.info Sep 23 00:31:53 devstack sudo[105009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:53 devstack sudo[105009]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3078f4b4-28cd-4fe9-9437-2dd4d6dec928 tempest-CreateVolumesFromSnapshotTest-1109491162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-982cf9b5-7c4d-497f-917d-e13b36a38e8e.info" returned: 0 in 0.276s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-3078f4b4-28cd-4fe9-9437-2dd4d6dec928 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.615s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.241s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:53 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:47Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=184ef56e-79e6-465e-bd7e-ec2deb62c232,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00c87d0dd4264be2bf01894606547705',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:48Z,use_quota=True,user_id='25c9375a66a64016992b9e10ce1fd8eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:31:53 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] Creating volume 184ef56e-79e6-465e-bd7e-ec2deb62c232 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:31:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:53 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:53 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:53 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:31:53 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:31:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-184ef56e-79e6-465e-bd7e-ec2deb62c232 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:53 devstack sudo[105012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-184ef56e-79e6-465e-bd7e-ec2deb62c232 1073741824 Sep 23 00:31:53 devstack sudo[105012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:53 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-3078f4b4-28cd-4fe9-9437-2dd4d6dec928 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Create snapshot completed successfully Sep 23 00:31:53 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6c9430d2-b1b1-4f8a-b69a-a90e1f362e21 tempest-CreateVolumesFromImageTest-111102826 None] Acquiring lock "cinder-1fe1a53b-ec51-4a31-bcac-5d5b4a92843d-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:53 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6c9430d2-b1b1-4f8a-b69a-a90e1f362e21 tempest-CreateVolumesFromImageTest-111102826 None] Lock "cinder-1fe1a53b-ec51-4a31-bcac-5d5b4a92843d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:53 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6c9430d2-b1b1-4f8a-b69a-a90e1f362e21 tempest-CreateVolumesFromImageTest-111102826 None] Acquiring lock "cinder-quobyte-1fe1a53b-ec51-4a31-bcac-5d5b4a92843d" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:53 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6c9430d2-b1b1-4f8a-b69a-a90e1f362e21 tempest-CreateVolumesFromImageTest-111102826 None] Lock "cinder-quobyte-1fe1a53b-ec51-4a31-bcac-5d5b4a92843d" acquired by "delete_volume" :: waited 0.020s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:53 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[7265d3bb-48bf-438e-87d2-3fa66c508ca7]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6c9430d2-b1b1-4f8a-b69a-a90e1f362e21 tempest-CreateVolumesFromImageTest-111102826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1fe1a53b-ec51-4a31-bcac-5d5b4a92843d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:53 devstack sudo[105017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1fe1a53b-ec51-4a31-bcac-5d5b4a92843d Sep 23 00:31:53 devstack sudo[105017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:53 devstack sudo[105012]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-184ef56e-79e6-465e-bd7e-ec2deb62c232 1073741824" returned: 0 in 0.513s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-184ef56e-79e6-465e-bd7e-ec2deb62c232 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:54 devstack sudo[105019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-184ef56e-79e6-465e-bd7e-ec2deb62c232 Sep 23 00:31:54 devstack sudo[105019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:54 devstack sudo[105017]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6c9430d2-b1b1-4f8a-b69a-a90e1f362e21 tempest-CreateVolumesFromImageTest-111102826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1fe1a53b-ec51-4a31-bcac-5d5b4a92843d" returned: 0 in 0.510s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6c9430d2-b1b1-4f8a-b69a-a90e1f362e21 tempest-CreateVolumesFromImageTest-111102826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1fe1a53b-ec51-4a31-bcac-5d5b4a92843d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:54 devstack sudo[105024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1fe1a53b-ec51-4a31-bcac-5d5b4a92843d Sep 23 00:31:54 devstack sudo[105024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:54 devstack sudo[105019]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-184ef56e-79e6-465e-bd7e-ec2deb62c232" returned: 0 in 0.325s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:31:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.941s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f73115d-30c9-4bcd-813c-5fa88b3bd898,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d66d3b96c8a94649a6e45489c8f224ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:50Z,use_quota=True,user_id='f1b9b8178d4246dca7c79efdd27c390d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa343a75-e9af-4098-a972-a5ee5b9d741f),volume_type_id=aa343a75-e9af-4098-a972-a5ee5b9d741f)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:31:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Creating volume 3f73115d-30c9-4bcd-813c-5fa88b3bd898 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:31:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:31:54 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:31:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3f73115d-30c9-4bcd-813c-5fa88b3bd898 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:54 devstack cinder-volume[86591]: DEBUG cinder.volume.volume_utils [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] Attempting download of 4d8c0e61-5fb9-4d40-a303-cf0f508fc38c ((None, [{'url': 'file:///opt/stack/data/glance/images/4d8c0e61-5fb9-4d40-a303-cf0f508fc38c', 'metadata': {}}])) to volume 184ef56e-79e6-465e-bd7e-ec2deb62c232. {{(pid=86591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 00:31:54 devstack sudo[105027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3f73115d-30c9-4bcd-813c-5fa88b3bd898 1073741824 Sep 23 00:31:54 devstack sudo[105027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:54 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[595a6340-5b22-4958-81be-2e75bbb685d8]: (4, 'raw') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4d8c0e61-5fb9-4d40-a303-cf0f508fc38c_jt2i1_ld {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:54 devstack sudo[105029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4d8c0e61-5fb9-4d40-a303-cf0f508fc38c_jt2i1_ld Sep 23 00:31:54 devstack sudo[105029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:54 devstack sudo[105024]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6c9430d2-b1b1-4f8a-b69a-a90e1f362e21 tempest-CreateVolumesFromImageTest-111102826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1fe1a53b-ec51-4a31-bcac-5d5b4a92843d" returned: 0 in 0.417s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:54 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6c9430d2-b1b1-4f8a-b69a-a90e1f362e21 tempest-CreateVolumesFromImageTest-111102826 None] Lock "cinder-quobyte-1fe1a53b-ec51-4a31-bcac-5d5b4a92843d" released by "delete_volume" :: held 0.987s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:54 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-6c9430d2-b1b1-4f8a-b69a-a90e1f362e21 tempest-CreateVolumesFromImageTest-111102826 None] Created reservations ['29e42605-bc26-49a8-a3be-521edaabf3b0', '51f6050a-0c9c-452e-b6f5-4ceeae6f5c10', 'c61c6874-af0e-4800-b1d4-d68962c72464', 'e267c78f-83ab-498d-8fcb-8d9cb8f1633a'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:31:54 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d2a5456-1b78-4418-8cf9-f0162fa90804 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:31:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3d2a5456-1b78-4418-8cf9-f0162fa90804 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Flow 'volume_create_manager' (f5318588-04ea-4700-b0bb-ea1e10a2a188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3d2a5456-1b78-4418-8cf9-f0162fa90804 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86748f7f-82d8-465a-b682-3dda0d30a584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3d2a5456-1b78-4418-8cf9-f0162fa90804 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86748f7f-82d8-465a-b682-3dda0d30a584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-36188046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6e5163b-c12b-40a9-b5b5-3ab222a6036f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3130d1b5f264f9e990b49bceefd9339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:55Z,use_quota=True,user_id='1dd39020b759450aaad6d06a652b808b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3d2a5456-1b78-4418-8cf9-f0162fa90804 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee563f45-0456-4ac4-931b-8828a85057f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3d2a5456-1b78-4418-8cf9-f0162fa90804 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee563f45-0456-4ac4-931b-8828a85057f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3d2a5456-1b78-4418-8cf9-f0162fa90804 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f928448-52b8-45f0-98b6-711f280422b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3d2a5456-1b78-4418-8cf9-f0162fa90804 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f928448-52b8-45f0-98b6-711f280422b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6e5163b-c12b-40a9-b5b5-3ab222a6036f', 'volume_name': 'volume-e6e5163b-c12b-40a9-b5b5-3ab222a6036f', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3d2a5456-1b78-4418-8cf9-f0162fa90804 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d37ece3-915a-4028-827c-1ee4dc85fb3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3d2a5456-1b78-4418-8cf9-f0162fa90804 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d37ece3-915a-4028-827c-1ee4dc85fb3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3d2a5456-1b78-4418-8cf9-f0162fa90804 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0ed8984-3e96-48a3-b4cf-bf80c4702f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:54 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-3d2a5456-1b78-4418-8cf9-f0162fa90804 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Volume e6e5163b-c12b-40a9-b5b5-3ab222a6036f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6e5163b-c12b-40a9-b5b5-3ab222a6036f', 'volume_size': 1} Sep 23 00:31:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-3d2a5456-1b78-4418-8cf9-f0162fa90804 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6c9430d2-b1b1-4f8a-b69a-a90e1f362e21 tempest-CreateVolumesFromImageTest-111102826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6c9430d2-b1b1-4f8a-b69a-a90e1f362e21 tempest-CreateVolumesFromImageTest-111102826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:55 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6c9430d2-b1b1-4f8a-b69a-a90e1f362e21 tempest-CreateVolumesFromImageTest-111102826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:55 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-6c9430d2-b1b1-4f8a-b69a-a90e1f362e21 tempest-CreateVolumesFromImageTest-111102826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6c9430d2-b1b1-4f8a-b69a-a90e1f362e21 tempest-CreateVolumesFromImageTest-111102826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6c9430d2-b1b1-4f8a-b69a-a90e1f362e21 tempest-CreateVolumesFromImageTest-111102826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:55 devstack sudo[105038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:31:55 devstack sudo[105038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:55 devstack sudo[105029]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4d8c0e61-5fb9-4d40-a303-cf0f508fc38c_jt2i1_ld" returned: 0 in 0.681s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d8c0e61-5fb9-4d40-a303-cf0f508fc38c_jt2i1_ld {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:55 devstack sudo[105027]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3f73115d-30c9-4bcd-813c-5fa88b3bd898 1073741824" returned: 0 in 0.897s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3f73115d-30c9-4bcd-813c-5fa88b3bd898 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:55 devstack sudo[105041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3f73115d-30c9-4bcd-813c-5fa88b3bd898 Sep 23 00:31:55 devstack sudo[105041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:55 devstack sudo[105040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d8c0e61-5fb9-4d40-a303-cf0f508fc38c_jt2i1_ld Sep 23 00:31:55 devstack sudo[105040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:55 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-d457c111-069c-45e6-b736-e410ea292353 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:31:55 devstack sudo[105038]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d457c111-069c-45e6-b736-e410ea292353 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Flow 'volume_create_manager' (db9b9dca-95d2-4f7f-8c5b-3c1716e0d19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d457c111-069c-45e6-b736-e410ea292353 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3f34ee6-e38f-4a0e-8021-70579aaf4ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6c9430d2-b1b1-4f8a-b69a-a90e1f362e21 tempest-CreateVolumesFromImageTest-111102826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.416s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:55 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-6c9430d2-b1b1-4f8a-b69a-a90e1f362e21 tempest-CreateVolumesFromImageTest-111102826 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:31:55 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-6c9430d2-b1b1-4f8a-b69a-a90e1f362e21 tempest-CreateVolumesFromImageTest-111102826 None] Deleted volume successfully. Sep 23 00:31:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d457c111-069c-45e6-b736-e410ea292353 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3f34ee6-e38f-4a0e-8021-70579aaf4ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1945171279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7199f9b8-00a1-4ee5-9c3d-c67cafb088b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3130d1b5f264f9e990b49bceefd9339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:55Z,use_quota=True,user_id='1dd39020b759450aaad6d06a652b808b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d457c111-069c-45e6-b736-e410ea292353 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a83cc27e-3f07-42ff-8b85-203c406f606f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d457c111-069c-45e6-b736-e410ea292353 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a83cc27e-3f07-42ff-8b85-203c406f606f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d457c111-069c-45e6-b736-e410ea292353 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e109625c-d38b-4f5a-93ac-c47622650e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d457c111-069c-45e6-b736-e410ea292353 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e109625c-d38b-4f5a-93ac-c47622650e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7199f9b8-00a1-4ee5-9c3d-c67cafb088b6', 'volume_name': 'volume-7199f9b8-00a1-4ee5-9c3d-c67cafb088b6', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d457c111-069c-45e6-b736-e410ea292353 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9136a3d5-9e73-42ce-a677-7e7426675917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d457c111-069c-45e6-b736-e410ea292353 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9136a3d5-9e73-42ce-a677-7e7426675917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d457c111-069c-45e6-b736-e410ea292353 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f66044b6-1016-4ea2-b105-01b3caf7c793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:55 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-d457c111-069c-45e6-b736-e410ea292353 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Volume 7199f9b8-00a1-4ee5-9c3d-c67cafb088b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7199f9b8-00a1-4ee5-9c3d-c67cafb088b6', 'volume_size': 1} Sep 23 00:31:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d457c111-069c-45e6-b736-e410ea292353 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:55 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-6c9430d2-b1b1-4f8a-b69a-a90e1f362e21 tempest-CreateVolumesFromImageTest-111102826 None] Lock "cinder-1fe1a53b-ec51-4a31-bcac-5d5b4a92843d-delete_volume" released by "delete_volume" :: held 1.984s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:55 devstack sudo[105040]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d8c0e61-5fb9-4d40-a303-cf0f508fc38c_jt2i1_ld" returned: 1 in 0.539s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d8c0e61-5fb9-4d40-a303-cf0f508fc38c_jt2i1_ld' failed. Not Retrying. {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:31:55 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[591c18d3-8c63-435d-8aa4-300610dc2dfc]: (4, 'raw') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4d8c0e61-5fb9-4d40-a303-cf0f508fc38c_18vm5it3devstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:55 devstack sudo[105041]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3f73115d-30c9-4bcd-813c-5fa88b3bd898" returned: 0 in 0.402s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:55 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] <== create_volume: return (1382ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:31:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.386s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-3d2a5456-1b78-4418-8cf9-f0162fa90804 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.701s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:55 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-3d2a5456-1b78-4418-8cf9-f0162fa90804 tempest-CreateVolumesFromSnapshotTest-1109491162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-36188046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6e5163b-c12b-40a9-b5b5-3ab222a6036f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3130d1b5f264f9e990b49bceefd9339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:55Z,use_quota=True,user_id='1dd39020b759450aaad6d06a652b808b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:31:55 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-3d2a5456-1b78-4418-8cf9-f0162fa90804 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Creating volume e6e5163b-c12b-40a9-b5b5-3ab222a6036f {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:31:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-3d2a5456-1b78-4418-8cf9-f0162fa90804 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-3d2a5456-1b78-4418-8cf9-f0162fa90804 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:55 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-3d2a5456-1b78-4418-8cf9-f0162fa90804 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:55 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-3d2a5456-1b78-4418-8cf9-f0162fa90804 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-3d2a5456-1b78-4418-8cf9-f0162fa90804 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:55 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-3d2a5456-1b78-4418-8cf9-f0162fa90804 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:31:55 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-3d2a5456-1b78-4418-8cf9-f0162fa90804 tempest-CreateVolumesFromSnapshotTest-1109491162 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:31:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3d2a5456-1b78-4418-8cf9-f0162fa90804 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6e5163b-c12b-40a9-b5b5-3ab222a6036f 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:55 devstack sudo[105049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6e5163b-c12b-40a9-b5b5-3ab222a6036f 1073741824 Sep 23 00:31:55 devstack sudo[105049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:55 devstack cinder-volume[86591]: DEBUG cinder.volume.volume_utils [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Attempting download of 66a58d32-4194-441d-a910-0ebf7286e8c9 ((None, [{'url': 'file:///opt/stack/data/glance/images/66a58d32-4194-441d-a910-0ebf7286e8c9', 'metadata': {}}])) to volume 3f73115d-30c9-4bcd-813c-5fa88b3bd898. {{(pid=86591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 00:31:55 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[073eef96-6e2b-499b-ae88-72a2cc0b6513]: (4, 'raw') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_66a58d32-4194-441d-a910-0ebf7286e8c9_zeyqdg8p {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:55 devstack sudo[105048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4d8c0e61-5fb9-4d40-a303-cf0f508fc38c_18vm5it3devstack@QuobyteHD Sep 23 00:31:55 devstack sudo[105048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:55 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5599851f-5264-4e43-9478-ac403c21ff36 tempest-CreateVolumesFromImageTest-111102826 None] Acquiring lock "cinder-002cfb37-e176-41dc-b637-a22948478bf2-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:55 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5599851f-5264-4e43-9478-ac403c21ff36 tempest-CreateVolumesFromImageTest-111102826 None] Lock "cinder-002cfb37-e176-41dc-b637-a22948478bf2-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:56 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-8137f7b9-c820-4d17-830c-7d0cf4c705ca tempest-CreateVolumesFromSnapshotTest-1109491162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:31:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8137f7b9-c820-4d17-830c-7d0cf4c705ca tempest-CreateVolumesFromSnapshotTest-1109491162 None] Flow 'volume_create_manager' (93f1f154-de3a-4579-a6a3-9878dabe5c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8137f7b9-c820-4d17-830c-7d0cf4c705ca tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dda393d6-dcf7-4487-b434-b7dce7e88c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:56 devstack sudo[105051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_66a58d32-4194-441d-a910-0ebf7286e8c9_zeyqdg8p Sep 23 00:31:56 devstack sudo[105051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8137f7b9-c820-4d17-830c-7d0cf4c705ca tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dda393d6-dcf7-4487-b434-b7dce7e88c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-255000311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=901c7dfa-f803-43c9-b643-149a260631cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3130d1b5f264f9e990b49bceefd9339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:56Z,use_quota=True,user_id='1dd39020b759450aaad6d06a652b808b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8137f7b9-c820-4d17-830c-7d0cf4c705ca tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (947b2e01-1f9f-4308-aea8-5e492acb3a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8137f7b9-c820-4d17-830c-7d0cf4c705ca tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (947b2e01-1f9f-4308-aea8-5e492acb3a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8137f7b9-c820-4d17-830c-7d0cf4c705ca tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65d6d750-97e9-48bd-8c47-a4297d5dfcce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8137f7b9-c820-4d17-830c-7d0cf4c705ca tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65d6d750-97e9-48bd-8c47-a4297d5dfcce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '901c7dfa-f803-43c9-b643-149a260631cc', 'volume_name': 'volume-901c7dfa-f803-43c9-b643-149a260631cc', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8137f7b9-c820-4d17-830c-7d0cf4c705ca tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (599ee088-0744-4b28-9491-65ba1f5cc0a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8137f7b9-c820-4d17-830c-7d0cf4c705ca tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (599ee088-0744-4b28-9491-65ba1f5cc0a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8137f7b9-c820-4d17-830c-7d0cf4c705ca tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35dbdea0-1df7-4ceb-bf44-7226f708cbd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:56 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-8137f7b9-c820-4d17-830c-7d0cf4c705ca tempest-CreateVolumesFromSnapshotTest-1109491162 None] Volume 901c7dfa-f803-43c9-b643-149a260631cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-901c7dfa-f803-43c9-b643-149a260631cc', 'volume_size': 1} Sep 23 00:31:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8137f7b9-c820-4d17-830c-7d0cf4c705ca tempest-CreateVolumesFromSnapshotTest-1109491162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:56 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5599851f-5264-4e43-9478-ac403c21ff36 tempest-CreateVolumesFromImageTest-111102826 None] Acquiring lock "cinder-quobyte-002cfb37-e176-41dc-b637-a22948478bf2" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:56 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5599851f-5264-4e43-9478-ac403c21ff36 tempest-CreateVolumesFromImageTest-111102826 None] Lock "cinder-quobyte-002cfb37-e176-41dc-b637-a22948478bf2" acquired by "delete_volume" :: waited 0.042s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:56 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[5615c4db-3883-48b1-a0c0-dc7b150b79ea]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5599851f-5264-4e43-9478-ac403c21ff36 tempest-CreateVolumesFromImageTest-111102826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-002cfb37-e176-41dc-b637-a22948478bf2 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:56 devstack sudo[105048]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4d8c0e61-5fb9-4d40-a303-cf0f508fc38c_18vm5it3devstack@QuobyteHD" returned: 0 in 0.684s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4d8c0e61-5fb9-4d40-a303-cf0f508fc38c_18vm5it3devstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:56 devstack sudo[105060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4d8c0e61-5fb9-4d40-a303-cf0f508fc38c_18vm5it3devstack@QuobyteHD Sep 23 00:31:56 devstack sudo[105060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:56 devstack sudo[105059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-002cfb37-e176-41dc-b637-a22948478bf2 Sep 23 00:31:56 devstack sudo[105059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:56 devstack sudo[105051]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_66a58d32-4194-441d-a910-0ebf7286e8c9_zeyqdg8p" returned: 0 in 0.752s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_66a58d32-4194-441d-a910-0ebf7286e8c9_zeyqdg8p {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:56 devstack sudo[105049]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3d2a5456-1b78-4418-8cf9-f0162fa90804 tempest-CreateVolumesFromSnapshotTest-1109491162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6e5163b-c12b-40a9-b5b5-3ab222a6036f 1073741824" returned: 0 in 0.974s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:56 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fbb2235-7bc7-421c-997e-471cb307681c tempest-CreateVolumesFromSnapshotTest-1109491162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:31:56 devstack sudo[105066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_66a58d32-4194-441d-a910-0ebf7286e8c9_zeyqdg8p Sep 23 00:31:56 devstack sudo[105066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5fbb2235-7bc7-421c-997e-471cb307681c tempest-CreateVolumesFromSnapshotTest-1109491162 None] Flow 'volume_create_manager' (8850718d-3240-4d4e-8256-643e164bfb5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5fbb2235-7bc7-421c-997e-471cb307681c tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1ad330e-c853-447d-9046-64c61d9aaf30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5fbb2235-7bc7-421c-997e-471cb307681c tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1ad330e-c853-447d-9046-64c61d9aaf30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1595210274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=438b5939-0d5a-4867-8796-a4ffcfbaaf86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3130d1b5f264f9e990b49bceefd9339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:57Z,use_quota=True,user_id='1dd39020b759450aaad6d06a652b808b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5fbb2235-7bc7-421c-997e-471cb307681c tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87953742-9e91-407d-b3e7-ce057df23360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:56 devstack sudo[105060]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5fbb2235-7bc7-421c-997e-471cb307681c tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87953742-9e91-407d-b3e7-ce057df23360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5fbb2235-7bc7-421c-997e-471cb307681c tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c0cd7c8-ea83-4519-a629-13db9852a981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5fbb2235-7bc7-421c-997e-471cb307681c tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c0cd7c8-ea83-4519-a629-13db9852a981) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '438b5939-0d5a-4867-8796-a4ffcfbaaf86', 'volume_name': 'volume-438b5939-0d5a-4867-8796-a4ffcfbaaf86', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5fbb2235-7bc7-421c-997e-471cb307681c tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (900ba0b4-1c19-4c0c-b4e3-3cf1b0d77243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5fbb2235-7bc7-421c-997e-471cb307681c tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (900ba0b4-1c19-4c0c-b4e3-3cf1b0d77243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:56 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5fbb2235-7bc7-421c-997e-471cb307681c tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b0067ad-9236-42e3-a893-2ced829fbe87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:56 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-5fbb2235-7bc7-421c-997e-471cb307681c tempest-CreateVolumesFromSnapshotTest-1109491162 None] Volume 438b5939-0d5a-4867-8796-a4ffcfbaaf86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-438b5939-0d5a-4867-8796-a4ffcfbaaf86', 'volume_size': 1} Sep 23 00:31:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5fbb2235-7bc7-421c-997e-471cb307681c tempest-CreateVolumesFromSnapshotTest-1109491162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3d2a5456-1b78-4418-8cf9-f0162fa90804 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6e5163b-c12b-40a9-b5b5-3ab222a6036f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4d8c0e61-5fb9-4d40-a303-cf0f508fc38c_18vm5it3devstack@QuobyteHD" returned: 1 in 0.587s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4d8c0e61-5fb9-4d40-a303-cf0f508fc38c_18vm5it3devstack@QuobyteHD' failed. Not Retrying. {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:31:56 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] 4d8c0e61-5fb9-4d40-a303-cf0f508fc38c was raw, converting to qcow2 {{(pid=86591) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 00:31:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4d8c0e61-5fb9-4d40-a303-cf0f508fc38c_18vm5it3devstack@QuobyteHD /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-184ef56e-79e6-465e-bd7e-ec2deb62c232 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:56 devstack sudo[105074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6e5163b-c12b-40a9-b5b5-3ab222a6036f Sep 23 00:31:56 devstack sudo[105059]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:56 devstack sudo[105074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5599851f-5264-4e43-9478-ac403c21ff36 tempest-CreateVolumesFromImageTest-111102826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-002cfb37-e176-41dc-b637-a22948478bf2" returned: 0 in 0.689s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5599851f-5264-4e43-9478-ac403c21ff36 tempest-CreateVolumesFromImageTest-111102826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-002cfb37-e176-41dc-b637-a22948478bf2 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:57 devstack sudo[105075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4d8c0e61-5fb9-4d40-a303-cf0f508fc38c_18vm5it3devstack@QuobyteHD /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-184ef56e-79e6-465e-bd7e-ec2deb62c232 Sep 23 00:31:57 devstack sudo[105075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:57 devstack sudo[105077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-002cfb37-e176-41dc-b637-a22948478bf2 Sep 23 00:31:57 devstack sudo[105077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:57 devstack sudo[105066]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_66a58d32-4194-441d-a910-0ebf7286e8c9_zeyqdg8p" returned: 1 in 0.751s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_66a58d32-4194-441d-a910-0ebf7286e8c9_zeyqdg8p' failed. Not Retrying. {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:31:57 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1851a7-1019-43dc-9926-ad525a33fc7e]: (4, 'raw') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_66a58d32-4194-441d-a910-0ebf7286e8c9_sxxourvtdevstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:57 devstack sudo[105077]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5599851f-5264-4e43-9478-ac403c21ff36 tempest-CreateVolumesFromImageTest-111102826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-002cfb37-e176-41dc-b637-a22948478bf2" returned: 0 in 0.453s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:57 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5599851f-5264-4e43-9478-ac403c21ff36 tempest-CreateVolumesFromImageTest-111102826 None] Lock "cinder-quobyte-002cfb37-e176-41dc-b637-a22948478bf2" released by "delete_volume" :: held 1.253s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:57 devstack sudo[105074]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:57 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-1124be1c-dd6c-4d45-80de-f241d503196f tempest-CreateVolumesFromSnapshotTest-1109491162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:31:57 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1124be1c-dd6c-4d45-80de-f241d503196f tempest-CreateVolumesFromSnapshotTest-1109491162 None] Flow 'volume_create_manager' (8264a903-79b4-4e45-91cc-4223049638b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:57 devstack sudo[105085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_66a58d32-4194-441d-a910-0ebf7286e8c9_sxxourvtdevstack@QuobyteHD Sep 23 00:31:57 devstack sudo[105085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:57 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1124be1c-dd6c-4d45-80de-f241d503196f tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84bb1424-08b0-4910-b0a7-749fcfcf6e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3d2a5456-1b78-4418-8cf9-f0162fa90804 tempest-CreateVolumesFromSnapshotTest-1109491162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6e5163b-c12b-40a9-b5b5-3ab222a6036f" returned: 0 in 0.683s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:57 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-3d2a5456-1b78-4418-8cf9-f0162fa90804 tempest-CreateVolumesFromSnapshotTest-1109491162 None] <== create_volume: return (1920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:31:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-3d2a5456-1b78-4418-8cf9-f0162fa90804 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.923s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d457c111-069c-45e6-b736-e410ea292353 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.046s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:57 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d457c111-069c-45e6-b736-e410ea292353 tempest-CreateVolumesFromSnapshotTest-1109491162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1945171279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7199f9b8-00a1-4ee5-9c3d-c67cafb088b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3130d1b5f264f9e990b49bceefd9339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:55Z,use_quota=True,user_id='1dd39020b759450aaad6d06a652b808b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:31:57 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-d457c111-069c-45e6-b736-e410ea292353 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Creating volume 7199f9b8-00a1-4ee5-9c3d-c67cafb088b6 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:31:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d457c111-069c-45e6-b736-e410ea292353 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d457c111-069c-45e6-b736-e410ea292353 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:57 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d457c111-069c-45e6-b736-e410ea292353 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:57 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d457c111-069c-45e6-b736-e410ea292353 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d457c111-069c-45e6-b736-e410ea292353 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:57 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d457c111-069c-45e6-b736-e410ea292353 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:31:57 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-d457c111-069c-45e6-b736-e410ea292353 tempest-CreateVolumesFromSnapshotTest-1109491162 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:31:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d457c111-069c-45e6-b736-e410ea292353 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7199f9b8-00a1-4ee5-9c3d-c67cafb088b6 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:57 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1124be1c-dd6c-4d45-80de-f241d503196f tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84bb1424-08b0-4910-b0a7-749fcfcf6e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1987689727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=085ddcf0-4857-4831-b679-bfe5d092fa68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3130d1b5f264f9e990b49bceefd9339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:57Z,use_quota=True,user_id='1dd39020b759450aaad6d06a652b808b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:57 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1124be1c-dd6c-4d45-80de-f241d503196f tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3eddc3d-5621-4c02-82e0-b2d812ff41d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:57 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1124be1c-dd6c-4d45-80de-f241d503196f tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3eddc3d-5621-4c02-82e0-b2d812ff41d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:57 devstack sudo[105092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7199f9b8-00a1-4ee5-9c3d-c67cafb088b6 1073741824 Sep 23 00:31:57 devstack sudo[105092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:57 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1124be1c-dd6c-4d45-80de-f241d503196f tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0451904-f447-42cd-9d1b-722c0b6e7efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:57 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1124be1c-dd6c-4d45-80de-f241d503196f tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0451904-f447-42cd-9d1b-722c0b6e7efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '085ddcf0-4857-4831-b679-bfe5d092fa68', 'volume_name': 'volume-085ddcf0-4857-4831-b679-bfe5d092fa68', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:57 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1124be1c-dd6c-4d45-80de-f241d503196f tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c36bccc-e8de-4ecd-a479-b464d62877ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:57 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1124be1c-dd6c-4d45-80de-f241d503196f tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c36bccc-e8de-4ecd-a479-b464d62877ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:57 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1124be1c-dd6c-4d45-80de-f241d503196f tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62214c13-14a2-4104-b59c-a08b2632744f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:57 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-1124be1c-dd6c-4d45-80de-f241d503196f tempest-CreateVolumesFromSnapshotTest-1109491162 None] Volume 085ddcf0-4857-4831-b679-bfe5d092fa68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-085ddcf0-4857-4831-b679-bfe5d092fa68', 'volume_size': 1} Sep 23 00:31:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1124be1c-dd6c-4d45-80de-f241d503196f tempest-CreateVolumesFromSnapshotTest-1109491162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:57 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3d2a5456-1b78-4418-8cf9-f0162fa90804 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0ed8984-3e96-48a3-b4cf-bf80c4702f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6e5163b-c12b-40a9-b5b5-3ab222a6036f', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:57 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3d2a5456-1b78-4418-8cf9-f0162fa90804 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e544f4e6-f2b9-43fc-b58b-c0a90e98ad01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:57 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-5599851f-5264-4e43-9478-ac403c21ff36 tempest-CreateVolumesFromImageTest-111102826 None] Created reservations ['1fe34ee9-dde0-458c-8d26-3cda85c914b9', '3b93ecde-7be9-4c15-8d52-8518aab18e4d', '1bb1b6ec-d7d6-493c-80de-d171ba75ae05', '674ad8e4-aff5-47de-a0eb-f69778cf6fc8'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:31:57 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-3d2a5456-1b78-4418-8cf9-f0162fa90804 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Volume volume-e6e5163b-c12b-40a9-b5b5-3ab222a6036f (e6e5163b-c12b-40a9-b5b5-3ab222a6036f): created successfully Sep 23 00:31:57 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3d2a5456-1b78-4418-8cf9-f0162fa90804 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e544f4e6-f2b9-43fc-b58b-c0a90e98ad01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:57 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3d2a5456-1b78-4418-8cf9-f0162fa90804 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Flow 'volume_create_manager' (f5318588-04ea-4700-b0bb-ea1e10a2a188) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:57 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-3d2a5456-1b78-4418-8cf9-f0162fa90804 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Created volume successfully. Sep 23 00:31:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5599851f-5264-4e43-9478-ac403c21ff36 tempest-CreateVolumesFromImageTest-111102826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5599851f-5264-4e43-9478-ac403c21ff36 tempest-CreateVolumesFromImageTest-111102826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:57 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5599851f-5264-4e43-9478-ac403c21ff36 tempest-CreateVolumesFromImageTest-111102826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:57 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5599851f-5264-4e43-9478-ac403c21ff36 tempest-CreateVolumesFromImageTest-111102826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5599851f-5264-4e43-9478-ac403c21ff36 tempest-CreateVolumesFromImageTest-111102826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5599851f-5264-4e43-9478-ac403c21ff36 tempest-CreateVolumesFromImageTest-111102826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:57 devstack sudo[105075]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4d8c0e61-5fb9-4d40-a303-cf0f508fc38c_18vm5it3devstack@QuobyteHD /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-184ef56e-79e6-465e-bd7e-ec2deb62c232" returned: 0 in 1.021s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:57 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4d8c0e61-5fb9-4d40-a303-cf0f508fc38c_18vm5it3devstack@QuobyteHD, size 0.00 MB, duration 1.02 sec, destination /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-184ef56e-79e6-465e-bd7e-ec2deb62c232 {{(pid=86591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:31:57 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] Converted 0.00 MB image at 0.00 MB/s Sep 23 00:31:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-184ef56e-79e6-465e-bd7e-ec2deb62c232 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:57 devstack sudo[105097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:31:57 devstack sudo[105097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:57 devstack sudo[105085]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_66a58d32-4194-441d-a910-0ebf7286e8c9_sxxourvtdevstack@QuobyteHD" returned: 0 in 0.640s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66a58d32-4194-441d-a910-0ebf7286e8c9_sxxourvtdevstack@QuobyteHD {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:58 devstack sudo[105099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-184ef56e-79e6-465e-bd7e-ec2deb62c232 1G Sep 23 00:31:58 devstack sudo[105099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:58 devstack sudo[105100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66a58d32-4194-441d-a910-0ebf7286e8c9_sxxourvtdevstack@QuobyteHD Sep 23 00:31:58 devstack sudo[105100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:58 devstack sudo[105092]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:58 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9674c435-a6de-4941-8c73-1d2435262d31 tempest-CreateVolumesFromImageTest-111102826 None] Acquiring lock "cinder-d5babfd7-a5cb-40f4-9109-060f9873c265-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d457c111-069c-45e6-b736-e410ea292353 tempest-CreateVolumesFromSnapshotTest-1109491162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7199f9b8-00a1-4ee5-9c3d-c67cafb088b6 1073741824" returned: 0 in 0.735s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:58 devstack sudo[105097]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5599851f-5264-4e43-9478-ac403c21ff36 tempest-CreateVolumesFromImageTest-111102826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.472s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:58 devstack sudo[105099]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:58 devstack sudo[105100]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:58 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-5599851f-5264-4e43-9478-ac403c21ff36 tempest-CreateVolumesFromImageTest-111102826 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:31:58 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9674c435-a6de-4941-8c73-1d2435262d31 tempest-CreateVolumesFromImageTest-111102826 None] Lock "cinder-d5babfd7-a5cb-40f4-9109-060f9873c265-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:58 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-5599851f-5264-4e43-9478-ac403c21ff36 tempest-CreateVolumesFromImageTest-111102826 None] Deleted volume successfully. Sep 23 00:31:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-184ef56e-79e6-465e-bd7e-ec2deb62c232 1G" returned: 0 in 0.477s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66a58d32-4194-441d-a910-0ebf7286e8c9_sxxourvtdevstack@QuobyteHD" returned: 1 in 0.465s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66a58d32-4194-441d-a910-0ebf7286e8c9_sxxourvtdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:31:58 devstack cinder-volume[86591]: DEBUG cinder.volume.volume_utils [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] Downloaded image 4d8c0e61-5fb9-4d40-a303-cf0f508fc38c ((None, [{'url': 'file:///opt/stack/data/glance/images/4d8c0e61-5fb9-4d40-a303-cf0f508fc38c', 'metadata': {}}])) to volume 184ef56e-79e6-465e-bd7e-ec2deb62c232 successfully. {{(pid=86591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 00:31:58 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] Temporary image 4d8c0e61-5fb9-4d40-a303-cf0f508fc38c for user 25c9375a66a64016992b9e10ce1fd8eb is deleted. {{(pid=86591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 00:31:58 devstack cinder-volume[86591]: DEBUG cinder.volume.volume_utils [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] Marking volume 184ef56e-79e6-465e-bd7e-ec2deb62c232 as bootable. {{(pid=86591) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 00:31:58 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] 66a58d32-4194-441d-a910-0ebf7286e8c9 was raw, converting to qcow2 {{(pid=86591) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 00:31:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_66a58d32-4194-441d-a910-0ebf7286e8c9_sxxourvtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3f73115d-30c9-4bcd-813c-5fa88b3bd898 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:58 devstack sudo[105114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_66a58d32-4194-441d-a910-0ebf7286e8c9_sxxourvtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3f73115d-30c9-4bcd-813c-5fa88b3bd898 Sep 23 00:31:58 devstack sudo[105114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:58 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5599851f-5264-4e43-9478-ac403c21ff36 tempest-CreateVolumesFromImageTest-111102826 None] Lock "cinder-002cfb37-e176-41dc-b637-a22948478bf2-delete_volume" released by "delete_volume" :: held 2.584s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d457c111-069c-45e6-b736-e410ea292353 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7199f9b8-00a1-4ee5-9c3d-c67cafb088b6 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:58 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] Copying metadata from image 4d8c0e61-5fb9-4d40-a303-cf0f508fc38c to 184ef56e-79e6-465e-bd7e-ec2deb62c232. {{(pid=86591) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 00:31:58 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] Creating volume glance metadata for volume 184ef56e-79e6-465e-bd7e-ec2deb62c232 backed by image 4d8c0e61-5fb9-4d40-a303-cf0f508fc38c with: {'image_id': '4d8c0e61-5fb9-4d40-a303-cf0f508fc38c', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'e89525ed9cbcfa9b8ebec548777862e7', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86591) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 00:31:58 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9674c435-a6de-4941-8c73-1d2435262d31 tempest-CreateVolumesFromImageTest-111102826 None] Acquiring lock "cinder-quobyte-d5babfd7-a5cb-40f4-9109-060f9873c265" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:58 devstack sudo[105116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7199f9b8-00a1-4ee5-9c3d-c67cafb088b6 Sep 23 00:31:58 devstack sudo[105116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:58 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9674c435-a6de-4941-8c73-1d2435262d31 tempest-CreateVolumesFromImageTest-111102826 None] Lock "cinder-quobyte-d5babfd7-a5cb-40f4-9109-060f9873c265" acquired by "delete_volume" :: waited 0.034s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:58 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[939b603e-99db-48dc-891f-610a8c544549]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9674c435-a6de-4941-8c73-1d2435262d31 tempest-CreateVolumesFromImageTest-111102826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d5babfd7-a5cb-40f4-9109-060f9873c265 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c06fdb6-5ef0-46fc-9baa-7f4b1b7cbc03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-184ef56e-79e6-465e-bd7e-ec2deb62c232', 'volume_size': 1, 'image_id': '4d8c0e61-5fb9-4d40-a303-cf0f508fc38c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4d8c0e61-5fb9-4d40-a303-cf0f508fc38c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e89525ed9cbcfa9b8ebec548777862e7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '00c87d0dd4264be2bf01894606547705', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2b051138029422e60d0f3e88a671462a8cea8e4ab6584fb248679b7183d84b5e84b6c40e47edd940f96c75c75963013821eef681b55f816b2985da727aff1474', 'id': '4d8c0e61-5fb9-4d40-a303-cf0f508fc38c', 'created_at': datetime.datetime(2026, 9, 22, 22, 31, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 31, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4d8c0e61-5fb9-4d40-a303-cf0f508fc38c/file', 'properties': {}}, 'image_service': }' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b812ff2f-6684-4a5a-9b8a-38a593686220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:58 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] Volume volume-184ef56e-79e6-465e-bd7e-ec2deb62c232 (184ef56e-79e6-465e-bd7e-ec2deb62c232): created successfully Sep 23 00:31:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b812ff2f-6684-4a5a-9b8a-38a593686220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] Flow 'volume_create_manager' (b6d0c438-624f-41a8-b91f-fe29f021b7ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:58 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-7810af3a-c547-425f-87f3-323163990261 tempest-VolumeImageDependencyTests-1675728564 None] Created volume successfully. Sep 23 00:31:58 devstack sudo[105118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d5babfd7-a5cb-40f4-9109-060f9873c265 Sep 23 00:31:58 devstack sudo[105118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:58 devstack sudo[105116]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d457c111-069c-45e6-b736-e410ea292353 tempest-CreateVolumesFromSnapshotTest-1109491162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7199f9b8-00a1-4ee5-9c3d-c67cafb088b6" returned: 0 in 0.321s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:58 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d457c111-069c-45e6-b736-e410ea292353 tempest-CreateVolumesFromSnapshotTest-1109491162 None] <== create_volume: return (1278ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:31:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d457c111-069c-45e6-b736-e410ea292353 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.281s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8137f7b9-c820-4d17-830c-7d0cf4c705ca tempest-CreateVolumesFromSnapshotTest-1109491162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.763s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:58 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-8137f7b9-c820-4d17-830c-7d0cf4c705ca tempest-CreateVolumesFromSnapshotTest-1109491162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-255000311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=901c7dfa-f803-43c9-b643-149a260631cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3130d1b5f264f9e990b49bceefd9339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:56Z,use_quota=True,user_id='1dd39020b759450aaad6d06a652b808b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:31:58 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-8137f7b9-c820-4d17-830c-7d0cf4c705ca tempest-CreateVolumesFromSnapshotTest-1109491162 None] Creating volume 901c7dfa-f803-43c9-b643-149a260631cc {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:31:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8137f7b9-c820-4d17-830c-7d0cf4c705ca tempest-CreateVolumesFromSnapshotTest-1109491162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8137f7b9-c820-4d17-830c-7d0cf4c705ca tempest-CreateVolumesFromSnapshotTest-1109491162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:58 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-8137f7b9-c820-4d17-830c-7d0cf4c705ca tempest-CreateVolumesFromSnapshotTest-1109491162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:58 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-8137f7b9-c820-4d17-830c-7d0cf4c705ca tempest-CreateVolumesFromSnapshotTest-1109491162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8137f7b9-c820-4d17-830c-7d0cf4c705ca tempest-CreateVolumesFromSnapshotTest-1109491162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:58 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-8137f7b9-c820-4d17-830c-7d0cf4c705ca tempest-CreateVolumesFromSnapshotTest-1109491162 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:31:58 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-8137f7b9-c820-4d17-830c-7d0cf4c705ca tempest-CreateVolumesFromSnapshotTest-1109491162 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:31:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8137f7b9-c820-4d17-830c-7d0cf4c705ca tempest-CreateVolumesFromSnapshotTest-1109491162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-901c7dfa-f803-43c9-b643-149a260631cc 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d457c111-069c-45e6-b736-e410ea292353 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f66044b6-1016-4ea2-b105-01b3caf7c793) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7199f9b8-00a1-4ee5-9c3d-c67cafb088b6', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:58 devstack sudo[105124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-901c7dfa-f803-43c9-b643-149a260631cc 1073741824 Sep 23 00:31:58 devstack sudo[105124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d457c111-069c-45e6-b736-e410ea292353 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5988d360-affe-4964-a483-a39f6ca418ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:58 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-d457c111-069c-45e6-b736-e410ea292353 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Volume volume-7199f9b8-00a1-4ee5-9c3d-c67cafb088b6 (7199f9b8-00a1-4ee5-9c3d-c67cafb088b6): created successfully Sep 23 00:31:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d457c111-069c-45e6-b736-e410ea292353 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5988d360-affe-4964-a483-a39f6ca418ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-d457c111-069c-45e6-b736-e410ea292353 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Flow 'volume_create_manager' (db9b9dca-95d2-4f7f-8c5b-3c1716e0d19e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:59 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-d457c111-069c-45e6-b736-e410ea292353 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Created volume successfully. Sep 23 00:31:59 devstack sudo[105114]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_66a58d32-4194-441d-a910-0ebf7286e8c9_sxxourvtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3f73115d-30c9-4bcd-813c-5fa88b3bd898" returned: 0 in 0.610s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:59 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_66a58d32-4194-441d-a910-0ebf7286e8c9_sxxourvtdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3f73115d-30c9-4bcd-813c-5fa88b3bd898 {{(pid=86591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:31:59 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Converted 0.00 MB image at 0.00 MB/s Sep 23 00:31:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3f73115d-30c9-4bcd-813c-5fa88b3bd898 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:59 devstack sudo[105129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3f73115d-30c9-4bcd-813c-5fa88b3bd898 1G Sep 23 00:31:59 devstack sudo[105129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:59 devstack sudo[105118]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9674c435-a6de-4941-8c73-1d2435262d31 tempest-CreateVolumesFromImageTest-111102826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d5babfd7-a5cb-40f4-9109-060f9873c265" returned: 0 in 0.522s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9674c435-a6de-4941-8c73-1d2435262d31 tempest-CreateVolumesFromImageTest-111102826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d5babfd7-a5cb-40f4-9109-060f9873c265 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:59 devstack sudo[105135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d5babfd7-a5cb-40f4-9109-060f9873c265 Sep 23 00:31:59 devstack sudo[105135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:59 devstack sudo[105124]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8137f7b9-c820-4d17-830c-7d0cf4c705ca tempest-CreateVolumesFromSnapshotTest-1109491162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-901c7dfa-f803-43c9-b643-149a260631cc 1073741824" returned: 0 in 0.518s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8137f7b9-c820-4d17-830c-7d0cf4c705ca tempest-CreateVolumesFromSnapshotTest-1109491162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-901c7dfa-f803-43c9-b643-149a260631cc {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:59 devstack sudo[105142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-901c7dfa-f803-43c9-b643-149a260631cc Sep 23 00:31:59 devstack sudo[105142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:59 devstack sudo[105135]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9674c435-a6de-4941-8c73-1d2435262d31 tempest-CreateVolumesFromImageTest-111102826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d5babfd7-a5cb-40f4-9109-060f9873c265" returned: 0 in 0.308s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:59 devstack sudo[105129]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3f73115d-30c9-4bcd-813c-5fa88b3bd898 1G" returned: 0 in 0.430s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:59 devstack cinder-volume[86591]: DEBUG cinder.volume.volume_utils [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Downloaded image 66a58d32-4194-441d-a910-0ebf7286e8c9 ((None, [{'url': 'file:///opt/stack/data/glance/images/66a58d32-4194-441d-a910-0ebf7286e8c9', 'metadata': {}}])) to volume 3f73115d-30c9-4bcd-813c-5fa88b3bd898 successfully. {{(pid=86591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 00:31:59 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Temporary image 66a58d32-4194-441d-a910-0ebf7286e8c9 for user f1b9b8178d4246dca7c79efdd27c390d is deleted. {{(pid=86591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 00:31:59 devstack cinder-volume[86591]: DEBUG cinder.volume.volume_utils [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Marking volume 3f73115d-30c9-4bcd-813c-5fa88b3bd898 as bootable. {{(pid=86591) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 00:31:59 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9674c435-a6de-4941-8c73-1d2435262d31 tempest-CreateVolumesFromImageTest-111102826 None] Lock "cinder-quobyte-d5babfd7-a5cb-40f4-9109-060f9873c265" released by "delete_volume" :: held 0.912s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:59 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Copying metadata from image 66a58d32-4194-441d-a910-0ebf7286e8c9 to 3f73115d-30c9-4bcd-813c-5fa88b3bd898. {{(pid=86591) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 00:31:59 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Creating volume glance metadata for volume 3f73115d-30c9-4bcd-813c-5fa88b3bd898 backed by image 66a58d32-4194-441d-a910-0ebf7286e8c9 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '66a58d32-4194-441d-a910-0ebf7286e8c9', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'e5d6a0a5f549a3740ec3d52cceab93e4', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86591) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 00:31:59 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-9674c435-a6de-4941-8c73-1d2435262d31 tempest-CreateVolumesFromImageTest-111102826 None] Created reservations ['70f9e56f-4c9b-4899-9e67-d30a056d298d', 'd16970e7-8e6e-4df1-bcdc-18ac844b00ac', '283060f9-12f5-4d6f-ab77-7c2c76e53bfd', 'e3981f63-2d4e-4478-b52f-ab46b298eac3'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:31:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (209e0a85-4f5d-49ab-a1af-40f026c7c035) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f73115d-30c9-4bcd-813c-5fa88b3bd898', 'volume_size': 1, 'image_id': '66a58d32-4194-441d-a910-0ebf7286e8c9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/66a58d32-4194-441d-a910-0ebf7286e8c9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e5d6a0a5f549a3740ec3d52cceab93e4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd66d3b96c8a94649a6e45489c8f224ad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fa197e54b240b882de4d62b31a354fa310e84dd01cfcf898c39879b1383b17efe3e275d9e8e84c4bd27645e7ff8e6c2605015d46cd0752d3268b2c91a5a57e49', 'id': '66a58d32-4194-441d-a910-0ebf7286e8c9', 'created_at': datetime.datetime(2026, 9, 22, 22, 31, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 31, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/66a58d32-4194-441d-a910-0ebf7286e8c9/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (351ce0fe-584c-4031-a867-422469af2a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:59 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Volume volume-3f73115d-30c9-4bcd-813c-5fa88b3bd898 (3f73115d-30c9-4bcd-813c-5fa88b3bd898): created successfully Sep 23 00:31:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (351ce0fe-584c-4031-a867-422469af2a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Flow 'volume_create_manager' (0a69ea9c-e901-464a-981b-bf5f5b21548f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:59 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-0c509306-0a8c-4c93-82bb-d05c53095e0c tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Created volume successfully. Sep 23 00:31:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9674c435-a6de-4941-8c73-1d2435262d31 tempest-CreateVolumesFromImageTest-111102826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9674c435-a6de-4941-8c73-1d2435262d31 tempest-CreateVolumesFromImageTest-111102826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9674c435-a6de-4941-8c73-1d2435262d31 tempest-CreateVolumesFromImageTest-111102826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9674c435-a6de-4941-8c73-1d2435262d31 tempest-CreateVolumesFromImageTest-111102826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9674c435-a6de-4941-8c73-1d2435262d31 tempest-CreateVolumesFromImageTest-111102826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9674c435-a6de-4941-8c73-1d2435262d31 tempest-CreateVolumesFromImageTest-111102826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:59 devstack sudo[105142]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8137f7b9-c820-4d17-830c-7d0cf4c705ca tempest-CreateVolumesFromSnapshotTest-1109491162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-901c7dfa-f803-43c9-b643-149a260631cc" returned: 0 in 0.344s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-8137f7b9-c820-4d17-830c-7d0cf4c705ca tempest-CreateVolumesFromSnapshotTest-1109491162 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:31:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8137f7b9-c820-4d17-830c-7d0cf4c705ca tempest-CreateVolumesFromSnapshotTest-1109491162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5fbb2235-7bc7-421c-997e-471cb307681c tempest-CreateVolumesFromSnapshotTest-1109491162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.925s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5fbb2235-7bc7-421c-997e-471cb307681c tempest-CreateVolumesFromSnapshotTest-1109491162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1595210274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=438b5939-0d5a-4867-8796-a4ffcfbaaf86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3130d1b5f264f9e990b49bceefd9339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:57Z,use_quota=True,user_id='1dd39020b759450aaad6d06a652b808b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:31:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-5fbb2235-7bc7-421c-997e-471cb307681c tempest-CreateVolumesFromSnapshotTest-1109491162 None] Creating volume 438b5939-0d5a-4867-8796-a4ffcfbaaf86 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:31:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5fbb2235-7bc7-421c-997e-471cb307681c tempest-CreateVolumesFromSnapshotTest-1109491162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5fbb2235-7bc7-421c-997e-471cb307681c tempest-CreateVolumesFromSnapshotTest-1109491162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5fbb2235-7bc7-421c-997e-471cb307681c tempest-CreateVolumesFromSnapshotTest-1109491162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5fbb2235-7bc7-421c-997e-471cb307681c tempest-CreateVolumesFromSnapshotTest-1109491162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5fbb2235-7bc7-421c-997e-471cb307681c tempest-CreateVolumesFromSnapshotTest-1109491162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5fbb2235-7bc7-421c-997e-471cb307681c tempest-CreateVolumesFromSnapshotTest-1109491162 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:31:59 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-5fbb2235-7bc7-421c-997e-471cb307681c tempest-CreateVolumesFromSnapshotTest-1109491162 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:31:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5fbb2235-7bc7-421c-997e-471cb307681c tempest-CreateVolumesFromSnapshotTest-1109491162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-438b5939-0d5a-4867-8796-a4ffcfbaaf86 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:59 devstack sudo[105145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:31:59 devstack sudo[105145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8137f7b9-c820-4d17-830c-7d0cf4c705ca tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35dbdea0-1df7-4ceb-bf44-7226f708cbd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-901c7dfa-f803-43c9-b643-149a260631cc', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8137f7b9-c820-4d17-830c-7d0cf4c705ca tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83598813-ac8b-4b17-978a-05c42c7dea8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:59 devstack sudo[105147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-438b5939-0d5a-4867-8796-a4ffcfbaaf86 1073741824 Sep 23 00:31:59 devstack sudo[105147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:59 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d7e85434-9077-40e3-bdc5-74b65b93e028 tempest-VolumeImageDependencyTests-1675728564 None] Acquiring lock "cinder-184ef56e-79e6-465e-bd7e-ec2deb62c232-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:59 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-20b166d1-0714-484a-a786-7086c1a28db7 tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Acquiring lock "cinder-3f73115d-30c9-4bcd-813c-5fa88b3bd898-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:59 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-8137f7b9-c820-4d17-830c-7d0cf4c705ca tempest-CreateVolumesFromSnapshotTest-1109491162 None] Volume volume-901c7dfa-f803-43c9-b643-149a260631cc (901c7dfa-f803-43c9-b643-149a260631cc): created successfully Sep 23 00:31:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8137f7b9-c820-4d17-830c-7d0cf4c705ca tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83598813-ac8b-4b17-978a-05c42c7dea8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8137f7b9-c820-4d17-830c-7d0cf4c705ca tempest-CreateVolumesFromSnapshotTest-1109491162 None] Flow 'volume_create_manager' (93f1f154-de3a-4579-a6a3-9878dabe5c7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:00 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d7e85434-9077-40e3-bdc5-74b65b93e028 tempest-VolumeImageDependencyTests-1675728564 None] Lock "cinder-184ef56e-79e6-465e-bd7e-ec2deb62c232-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:00 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-20b166d1-0714-484a-a786-7086c1a28db7 tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Lock "cinder-3f73115d-30c9-4bcd-813c-5fa88b3bd898-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:00 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-8137f7b9-c820-4d17-830c-7d0cf4c705ca tempest-CreateVolumesFromSnapshotTest-1109491162 None] Created volume successfully. Sep 23 00:32:00 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d7e85434-9077-40e3-bdc5-74b65b93e028 tempest-VolumeImageDependencyTests-1675728564 None] Acquiring lock "cinder-quobyte-184ef56e-79e6-465e-bd7e-ec2deb62c232" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:00 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-20b166d1-0714-484a-a786-7086c1a28db7 tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Acquiring lock "cinder-quobyte-3f73115d-30c9-4bcd-813c-5fa88b3bd898" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:00 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d7e85434-9077-40e3-bdc5-74b65b93e028 tempest-VolumeImageDependencyTests-1675728564 None] Lock "cinder-quobyte-184ef56e-79e6-465e-bd7e-ec2deb62c232" acquired by "delete_volume" :: waited 0.022s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:00 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-20b166d1-0714-484a-a786-7086c1a28db7 tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Lock "cinder-quobyte-3f73115d-30c9-4bcd-813c-5fa88b3bd898" acquired by "delete_volume" :: waited 0.040s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:00 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[719793c5-23aa-4a18-af57-dbac159dfea8]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d7e85434-9077-40e3-bdc5-74b65b93e028 tempest-VolumeImageDependencyTests-1675728564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-184ef56e-79e6-465e-bd7e-ec2deb62c232 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:00 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[6940e629-6b30-4b0c-bd76-5359d32c295f]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-20b166d1-0714-484a-a786-7086c1a28db7 tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3f73115d-30c9-4bcd-813c-5fa88b3bd898 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:00 devstack sudo[105145]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9674c435-a6de-4941-8c73-1d2435262d31 tempest-CreateVolumesFromImageTest-111102826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.343s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:00 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-9674c435-a6de-4941-8c73-1d2435262d31 tempest-CreateVolumesFromImageTest-111102826 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:00 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-9674c435-a6de-4941-8c73-1d2435262d31 tempest-CreateVolumesFromImageTest-111102826 None] Deleted volume successfully. Sep 23 00:32:00 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9674c435-a6de-4941-8c73-1d2435262d31 tempest-CreateVolumesFromImageTest-111102826 None] Lock "cinder-d5babfd7-a5cb-40f4-9109-060f9873c265-delete_volume" released by "delete_volume" :: held 1.781s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:00 devstack sudo[105152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3f73115d-30c9-4bcd-813c-5fa88b3bd898 Sep 23 00:32:00 devstack sudo[105152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:00 devstack sudo[105151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-184ef56e-79e6-465e-bd7e-ec2deb62c232 Sep 23 00:32:00 devstack sudo[105151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:00 devstack sudo[105147]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5fbb2235-7bc7-421c-997e-471cb307681c tempest-CreateVolumesFromSnapshotTest-1109491162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-438b5939-0d5a-4867-8796-a4ffcfbaaf86 1073741824" returned: 0 in 0.605s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5fbb2235-7bc7-421c-997e-471cb307681c tempest-CreateVolumesFromSnapshotTest-1109491162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-438b5939-0d5a-4867-8796-a4ffcfbaaf86 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:00 devstack sudo[105162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-438b5939-0d5a-4867-8796-a4ffcfbaaf86 Sep 23 00:32:00 devstack sudo[105162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:00 devstack sudo[105152]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-20b166d1-0714-484a-a786-7086c1a28db7 tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3f73115d-30c9-4bcd-813c-5fa88b3bd898" returned: 0 in 0.431s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-20b166d1-0714-484a-a786-7086c1a28db7 tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3f73115d-30c9-4bcd-813c-5fa88b3bd898 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:00 devstack sudo[105151]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d7e85434-9077-40e3-bdc5-74b65b93e028 tempest-VolumeImageDependencyTests-1675728564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-184ef56e-79e6-465e-bd7e-ec2deb62c232" returned: 0 in 0.467s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d7e85434-9077-40e3-bdc5-74b65b93e028 tempest-VolumeImageDependencyTests-1675728564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-184ef56e-79e6-465e-bd7e-ec2deb62c232 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:00 devstack sudo[105166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3f73115d-30c9-4bcd-813c-5fa88b3bd898 Sep 23 00:32:00 devstack sudo[105166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:00 devstack sudo[105167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-184ef56e-79e6-465e-bd7e-ec2deb62c232 Sep 23 00:32:00 devstack sudo[105167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:00 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-2278d153-6a6c-4f68-8da0-fbda9f3e57be tempest-CreateVolumesFromImageTest-111102826 None] Acquiring lock "cinder-db59e5f1-33b2-4650-84be-6798a2d09706-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:00 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-2278d153-6a6c-4f68-8da0-fbda9f3e57be tempest-CreateVolumesFromImageTest-111102826 None] Lock "cinder-db59e5f1-33b2-4650-84be-6798a2d09706-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:00 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-2278d153-6a6c-4f68-8da0-fbda9f3e57be tempest-CreateVolumesFromImageTest-111102826 None] Acquiring lock "cinder-quobyte-db59e5f1-33b2-4650-84be-6798a2d09706" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:00 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-2278d153-6a6c-4f68-8da0-fbda9f3e57be tempest-CreateVolumesFromImageTest-111102826 None] Lock "cinder-quobyte-db59e5f1-33b2-4650-84be-6798a2d09706" acquired by "delete_volume" :: waited 0.030s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:00 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51ecf59-7090-4639-8035-b9a199b9973d]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2278d153-6a6c-4f68-8da0-fbda9f3e57be tempest-CreateVolumesFromImageTest-111102826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db59e5f1-33b2-4650-84be-6798a2d09706 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:00 devstack sudo[105162]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5fbb2235-7bc7-421c-997e-471cb307681c tempest-CreateVolumesFromSnapshotTest-1109491162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-438b5939-0d5a-4867-8796-a4ffcfbaaf86" returned: 0 in 0.438s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:00 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5fbb2235-7bc7-421c-997e-471cb307681c tempest-CreateVolumesFromSnapshotTest-1109491162 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:32:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5fbb2235-7bc7-421c-997e-471cb307681c tempest-CreateVolumesFromSnapshotTest-1109491162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1124be1c-dd6c-4d45-80de-f241d503196f tempest-CreateVolumesFromSnapshotTest-1109491162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.231s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:00 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1124be1c-dd6c-4d45-80de-f241d503196f tempest-CreateVolumesFromSnapshotTest-1109491162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1987689727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=085ddcf0-4857-4831-b679-bfe5d092fa68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3130d1b5f264f9e990b49bceefd9339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:57Z,use_quota=True,user_id='1dd39020b759450aaad6d06a652b808b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:32:00 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-1124be1c-dd6c-4d45-80de-f241d503196f tempest-CreateVolumesFromSnapshotTest-1109491162 None] Creating volume 085ddcf0-4857-4831-b679-bfe5d092fa68 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:32:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1124be1c-dd6c-4d45-80de-f241d503196f tempest-CreateVolumesFromSnapshotTest-1109491162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1124be1c-dd6c-4d45-80de-f241d503196f tempest-CreateVolumesFromSnapshotTest-1109491162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:00 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1124be1c-dd6c-4d45-80de-f241d503196f tempest-CreateVolumesFromSnapshotTest-1109491162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:00 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1124be1c-dd6c-4d45-80de-f241d503196f tempest-CreateVolumesFromSnapshotTest-1109491162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1124be1c-dd6c-4d45-80de-f241d503196f tempest-CreateVolumesFromSnapshotTest-1109491162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:00 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1124be1c-dd6c-4d45-80de-f241d503196f tempest-CreateVolumesFromSnapshotTest-1109491162 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:32:00 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-1124be1c-dd6c-4d45-80de-f241d503196f tempest-CreateVolumesFromSnapshotTest-1109491162 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:32:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1124be1c-dd6c-4d45-80de-f241d503196f tempest-CreateVolumesFromSnapshotTest-1109491162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-085ddcf0-4857-4831-b679-bfe5d092fa68 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5fbb2235-7bc7-421c-997e-471cb307681c tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b0067ad-9236-42e3-a893-2ced829fbe87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-438b5939-0d5a-4867-8796-a4ffcfbaaf86', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5fbb2235-7bc7-421c-997e-471cb307681c tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (835d604b-c39a-4983-8671-3fd2ec165977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:01 devstack sudo[105166]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:01 devstack sudo[105174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-085ddcf0-4857-4831-b679-bfe5d092fa68 1073741824 Sep 23 00:32:01 devstack sudo[105174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-20b166d1-0714-484a-a786-7086c1a28db7 tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3f73115d-30c9-4bcd-813c-5fa88b3bd898" returned: 0 in 0.444s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:01 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-20b166d1-0714-484a-a786-7086c1a28db7 tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Lock "cinder-quobyte-3f73115d-30c9-4bcd-813c-5fa88b3bd898" released by "delete_volume" :: held 0.964s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:01 devstack sudo[105167]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:01 devstack sudo[105171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db59e5f1-33b2-4650-84be-6798a2d09706 Sep 23 00:32:01 devstack sudo[105171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:01 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-5fbb2235-7bc7-421c-997e-471cb307681c tempest-CreateVolumesFromSnapshotTest-1109491162 None] Volume volume-438b5939-0d5a-4867-8796-a4ffcfbaaf86 (438b5939-0d5a-4867-8796-a4ffcfbaaf86): created successfully Sep 23 00:32:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5fbb2235-7bc7-421c-997e-471cb307681c tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (835d604b-c39a-4983-8671-3fd2ec165977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-5fbb2235-7bc7-421c-997e-471cb307681c tempest-CreateVolumesFromSnapshotTest-1109491162 None] Flow 'volume_create_manager' (8850718d-3240-4d4e-8256-643e164bfb5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d7e85434-9077-40e3-bdc5-74b65b93e028 tempest-VolumeImageDependencyTests-1675728564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-184ef56e-79e6-465e-bd7e-ec2deb62c232" returned: 0 in 0.518s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:01 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-5fbb2235-7bc7-421c-997e-471cb307681c tempest-CreateVolumesFromSnapshotTest-1109491162 None] Created volume successfully. Sep 23 00:32:01 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d7e85434-9077-40e3-bdc5-74b65b93e028 tempest-VolumeImageDependencyTests-1675728564 None] Lock "cinder-quobyte-184ef56e-79e6-465e-bd7e-ec2deb62c232" released by "delete_volume" :: held 1.060s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:01 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-20b166d1-0714-484a-a786-7086c1a28db7 tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Created reservations ['0dde708c-209d-4d8a-89f2-e8e482405429', '36c183e2-869b-436f-b74e-f8741966244e', '43477ca1-4c9c-4c44-855c-04e5e9dfe526', '6f6a1ac7-5006-4f16-953c-c79fbe3f278c'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:01 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-d7e85434-9077-40e3-bdc5-74b65b93e028 tempest-VolumeImageDependencyTests-1675728564 None] Created reservations ['970fc3f2-2f65-4f52-b2a8-7cf9bce73fa8', 'ebf6f712-44f8-48ce-af0e-1c89611e946c', '775bbeff-34bf-45a1-a35f-8de52480ee52', '1a40f389-5c81-4d15-8071-510a27978c94'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-20b166d1-0714-484a-a786-7086c1a28db7 tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-20b166d1-0714-484a-a786-7086c1a28db7 tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-20b166d1-0714-484a-a786-7086c1a28db7 tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-20b166d1-0714-484a-a786-7086c1a28db7 tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-20b166d1-0714-484a-a786-7086c1a28db7 tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-20b166d1-0714-484a-a786-7086c1a28db7 tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:01 devstack sudo[105183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:32:01 devstack sudo[105183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d7e85434-9077-40e3-bdc5-74b65b93e028 tempest-VolumeImageDependencyTests-1675728564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d7e85434-9077-40e3-bdc5-74b65b93e028 tempest-VolumeImageDependencyTests-1675728564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d7e85434-9077-40e3-bdc5-74b65b93e028 tempest-VolumeImageDependencyTests-1675728564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-d7e85434-9077-40e3-bdc5-74b65b93e028 tempest-VolumeImageDependencyTests-1675728564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-d7e85434-9077-40e3-bdc5-74b65b93e028 tempest-VolumeImageDependencyTests-1675728564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:01 devstack sudo[105171]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d7e85434-9077-40e3-bdc5-74b65b93e028 tempest-VolumeImageDependencyTests-1675728564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2278d153-6a6c-4f68-8da0-fbda9f3e57be tempest-CreateVolumesFromImageTest-111102826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db59e5f1-33b2-4650-84be-6798a2d09706" returned: 0 in 0.511s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2278d153-6a6c-4f68-8da0-fbda9f3e57be tempest-CreateVolumesFromImageTest-111102826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db59e5f1-33b2-4650-84be-6798a2d09706 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:01 devstack sudo[105185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:32:01 devstack sudo[105185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:01 devstack sudo[105186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db59e5f1-33b2-4650-84be-6798a2d09706 Sep 23 00:32:01 devstack sudo[105186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:01 devstack sudo[105174]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1124be1c-dd6c-4d45-80de-f241d503196f tempest-CreateVolumesFromSnapshotTest-1109491162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-085ddcf0-4857-4831-b679-bfe5d092fa68 1073741824" returned: 0 in 0.666s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1124be1c-dd6c-4d45-80de-f241d503196f tempest-CreateVolumesFromSnapshotTest-1109491162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-085ddcf0-4857-4831-b679-bfe5d092fa68 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:01 devstack sudo[105183]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-20b166d1-0714-484a-a786-7086c1a28db7 tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.352s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:01 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-20b166d1-0714-484a-a786-7086c1a28db7 tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:01 devstack sudo[105191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-085ddcf0-4857-4831-b679-bfe5d092fa68 Sep 23 00:32:01 devstack sudo[105191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:01 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-20b166d1-0714-484a-a786-7086c1a28db7 tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Deleted volume successfully. Sep 23 00:32:01 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-20b166d1-0714-484a-a786-7086c1a28db7 tempest-VolumeAndVolumeTypeFromImageTest-702922413 None] Lock "cinder-3f73115d-30c9-4bcd-813c-5fa88b3bd898-delete_volume" released by "delete_volume" :: held 1.752s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:01 devstack sudo[105185]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-d7e85434-9077-40e3-bdc5-74b65b93e028 tempest-VolumeImageDependencyTests-1675728564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.353s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:01 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-d7e85434-9077-40e3-bdc5-74b65b93e028 tempest-VolumeImageDependencyTests-1675728564 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:01 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-d7e85434-9077-40e3-bdc5-74b65b93e028 tempest-VolumeImageDependencyTests-1675728564 None] Deleted volume successfully. Sep 23 00:32:01 devstack sudo[105186]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2278d153-6a6c-4f68-8da0-fbda9f3e57be tempest-CreateVolumesFromImageTest-111102826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db59e5f1-33b2-4650-84be-6798a2d09706" returned: 0 in 0.360s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:01 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-2278d153-6a6c-4f68-8da0-fbda9f3e57be tempest-CreateVolumesFromImageTest-111102826 None] Lock "cinder-quobyte-db59e5f1-33b2-4650-84be-6798a2d09706" released by "delete_volume" :: held 0.950s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:01 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-d7e85434-9077-40e3-bdc5-74b65b93e028 tempest-VolumeImageDependencyTests-1675728564 None] Lock "cinder-184ef56e-79e6-465e-bd7e-ec2deb62c232-delete_volume" released by "delete_volume" :: held 1.841s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:01 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-2278d153-6a6c-4f68-8da0-fbda9f3e57be tempest-CreateVolumesFromImageTest-111102826 None] Created reservations ['f5b72b5f-4a81-4690-8c13-adaff3346bda', '32d46a21-9d76-4a54-ae59-ebe05a5b6bd8', 'e18acef5-f421-4d7d-9d15-65494c44a87b', '375f5e83-ab07-484c-ad9a-8c53c051a392'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2278d153-6a6c-4f68-8da0-fbda9f3e57be tempest-CreateVolumesFromImageTest-111102826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2278d153-6a6c-4f68-8da0-fbda9f3e57be tempest-CreateVolumesFromImageTest-111102826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2278d153-6a6c-4f68-8da0-fbda9f3e57be tempest-CreateVolumesFromImageTest-111102826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-2278d153-6a6c-4f68-8da0-fbda9f3e57be tempest-CreateVolumesFromImageTest-111102826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-2278d153-6a6c-4f68-8da0-fbda9f3e57be tempest-CreateVolumesFromImageTest-111102826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2278d153-6a6c-4f68-8da0-fbda9f3e57be tempest-CreateVolumesFromImageTest-111102826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:02 devstack sudo[105195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:32:02 devstack sudo[105195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:02 devstack sudo[105191]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1124be1c-dd6c-4d45-80de-f241d503196f tempest-CreateVolumesFromSnapshotTest-1109491162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-085ddcf0-4857-4831-b679-bfe5d092fa68" returned: 0 in 0.355s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:02 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1124be1c-dd6c-4d45-80de-f241d503196f tempest-CreateVolumesFromSnapshotTest-1109491162 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:32:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1124be1c-dd6c-4d45-80de-f241d503196f tempest-CreateVolumesFromSnapshotTest-1109491162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:02 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1124be1c-dd6c-4d45-80de-f241d503196f tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62214c13-14a2-4104-b59c-a08b2632744f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-085ddcf0-4857-4831-b679-bfe5d092fa68', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:02 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1124be1c-dd6c-4d45-80de-f241d503196f tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7facb52-d1b6-465c-8fb2-052f72b2992b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:02 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-1124be1c-dd6c-4d45-80de-f241d503196f tempest-CreateVolumesFromSnapshotTest-1109491162 None] Volume volume-085ddcf0-4857-4831-b679-bfe5d092fa68 (085ddcf0-4857-4831-b679-bfe5d092fa68): created successfully Sep 23 00:32:02 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1124be1c-dd6c-4d45-80de-f241d503196f tempest-CreateVolumesFromSnapshotTest-1109491162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7facb52-d1b6-465c-8fb2-052f72b2992b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:02 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1124be1c-dd6c-4d45-80de-f241d503196f tempest-CreateVolumesFromSnapshotTest-1109491162 None] Flow 'volume_create_manager' (8264a903-79b4-4e45-91cc-4223049638b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:02 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-1124be1c-dd6c-4d45-80de-f241d503196f tempest-CreateVolumesFromSnapshotTest-1109491162 None] Created volume successfully. Sep 23 00:32:02 devstack sudo[105195]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-2278d153-6a6c-4f68-8da0-fbda9f3e57be tempest-CreateVolumesFromImageTest-111102826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.313s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:02 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-2278d153-6a6c-4f68-8da0-fbda9f3e57be tempest-CreateVolumesFromImageTest-111102826 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:02 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-2278d153-6a6c-4f68-8da0-fbda9f3e57be tempest-CreateVolumesFromImageTest-111102826 None] Deleted volume successfully. Sep 23 00:32:02 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-2278d153-6a6c-4f68-8da0-fbda9f3e57be tempest-CreateVolumesFromImageTest-111102826 None] Lock "cinder-db59e5f1-33b2-4650-84be-6798a2d09706-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:03 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9c4616d5-9a00-4886-a0d6-5ff6e5963e86 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Acquiring lock "cinder-085ddcf0-4857-4831-b679-bfe5d092fa68-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:03 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9c4616d5-9a00-4886-a0d6-5ff6e5963e86 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Lock "cinder-085ddcf0-4857-4831-b679-bfe5d092fa68-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:03 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9c4616d5-9a00-4886-a0d6-5ff6e5963e86 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Acquiring lock "cinder-quobyte-085ddcf0-4857-4831-b679-bfe5d092fa68" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:03 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9c4616d5-9a00-4886-a0d6-5ff6e5963e86 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Lock "cinder-quobyte-085ddcf0-4857-4831-b679-bfe5d092fa68" acquired by "delete_volume" :: waited 0.017s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:03 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35186cf-a2cc-4354-84d0-a52cf627fac1]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9c4616d5-9a00-4886-a0d6-5ff6e5963e86 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-085ddcf0-4857-4831-b679-bfe5d092fa68 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:03 devstack sudo[105199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-085ddcf0-4857-4831-b679-bfe5d092fa68 Sep 23 00:32:03 devstack sudo[105199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:03 devstack sudo[105199]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9c4616d5-9a00-4886-a0d6-5ff6e5963e86 tempest-CreateVolumesFromSnapshotTest-1109491162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-085ddcf0-4857-4831-b679-bfe5d092fa68" returned: 0 in 0.505s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9c4616d5-9a00-4886-a0d6-5ff6e5963e86 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-085ddcf0-4857-4831-b679-bfe5d092fa68 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:03 devstack sudo[105204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-085ddcf0-4857-4831-b679-bfe5d092fa68 Sep 23 00:32:03 devstack sudo[105204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:04 devstack sudo[105204]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9c4616d5-9a00-4886-a0d6-5ff6e5963e86 tempest-CreateVolumesFromSnapshotTest-1109491162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-085ddcf0-4857-4831-b679-bfe5d092fa68" returned: 0 in 0.379s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:04 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9c4616d5-9a00-4886-a0d6-5ff6e5963e86 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Lock "cinder-quobyte-085ddcf0-4857-4831-b679-bfe5d092fa68" released by "delete_volume" :: held 0.939s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:04 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-9c4616d5-9a00-4886-a0d6-5ff6e5963e86 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Created reservations ['27d88b2b-2e9d-4439-821c-91653039dcc1', '086f1d34-fa9b-4ed7-b213-6f0be03848c6', 'ce3d0199-803c-4bd1-b528-f264b79b8779', 'd7fa2ac1-104e-4657-ab22-f0588b8d3072'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9c4616d5-9a00-4886-a0d6-5ff6e5963e86 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9c4616d5-9a00-4886-a0d6-5ff6e5963e86 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:04 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9c4616d5-9a00-4886-a0d6-5ff6e5963e86 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:04 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9c4616d5-9a00-4886-a0d6-5ff6e5963e86 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9c4616d5-9a00-4886-a0d6-5ff6e5963e86 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9c4616d5-9a00-4886-a0d6-5ff6e5963e86 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:04 devstack sudo[105208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:32:04 devstack sudo[105208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:04 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-da1b911d-2ee1-44a6-ab54-78af7fda4782 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Acquiring lock "cinder-438b5939-0d5a-4867-8796-a4ffcfbaaf86-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:04 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-da1b911d-2ee1-44a6-ab54-78af7fda4782 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Lock "cinder-438b5939-0d5a-4867-8796-a4ffcfbaaf86-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:04 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-da1b911d-2ee1-44a6-ab54-78af7fda4782 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Acquiring lock "cinder-quobyte-438b5939-0d5a-4867-8796-a4ffcfbaaf86" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:04 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-da1b911d-2ee1-44a6-ab54-78af7fda4782 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Lock "cinder-quobyte-438b5939-0d5a-4867-8796-a4ffcfbaaf86" acquired by "delete_volume" :: waited 0.016s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:04 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[58fb960e-fdbf-4f9a-b035-de52cbd80f0a]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-da1b911d-2ee1-44a6-ab54-78af7fda4782 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-438b5939-0d5a-4867-8796-a4ffcfbaaf86 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:04 devstack sudo[105210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-438b5939-0d5a-4867-8796-a4ffcfbaaf86 Sep 23 00:32:04 devstack sudo[105210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:04 devstack sudo[105208]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9c4616d5-9a00-4886-a0d6-5ff6e5963e86 tempest-CreateVolumesFromSnapshotTest-1109491162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.422s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:04 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-9c4616d5-9a00-4886-a0d6-5ff6e5963e86 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:04 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-9c4616d5-9a00-4886-a0d6-5ff6e5963e86 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Deleted volume successfully. Sep 23 00:32:04 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9c4616d5-9a00-4886-a0d6-5ff6e5963e86 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Lock "cinder-085ddcf0-4857-4831-b679-bfe5d092fa68-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:05 devstack sudo[105210]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-da1b911d-2ee1-44a6-ab54-78af7fda4782 tempest-CreateVolumesFromSnapshotTest-1109491162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-438b5939-0d5a-4867-8796-a4ffcfbaaf86" returned: 0 in 0.489s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-da1b911d-2ee1-44a6-ab54-78af7fda4782 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-438b5939-0d5a-4867-8796-a4ffcfbaaf86 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:05 devstack sudo[105217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-438b5939-0d5a-4867-8796-a4ffcfbaaf86 Sep 23 00:32:05 devstack sudo[105217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:05 devstack sudo[105217]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-da1b911d-2ee1-44a6-ab54-78af7fda4782 tempest-CreateVolumesFromSnapshotTest-1109491162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-438b5939-0d5a-4867-8796-a4ffcfbaaf86" returned: 0 in 0.350s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:05 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-da1b911d-2ee1-44a6-ab54-78af7fda4782 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Lock "cinder-quobyte-438b5939-0d5a-4867-8796-a4ffcfbaaf86" released by "delete_volume" :: held 0.897s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:05 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-da1b911d-2ee1-44a6-ab54-78af7fda4782 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Created reservations ['877cf5d5-92ad-4510-a7f7-bd1d3870fa60', '30d5e1f8-60e1-42a9-b88f-c544da92165d', '648f5784-4d62-479a-941e-594bdfe2231d', 'cd06b3d1-d0f3-466c-b19f-39255c190b5d'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-da1b911d-2ee1-44a6-ab54-78af7fda4782 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-da1b911d-2ee1-44a6-ab54-78af7fda4782 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:05 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-da1b911d-2ee1-44a6-ab54-78af7fda4782 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:05 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-da1b911d-2ee1-44a6-ab54-78af7fda4782 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-da1b911d-2ee1-44a6-ab54-78af7fda4782 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-da1b911d-2ee1-44a6-ab54-78af7fda4782 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:05 devstack sudo[105220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:32:05 devstack sudo[105220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:06 devstack sudo[105220]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-da1b911d-2ee1-44a6-ab54-78af7fda4782 tempest-CreateVolumesFromSnapshotTest-1109491162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.285s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:06 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-da1b911d-2ee1-44a6-ab54-78af7fda4782 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:06 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-da1b911d-2ee1-44a6-ab54-78af7fda4782 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Deleted volume successfully. Sep 23 00:32:06 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-da1b911d-2ee1-44a6-ab54-78af7fda4782 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Lock "cinder-438b5939-0d5a-4867-8796-a4ffcfbaaf86-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:06 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4c77ea98-16ba-4b3b-a882-4a3085330fb9 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Acquiring lock "cinder-901c7dfa-f803-43c9-b643-149a260631cc-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:06 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4c77ea98-16ba-4b3b-a882-4a3085330fb9 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Lock "cinder-901c7dfa-f803-43c9-b643-149a260631cc-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:06 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4c77ea98-16ba-4b3b-a882-4a3085330fb9 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Acquiring lock "cinder-quobyte-901c7dfa-f803-43c9-b643-149a260631cc" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:06 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4c77ea98-16ba-4b3b-a882-4a3085330fb9 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Lock "cinder-quobyte-901c7dfa-f803-43c9-b643-149a260631cc" acquired by "delete_volume" :: waited 0.028s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:07 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[590cbbe7-8d0f-4a0d-ba53-9b09244cf300]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4c77ea98-16ba-4b3b-a882-4a3085330fb9 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-901c7dfa-f803-43c9-b643-149a260631cc {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:07 devstack sudo[105223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-901c7dfa-f803-43c9-b643-149a260631cc Sep 23 00:32:07 devstack sudo[105223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:07 devstack sudo[105223]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4c77ea98-16ba-4b3b-a882-4a3085330fb9 tempest-CreateVolumesFromSnapshotTest-1109491162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-901c7dfa-f803-43c9-b643-149a260631cc" returned: 0 in 0.520s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4c77ea98-16ba-4b3b-a882-4a3085330fb9 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-901c7dfa-f803-43c9-b643-149a260631cc {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:07 devstack sudo[105229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-901c7dfa-f803-43c9-b643-149a260631cc Sep 23 00:32:07 devstack sudo[105229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:07 devstack sudo[105229]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4c77ea98-16ba-4b3b-a882-4a3085330fb9 tempest-CreateVolumesFromSnapshotTest-1109491162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-901c7dfa-f803-43c9-b643-149a260631cc" returned: 0 in 0.287s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:07 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4c77ea98-16ba-4b3b-a882-4a3085330fb9 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Lock "cinder-quobyte-901c7dfa-f803-43c9-b643-149a260631cc" released by "delete_volume" :: held 0.884s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:07 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-4c77ea98-16ba-4b3b-a882-4a3085330fb9 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Created reservations ['fa691840-209e-420c-afe3-f7675816991c', 'e57be52f-0f77-4451-b0a0-e9758fee3256', 'e80e6f93-fd25-4fe5-8a24-c5b4b8adf87f', '6dcbe7b9-f298-46c6-8d2b-46e7bc4dc99b'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4c77ea98-16ba-4b3b-a882-4a3085330fb9 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4c77ea98-16ba-4b3b-a882-4a3085330fb9 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:08 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4c77ea98-16ba-4b3b-a882-4a3085330fb9 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:08 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4c77ea98-16ba-4b3b-a882-4a3085330fb9 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4c77ea98-16ba-4b3b-a882-4a3085330fb9 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4c77ea98-16ba-4b3b-a882-4a3085330fb9 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:08 devstack sudo[105232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:32:08 devstack sudo[105232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:08 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ec6d83b6-7dd8-4fe0-8e35-7d92f2add2b1 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Acquiring lock "cinder-7199f9b8-00a1-4ee5-9c3d-c67cafb088b6-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:08 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ec6d83b6-7dd8-4fe0-8e35-7d92f2add2b1 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Lock "cinder-7199f9b8-00a1-4ee5-9c3d-c67cafb088b6-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:08 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ec6d83b6-7dd8-4fe0-8e35-7d92f2add2b1 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Acquiring lock "cinder-quobyte-7199f9b8-00a1-4ee5-9c3d-c67cafb088b6" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:08 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ec6d83b6-7dd8-4fe0-8e35-7d92f2add2b1 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Lock "cinder-quobyte-7199f9b8-00a1-4ee5-9c3d-c67cafb088b6" acquired by "delete_volume" :: waited 0.026s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:08 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a027f23-ecf8-4aad-80fa-ea67961196cb]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ec6d83b6-7dd8-4fe0-8e35-7d92f2add2b1 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7199f9b8-00a1-4ee5-9c3d-c67cafb088b6 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:08 devstack sudo[105234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7199f9b8-00a1-4ee5-9c3d-c67cafb088b6 Sep 23 00:32:08 devstack sudo[105234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:08 devstack sudo[105232]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4c77ea98-16ba-4b3b-a882-4a3085330fb9 tempest-CreateVolumesFromSnapshotTest-1109491162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.449s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:08 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-4c77ea98-16ba-4b3b-a882-4a3085330fb9 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:08 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-4c77ea98-16ba-4b3b-a882-4a3085330fb9 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Deleted volume successfully. Sep 23 00:32:08 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4c77ea98-16ba-4b3b-a882-4a3085330fb9 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Lock "cinder-901c7dfa-f803-43c9-b643-149a260631cc-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:08 devstack sudo[105234]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ec6d83b6-7dd8-4fe0-8e35-7d92f2add2b1 tempest-CreateVolumesFromSnapshotTest-1109491162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7199f9b8-00a1-4ee5-9c3d-c67cafb088b6" returned: 0 in 0.546s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ec6d83b6-7dd8-4fe0-8e35-7d92f2add2b1 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7199f9b8-00a1-4ee5-9c3d-c67cafb088b6 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:08 devstack sudo[105241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7199f9b8-00a1-4ee5-9c3d-c67cafb088b6 Sep 23 00:32:08 devstack sudo[105241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:09 devstack sudo[105241]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ec6d83b6-7dd8-4fe0-8e35-7d92f2add2b1 tempest-CreateVolumesFromSnapshotTest-1109491162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-7199f9b8-00a1-4ee5-9c3d-c67cafb088b6" returned: 0 in 0.310s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:09 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ec6d83b6-7dd8-4fe0-8e35-7d92f2add2b1 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Lock "cinder-quobyte-7199f9b8-00a1-4ee5-9c3d-c67cafb088b6" released by "delete_volume" :: held 0.935s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:09 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-ec6d83b6-7dd8-4fe0-8e35-7d92f2add2b1 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Created reservations ['ca2c31d2-d6aa-42c6-8ea5-88ae0c6eddb3', '4dc65cba-4b43-4260-b006-dd2caf6d770f', '85594c79-69e5-41a4-bac8-ba1a33c8135c', 'fafaaf13-b1fd-4ea8-a557-70e64da23b84'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ec6d83b6-7dd8-4fe0-8e35-7d92f2add2b1 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ec6d83b6-7dd8-4fe0-8e35-7d92f2add2b1 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:09 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ec6d83b6-7dd8-4fe0-8e35-7d92f2add2b1 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:09 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-ec6d83b6-7dd8-4fe0-8e35-7d92f2add2b1 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ec6d83b6-7dd8-4fe0-8e35-7d92f2add2b1 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ec6d83b6-7dd8-4fe0-8e35-7d92f2add2b1 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:09 devstack sudo[105244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:32:09 devstack sudo[105244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:09 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-b634e041-0cbc-4744-a619-c19d1912aaa0 tempest-CinderUnicodeTest-1245637133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:32:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b634e041-0cbc-4744-a619-c19d1912aaa0 tempest-CinderUnicodeTest-1245637133 None] Flow 'volume_create_manager' (33d044d7-a05b-4946-8762-f74d42c93afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b634e041-0cbc-4744-a619-c19d1912aaa0 tempest-CinderUnicodeTest-1245637133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28cbc1a5-2974-4103-a166-230a04d2364c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b634e041-0cbc-4744-a619-c19d1912aaa0 tempest-CinderUnicodeTest-1245637133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28cbc1a5-2974-4103-a166-230a04d2364c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=135410a7-8b55-4e37-9f67-f3cfcfae2e94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd9d7e16b4124a2d9202a619f3bf9847',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:09Z,use_quota=True,user_id='e1157222eb634663bce6497b0a901ab1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b634e041-0cbc-4744-a619-c19d1912aaa0 tempest-CinderUnicodeTest-1245637133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23cf39c4-da0b-43a2-9fd5-d39ffb98c673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b634e041-0cbc-4744-a619-c19d1912aaa0 tempest-CinderUnicodeTest-1245637133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23cf39c4-da0b-43a2-9fd5-d39ffb98c673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b634e041-0cbc-4744-a619-c19d1912aaa0 tempest-CinderUnicodeTest-1245637133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eab0497-bd38-4550-8d5b-13857d1c8b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b634e041-0cbc-4744-a619-c19d1912aaa0 tempest-CinderUnicodeTest-1245637133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eab0497-bd38-4550-8d5b-13857d1c8b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '135410a7-8b55-4e37-9f67-f3cfcfae2e94', 'volume_name': 'volume-135410a7-8b55-4e37-9f67-f3cfcfae2e94', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b634e041-0cbc-4744-a619-c19d1912aaa0 tempest-CinderUnicodeTest-1245637133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79be0425-06e2-4cd2-9e51-b105f23a1d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b634e041-0cbc-4744-a619-c19d1912aaa0 tempest-CinderUnicodeTest-1245637133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79be0425-06e2-4cd2-9e51-b105f23a1d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b634e041-0cbc-4744-a619-c19d1912aaa0 tempest-CinderUnicodeTest-1245637133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc17d6fd-a15d-4f3a-ac60-32f7a5669f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:09 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-b634e041-0cbc-4744-a619-c19d1912aaa0 tempest-CinderUnicodeTest-1245637133 None] Volume 135410a7-8b55-4e37-9f67-f3cfcfae2e94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-135410a7-8b55-4e37-9f67-f3cfcfae2e94', 'volume_size': 1} Sep 23 00:32:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b634e041-0cbc-4744-a619-c19d1912aaa0 tempest-CinderUnicodeTest-1245637133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b634e041-0cbc-4744-a619-c19d1912aaa0 tempest-CinderUnicodeTest-1245637133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:09 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b634e041-0cbc-4744-a619-c19d1912aaa0 tempest-CinderUnicodeTest-1245637133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=135410a7-8b55-4e37-9f67-f3cfcfae2e94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd9d7e16b4124a2d9202a619f3bf9847',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:09Z,use_quota=True,user_id='e1157222eb634663bce6497b0a901ab1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:32:09 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-b634e041-0cbc-4744-a619-c19d1912aaa0 tempest-CinderUnicodeTest-1245637133 None] Creating volume 135410a7-8b55-4e37-9f67-f3cfcfae2e94 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:32:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b634e041-0cbc-4744-a619-c19d1912aaa0 tempest-CinderUnicodeTest-1245637133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b634e041-0cbc-4744-a619-c19d1912aaa0 tempest-CinderUnicodeTest-1245637133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:09 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b634e041-0cbc-4744-a619-c19d1912aaa0 tempest-CinderUnicodeTest-1245637133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:09 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b634e041-0cbc-4744-a619-c19d1912aaa0 tempest-CinderUnicodeTest-1245637133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b634e041-0cbc-4744-a619-c19d1912aaa0 tempest-CinderUnicodeTest-1245637133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:09 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b634e041-0cbc-4744-a619-c19d1912aaa0 tempest-CinderUnicodeTest-1245637133 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:32:09 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-b634e041-0cbc-4744-a619-c19d1912aaa0 tempest-CinderUnicodeTest-1245637133 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:32:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b634e041-0cbc-4744-a619-c19d1912aaa0 tempest-CinderUnicodeTest-1245637133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-135410a7-8b55-4e37-9f67-f3cfcfae2e94 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:09 devstack sudo[105244]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:09 devstack sudo[105247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-135410a7-8b55-4e37-9f67-f3cfcfae2e94 1073741824 Sep 23 00:32:09 devstack sudo[105247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ec6d83b6-7dd8-4fe0-8e35-7d92f2add2b1 tempest-CreateVolumesFromSnapshotTest-1109491162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.336s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:09 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-ec6d83b6-7dd8-4fe0-8e35-7d92f2add2b1 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:09 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-ec6d83b6-7dd8-4fe0-8e35-7d92f2add2b1 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Deleted volume successfully. Sep 23 00:32:09 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-ec6d83b6-7dd8-4fe0-8e35-7d92f2add2b1 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Lock "cinder-7199f9b8-00a1-4ee5-9c3d-c67cafb088b6-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:10 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8a9e679c-77c5-4dff-9fc2-0d4ae556bdad tempest-CreateVolumesFromSnapshotTest-1109491162 None] Acquiring lock "cinder-e6e5163b-c12b-40a9-b5b5-3ab222a6036f-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:10 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8a9e679c-77c5-4dff-9fc2-0d4ae556bdad tempest-CreateVolumesFromSnapshotTest-1109491162 None] Lock "cinder-e6e5163b-c12b-40a9-b5b5-3ab222a6036f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:10 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8a9e679c-77c5-4dff-9fc2-0d4ae556bdad tempest-CreateVolumesFromSnapshotTest-1109491162 None] Acquiring lock "cinder-quobyte-e6e5163b-c12b-40a9-b5b5-3ab222a6036f" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:10 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8a9e679c-77c5-4dff-9fc2-0d4ae556bdad tempest-CreateVolumesFromSnapshotTest-1109491162 None] Lock "cinder-quobyte-e6e5163b-c12b-40a9-b5b5-3ab222a6036f" acquired by "delete_volume" :: waited 0.023s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:10 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[507c60b1-0bee-457c-92c5-54e02a61d007]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8a9e679c-77c5-4dff-9fc2-0d4ae556bdad tempest-CreateVolumesFromSnapshotTest-1109491162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6e5163b-c12b-40a9-b5b5-3ab222a6036f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:10 devstack sudo[105252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6e5163b-c12b-40a9-b5b5-3ab222a6036f Sep 23 00:32:10 devstack sudo[105252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:10 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-1207891d-57bb-4808-bf77-b1fa222a8e14 tempest-VolumeDependencyTests-1974362274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:32:10 devstack sudo[105247]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1207891d-57bb-4808-bf77-b1fa222a8e14 tempest-VolumeDependencyTests-1974362274 None] Flow 'volume_create_manager' (99b1ae43-ee71-4674-86a1-8058cf9a43e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1207891d-57bb-4808-bf77-b1fa222a8e14 tempest-VolumeDependencyTests-1974362274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a008dcf-7930-4b9f-8bd1-5a32bde3aaa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b634e041-0cbc-4744-a619-c19d1912aaa0 tempest-CinderUnicodeTest-1245637133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-135410a7-8b55-4e37-9f67-f3cfcfae2e94 1073741824" returned: 0 in 0.695s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1207891d-57bb-4808-bf77-b1fa222a8e14 tempest-VolumeDependencyTests-1974362274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a008dcf-7930-4b9f-8bd1-5a32bde3aaa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-324332772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cff6b113-8f61-4e71-bb0d-b05b298a6486,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='798a7a7af80f4a75ab52bdc958eb10c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:10Z,use_quota=True,user_id='70792315b47d42dfaafd9fd5d8379d08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1207891d-57bb-4808-bf77-b1fa222a8e14 tempest-VolumeDependencyTests-1974362274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8855b23e-b570-4927-a767-882f79a6ef59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1207891d-57bb-4808-bf77-b1fa222a8e14 tempest-VolumeDependencyTests-1974362274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8855b23e-b570-4927-a767-882f79a6ef59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1207891d-57bb-4808-bf77-b1fa222a8e14 tempest-VolumeDependencyTests-1974362274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df9cab06-38e4-41f1-9a6e-50e41243fa30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1207891d-57bb-4808-bf77-b1fa222a8e14 tempest-VolumeDependencyTests-1974362274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df9cab06-38e4-41f1-9a6e-50e41243fa30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cff6b113-8f61-4e71-bb0d-b05b298a6486', 'volume_name': 'volume-cff6b113-8f61-4e71-bb0d-b05b298a6486', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1207891d-57bb-4808-bf77-b1fa222a8e14 tempest-VolumeDependencyTests-1974362274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f864c47-4f5a-4cd2-9c1c-ae9019b1dc19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1207891d-57bb-4808-bf77-b1fa222a8e14 tempest-VolumeDependencyTests-1974362274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f864c47-4f5a-4cd2-9c1c-ae9019b1dc19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1207891d-57bb-4808-bf77-b1fa222a8e14 tempest-VolumeDependencyTests-1974362274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68e4ac4c-2a64-49e7-adab-660f9ac49898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:10 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-1207891d-57bb-4808-bf77-b1fa222a8e14 tempest-VolumeDependencyTests-1974362274 None] Volume cff6b113-8f61-4e71-bb0d-b05b298a6486: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cff6b113-8f61-4e71-bb0d-b05b298a6486', 'volume_size': 1} Sep 23 00:32:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1207891d-57bb-4808-bf77-b1fa222a8e14 tempest-VolumeDependencyTests-1974362274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b634e041-0cbc-4744-a619-c19d1912aaa0 tempest-CinderUnicodeTest-1245637133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-135410a7-8b55-4e37-9f67-f3cfcfae2e94 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:10 devstack sudo[105257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-135410a7-8b55-4e37-9f67-f3cfcfae2e94 Sep 23 00:32:10 devstack sudo[105257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:10 devstack sudo[105252]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8a9e679c-77c5-4dff-9fc2-0d4ae556bdad tempest-CreateVolumesFromSnapshotTest-1109491162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6e5163b-c12b-40a9-b5b5-3ab222a6036f" returned: 0 in 0.445s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8a9e679c-77c5-4dff-9fc2-0d4ae556bdad tempest-CreateVolumesFromSnapshotTest-1109491162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6e5163b-c12b-40a9-b5b5-3ab222a6036f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:10 devstack sudo[105260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6e5163b-c12b-40a9-b5b5-3ab222a6036f Sep 23 00:32:10 devstack sudo[105260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:10 devstack sudo[105257]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b634e041-0cbc-4744-a619-c19d1912aaa0 tempest-CinderUnicodeTest-1245637133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-135410a7-8b55-4e37-9f67-f3cfcfae2e94" returned: 0 in 0.297s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:10 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b634e041-0cbc-4744-a619-c19d1912aaa0 tempest-CinderUnicodeTest-1245637133 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:32:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b634e041-0cbc-4744-a619-c19d1912aaa0 tempest-CinderUnicodeTest-1245637133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1207891d-57bb-4808-bf77-b1fa222a8e14 tempest-VolumeDependencyTests-1974362274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.338s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:10 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1207891d-57bb-4808-bf77-b1fa222a8e14 tempest-VolumeDependencyTests-1974362274 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-324332772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cff6b113-8f61-4e71-bb0d-b05b298a6486,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='798a7a7af80f4a75ab52bdc958eb10c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:10Z,use_quota=True,user_id='70792315b47d42dfaafd9fd5d8379d08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:32:10 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-1207891d-57bb-4808-bf77-b1fa222a8e14 tempest-VolumeDependencyTests-1974362274 None] Creating volume cff6b113-8f61-4e71-bb0d-b05b298a6486 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:32:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1207891d-57bb-4808-bf77-b1fa222a8e14 tempest-VolumeDependencyTests-1974362274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1207891d-57bb-4808-bf77-b1fa222a8e14 tempest-VolumeDependencyTests-1974362274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:10 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1207891d-57bb-4808-bf77-b1fa222a8e14 tempest-VolumeDependencyTests-1974362274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:10 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1207891d-57bb-4808-bf77-b1fa222a8e14 tempest-VolumeDependencyTests-1974362274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1207891d-57bb-4808-bf77-b1fa222a8e14 tempest-VolumeDependencyTests-1974362274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:10 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1207891d-57bb-4808-bf77-b1fa222a8e14 tempest-VolumeDependencyTests-1974362274 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:32:10 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-1207891d-57bb-4808-bf77-b1fa222a8e14 tempest-VolumeDependencyTests-1974362274 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:32:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1207891d-57bb-4808-bf77-b1fa222a8e14 tempest-VolumeDependencyTests-1974362274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cff6b113-8f61-4e71-bb0d-b05b298a6486 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b634e041-0cbc-4744-a619-c19d1912aaa0 tempest-CinderUnicodeTest-1245637133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc17d6fd-a15d-4f3a-ac60-32f7a5669f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-135410a7-8b55-4e37-9f67-f3cfcfae2e94', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b634e041-0cbc-4744-a619-c19d1912aaa0 tempest-CinderUnicodeTest-1245637133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d038ad01-0946-47ad-8bc9-5775c96bafc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:10 devstack sudo[105264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cff6b113-8f61-4e71-bb0d-b05b298a6486 1073741824 Sep 23 00:32:10 devstack sudo[105264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:10 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-b634e041-0cbc-4744-a619-c19d1912aaa0 tempest-CinderUnicodeTest-1245637133 None] Volume volume-135410a7-8b55-4e37-9f67-f3cfcfae2e94 (135410a7-8b55-4e37-9f67-f3cfcfae2e94): created successfully Sep 23 00:32:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b634e041-0cbc-4744-a619-c19d1912aaa0 tempest-CinderUnicodeTest-1245637133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d038ad01-0946-47ad-8bc9-5775c96bafc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:10 devstack sudo[105260]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b634e041-0cbc-4744-a619-c19d1912aaa0 tempest-CinderUnicodeTest-1245637133 None] Flow 'volume_create_manager' (33d044d7-a05b-4946-8762-f74d42c93afa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8a9e679c-77c5-4dff-9fc2-0d4ae556bdad tempest-CreateVolumesFromSnapshotTest-1109491162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-e6e5163b-c12b-40a9-b5b5-3ab222a6036f" returned: 0 in 0.300s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:10 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8a9e679c-77c5-4dff-9fc2-0d4ae556bdad tempest-CreateVolumesFromSnapshotTest-1109491162 None] Lock "cinder-quobyte-e6e5163b-c12b-40a9-b5b5-3ab222a6036f" released by "delete_volume" :: held 0.804s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:10 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-b634e041-0cbc-4744-a619-c19d1912aaa0 tempest-CinderUnicodeTest-1245637133 None] Created volume successfully. Sep 23 00:32:10 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-8a9e679c-77c5-4dff-9fc2-0d4ae556bdad tempest-CreateVolumesFromSnapshotTest-1109491162 None] Created reservations ['97e3839f-43fa-4d35-aecf-176a96052307', '2fcb0be2-5a43-4800-a21d-36b4460389bf', 'a3e521a2-280d-4e99-8f96-77863502e424', '976f791c-8da2-45d1-bc86-a6b540dc29f8'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8a9e679c-77c5-4dff-9fc2-0d4ae556bdad tempest-CreateVolumesFromSnapshotTest-1109491162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8a9e679c-77c5-4dff-9fc2-0d4ae556bdad tempest-CreateVolumesFromSnapshotTest-1109491162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:11 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-8a9e679c-77c5-4dff-9fc2-0d4ae556bdad tempest-CreateVolumesFromSnapshotTest-1109491162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:11 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-8a9e679c-77c5-4dff-9fc2-0d4ae556bdad tempest-CreateVolumesFromSnapshotTest-1109491162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8a9e679c-77c5-4dff-9fc2-0d4ae556bdad tempest-CreateVolumesFromSnapshotTest-1109491162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8a9e679c-77c5-4dff-9fc2-0d4ae556bdad tempest-CreateVolumesFromSnapshotTest-1109491162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:11 devstack sudo[105266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:32:11 devstack sudo[105266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:11 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-35797c8f-3d73-462c-860b-d5602f84635b tempest-CreateVolumesFromSnapshotTest-1109491162 None] Acquiring lock "cinder-33466645-a7c6-4fff-9619-e2ec5c1fe6e5-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:11 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-35797c8f-3d73-462c-860b-d5602f84635b tempest-CreateVolumesFromSnapshotTest-1109491162 None] Lock "cinder-33466645-a7c6-4fff-9619-e2ec5c1fe6e5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:11 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-35797c8f-3d73-462c-860b-d5602f84635b tempest-CreateVolumesFromSnapshotTest-1109491162 None] Acquiring lock "cinder-quobyte-982cf9b5-7c4d-497f-917d-e13b36a38e8e" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:11 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-35797c8f-3d73-462c-860b-d5602f84635b tempest-CreateVolumesFromSnapshotTest-1109491162 None] Lock "cinder-quobyte-982cf9b5-7c4d-497f-917d-e13b36a38e8e" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:11 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-35797c8f-3d73-462c-860b-d5602f84635b tempest-CreateVolumesFromSnapshotTest-1109491162 None] Acquiring lock "cinder-quobyte-33466645-a7c6-4fff-9619-e2ec5c1fe6e5" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:11 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-35797c8f-3d73-462c-860b-d5602f84635b tempest-CreateVolumesFromSnapshotTest-1109491162 None] Lock "cinder-quobyte-33466645-a7c6-4fff-9619-e2ec5c1fe6e5" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:11 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-35797c8f-3d73-462c-860b-d5602f84635b tempest-CreateVolumesFromSnapshotTest-1109491162 None] Deleting offline snapshot 33466645-a7c6-4fff-9619-e2ec5c1fe6e5 of volume 982cf9b5-7c4d-497f-917d-e13b36a38e8e {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:32:11 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-35797c8f-3d73-462c-860b-d5602f84635b tempest-CreateVolumesFromSnapshotTest-1109491162 None] snapshot_file for this snap is: volume-982cf9b5-7c4d-497f-917d-e13b36a38e8e.33466645-a7c6-4fff-9619-e2ec5c1fe6e5 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:32:11 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad051ad5-34ad-4fe4-9836-cf6760e5ce0c]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-35797c8f-3d73-462c-860b-d5602f84635b tempest-CreateVolumesFromSnapshotTest-1109491162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-982cf9b5-7c4d-497f-917d-e13b36a38e8e.33466645-a7c6-4fff-9619-e2ec5c1fe6e5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:11 devstack sudo[105266]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8a9e679c-77c5-4dff-9fc2-0d4ae556bdad tempest-CreateVolumesFromSnapshotTest-1109491162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.421s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:11 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-8a9e679c-77c5-4dff-9fc2-0d4ae556bdad tempest-CreateVolumesFromSnapshotTest-1109491162 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:11 devstack sudo[105264]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:11 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-8a9e679c-77c5-4dff-9fc2-0d4ae556bdad tempest-CreateVolumesFromSnapshotTest-1109491162 None] Deleted volume successfully. Sep 23 00:32:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1207891d-57bb-4808-bf77-b1fa222a8e14 tempest-VolumeDependencyTests-1974362274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cff6b113-8f61-4e71-bb0d-b05b298a6486 1073741824" returned: 0 in 0.687s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:11 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-8a9e679c-77c5-4dff-9fc2-0d4ae556bdad tempest-CreateVolumesFromSnapshotTest-1109491162 None] Lock "cinder-e6e5163b-c12b-40a9-b5b5-3ab222a6036f-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1207891d-57bb-4808-bf77-b1fa222a8e14 tempest-VolumeDependencyTests-1974362274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cff6b113-8f61-4e71-bb0d-b05b298a6486 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:11 devstack sudo[105280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cff6b113-8f61-4e71-bb0d-b05b298a6486 Sep 23 00:32:11 devstack sudo[105280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:11 devstack sudo[105279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-982cf9b5-7c4d-497f-917d-e13b36a38e8e.33466645-a7c6-4fff-9619-e2ec5c1fe6e5 Sep 23 00:32:11 devstack sudo[105279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:11 devstack sudo[105280]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1207891d-57bb-4808-bf77-b1fa222a8e14 tempest-VolumeDependencyTests-1974362274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cff6b113-8f61-4e71-bb0d-b05b298a6486" returned: 0 in 0.288s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:11 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1207891d-57bb-4808-bf77-b1fa222a8e14 tempest-VolumeDependencyTests-1974362274 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:32:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1207891d-57bb-4808-bf77-b1fa222a8e14 tempest-VolumeDependencyTests-1974362274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:11 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1207891d-57bb-4808-bf77-b1fa222a8e14 tempest-VolumeDependencyTests-1974362274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68e4ac4c-2a64-49e7-adab-660f9ac49898) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cff6b113-8f61-4e71-bb0d-b05b298a6486', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:11 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1207891d-57bb-4808-bf77-b1fa222a8e14 tempest-VolumeDependencyTests-1974362274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbb99340-f929-4211-a867-8bc3073e63db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:11 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-1207891d-57bb-4808-bf77-b1fa222a8e14 tempest-VolumeDependencyTests-1974362274 None] Volume volume-cff6b113-8f61-4e71-bb0d-b05b298a6486 (cff6b113-8f61-4e71-bb0d-b05b298a6486): created successfully Sep 23 00:32:11 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1207891d-57bb-4808-bf77-b1fa222a8e14 tempest-VolumeDependencyTests-1974362274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbb99340-f929-4211-a867-8bc3073e63db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:11 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1207891d-57bb-4808-bf77-b1fa222a8e14 tempest-VolumeDependencyTests-1974362274 None] Flow 'volume_create_manager' (99b1ae43-ee71-4674-86a1-8058cf9a43e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:11 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-1207891d-57bb-4808-bf77-b1fa222a8e14 tempest-VolumeDependencyTests-1974362274 None] Created volume successfully. Sep 23 00:32:11 devstack sudo[105279]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-35797c8f-3d73-462c-860b-d5602f84635b tempest-CreateVolumesFromSnapshotTest-1109491162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-982cf9b5-7c4d-497f-917d-e13b36a38e8e.33466645-a7c6-4fff-9619-e2ec5c1fe6e5" returned: 0 in 0.535s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:11 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-35797c8f-3d73-462c-860b-d5602f84635b tempest-CreateVolumesFromSnapshotTest-1109491162 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-982cf9b5-7c4d-497f-917d-e13b36a38e8e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:32:12 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a373fe2-91f7-4b07-83db-3d0b31fbc296]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-35797c8f-3d73-462c-860b-d5602f84635b tempest-CreateVolumesFromSnapshotTest-1109491162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-982cf9b5-7c4d-497f-917d-e13b36a38e8e {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:12 devstack sudo[105288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-982cf9b5-7c4d-497f-917d-e13b36a38e8e Sep 23 00:32:12 devstack sudo[105288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:12 devstack sudo[105288]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-35797c8f-3d73-462c-860b-d5602f84635b tempest-CreateVolumesFromSnapshotTest-1109491162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-982cf9b5-7c4d-497f-917d-e13b36a38e8e" returned: 0 in 0.527s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-35797c8f-3d73-462c-860b-d5602f84635b tempest-CreateVolumesFromSnapshotTest-1109491162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-982cf9b5-7c4d-497f-917d-e13b36a38e8e.33466645-a7c6-4fff-9619-e2ec5c1fe6e5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:12 devstack sudo[105294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-982cf9b5-7c4d-497f-917d-e13b36a38e8e.33466645-a7c6-4fff-9619-e2ec5c1fe6e5 Sep 23 00:32:12 devstack sudo[105294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:12 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bad0f28-b4dc-4057-b192-2f876398e3f9 tempest-CinderUnicodeTest-1245637133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:32:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1bad0f28-b4dc-4057-b192-2f876398e3f9 tempest-CinderUnicodeTest-1245637133 None] Flow 'volume_create_manager' (c18e0a02-beb4-4b27-be8b-d8026b72baa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1bad0f28-b4dc-4057-b192-2f876398e3f9 tempest-CinderUnicodeTest-1245637133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb47d951-0365-4864-99e7-72bf433a8bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1bad0f28-b4dc-4057-b192-2f876398e3f9 tempest-CinderUnicodeTest-1245637133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb47d951-0365-4864-99e7-72bf433a8bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:12Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-201994257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbdd0d42-072a-4804-a46a-619e3740720d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd9d7e16b4124a2d9202a619f3bf9847',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:13Z,use_quota=True,user_id='e1157222eb634663bce6497b0a901ab1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1bad0f28-b4dc-4057-b192-2f876398e3f9 tempest-CinderUnicodeTest-1245637133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89a80ebe-6737-462a-bb6a-242c77d23d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1bad0f28-b4dc-4057-b192-2f876398e3f9 tempest-CinderUnicodeTest-1245637133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89a80ebe-6737-462a-bb6a-242c77d23d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1bad0f28-b4dc-4057-b192-2f876398e3f9 tempest-CinderUnicodeTest-1245637133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (805e641a-11b5-4db3-bd6c-2dc8c39560d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1bad0f28-b4dc-4057-b192-2f876398e3f9 tempest-CinderUnicodeTest-1245637133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (805e641a-11b5-4db3-bd6c-2dc8c39560d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbdd0d42-072a-4804-a46a-619e3740720d', 'volume_name': 'volume-dbdd0d42-072a-4804-a46a-619e3740720d', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1bad0f28-b4dc-4057-b192-2f876398e3f9 tempest-CinderUnicodeTest-1245637133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5b69885-5f5f-45f6-8174-781068acee2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1bad0f28-b4dc-4057-b192-2f876398e3f9 tempest-CinderUnicodeTest-1245637133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5b69885-5f5f-45f6-8174-781068acee2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:12 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1bad0f28-b4dc-4057-b192-2f876398e3f9 tempest-CinderUnicodeTest-1245637133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a087d6a-ec6a-4a9a-941f-38273e2c323b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:12 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-1bad0f28-b4dc-4057-b192-2f876398e3f9 tempest-CinderUnicodeTest-1245637133 None] Volume dbdd0d42-072a-4804-a46a-619e3740720d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbdd0d42-072a-4804-a46a-619e3740720d', 'volume_size': 1} Sep 23 00:32:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1bad0f28-b4dc-4057-b192-2f876398e3f9 tempest-CinderUnicodeTest-1245637133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1bad0f28-b4dc-4057-b192-2f876398e3f9 tempest-CinderUnicodeTest-1245637133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:12 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1bad0f28-b4dc-4057-b192-2f876398e3f9 tempest-CinderUnicodeTest-1245637133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:12Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-201994257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbdd0d42-072a-4804-a46a-619e3740720d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd9d7e16b4124a2d9202a619f3bf9847',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:13Z,use_quota=True,user_id='e1157222eb634663bce6497b0a901ab1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:32:12 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-1bad0f28-b4dc-4057-b192-2f876398e3f9 tempest-CinderUnicodeTest-1245637133 None] Creating volume dbdd0d42-072a-4804-a46a-619e3740720d {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:32:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1bad0f28-b4dc-4057-b192-2f876398e3f9 tempest-CinderUnicodeTest-1245637133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1bad0f28-b4dc-4057-b192-2f876398e3f9 tempest-CinderUnicodeTest-1245637133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:12 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1bad0f28-b4dc-4057-b192-2f876398e3f9 tempest-CinderUnicodeTest-1245637133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:12 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1bad0f28-b4dc-4057-b192-2f876398e3f9 tempest-CinderUnicodeTest-1245637133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1bad0f28-b4dc-4057-b192-2f876398e3f9 tempest-CinderUnicodeTest-1245637133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:12 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1bad0f28-b4dc-4057-b192-2f876398e3f9 tempest-CinderUnicodeTest-1245637133 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:32:12 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-1bad0f28-b4dc-4057-b192-2f876398e3f9 tempest-CinderUnicodeTest-1245637133 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:32:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1bad0f28-b4dc-4057-b192-2f876398e3f9 tempest-CinderUnicodeTest-1245637133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-dbdd0d42-072a-4804-a46a-619e3740720d 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:12 devstack sudo[105296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-dbdd0d42-072a-4804-a46a-619e3740720d 1073741824 Sep 23 00:32:12 devstack sudo[105296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6e906d13-dc75-4c46-824c-9c1fd0054179 tempest-VolumeDependencyTests-1974362274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:13 devstack sudo[105294]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-35797c8f-3d73-462c-860b-d5602f84635b tempest-CreateVolumesFromSnapshotTest-1109491162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-982cf9b5-7c4d-497f-917d-e13b36a38e8e.33466645-a7c6-4fff-9619-e2ec5c1fe6e5" returned: 0 in 0.595s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-35797c8f-3d73-462c-860b-d5602f84635b tempest-CreateVolumesFromSnapshotTest-1109491162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-982cf9b5-7c4d-497f-917d-e13b36a38e8e.33466645-a7c6-4fff-9619-e2ec5c1fe6e5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:13 devstack sudo[105304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-982cf9b5-7c4d-497f-917d-e13b36a38e8e.33466645-a7c6-4fff-9619-e2ec5c1fe6e5 Sep 23 00:32:13 devstack sudo[105304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:13 devstack sudo[105296]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1bad0f28-b4dc-4057-b192-2f876398e3f9 tempest-CinderUnicodeTest-1245637133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-dbdd0d42-072a-4804-a46a-619e3740720d 1073741824" returned: 0 in 0.584s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:13 devstack sudo[105304]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-35797c8f-3d73-462c-860b-d5602f84635b tempest-CreateVolumesFromSnapshotTest-1109491162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-982cf9b5-7c4d-497f-917d-e13b36a38e8e.33466645-a7c6-4fff-9619-e2ec5c1fe6e5" returned: 0 in 0.293s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1bad0f28-b4dc-4057-b192-2f876398e3f9 tempest-CinderUnicodeTest-1245637133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-dbdd0d42-072a-4804-a46a-619e3740720d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:13 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-35797c8f-3d73-462c-860b-d5602f84635b tempest-CreateVolumesFromSnapshotTest-1109491162 None] Lock "cinder-quobyte-33466645-a7c6-4fff-9619-e2ec5c1fe6e5" released by "_delete_snapshot" :: held 2.124s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:13 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-35797c8f-3d73-462c-860b-d5602f84635b tempest-CreateVolumesFromSnapshotTest-1109491162 None] Lock "cinder-quobyte-982cf9b5-7c4d-497f-917d-e13b36a38e8e" released by "delete_snapshot" :: held 2.159s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:13 devstack sudo[105308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-dbdd0d42-072a-4804-a46a-619e3740720d Sep 23 00:32:13 devstack sudo[105308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:13 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-35797c8f-3d73-462c-860b-d5602f84635b tempest-CreateVolumesFromSnapshotTest-1109491162 None] Created reservations ['a93fde32-f924-46ae-b193-4c1155bd92bd', '768cd723-a93c-4072-b9d1-dc28834bb12d', 'c957006c-1492-4a6c-a363-e5cd13006c02', '528aba52-1b5f-4725-9a06-f9f7a470dd7f'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:13 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-35797c8f-3d73-462c-860b-d5602f84635b tempest-CreateVolumesFromSnapshotTest-1109491162 None] Delete snapshot completed successfully. Sep 23 00:32:13 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-35797c8f-3d73-462c-860b-d5602f84635b tempest-CreateVolumesFromSnapshotTest-1109491162 None] Lock "cinder-33466645-a7c6-4fff-9619-e2ec5c1fe6e5-delete_snapshot" released by "delete_snapshot" :: held 2.381s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:13 devstack sudo[105308]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1bad0f28-b4dc-4057-b192-2f876398e3f9 tempest-CinderUnicodeTest-1245637133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-dbdd0d42-072a-4804-a46a-619e3740720d" returned: 0 in 0.294s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:13 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1bad0f28-b4dc-4057-b192-2f876398e3f9 tempest-CinderUnicodeTest-1245637133 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:32:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1bad0f28-b4dc-4057-b192-2f876398e3f9 tempest-CinderUnicodeTest-1245637133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6e906d13-dc75-4c46-824c-9c1fd0054179 tempest-VolumeDependencyTests-1974362274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.921s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:13 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1bad0f28-b4dc-4057-b192-2f876398e3f9 tempest-CinderUnicodeTest-1245637133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a087d6a-ec6a-4a9a-941f-38273e2c323b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbdd0d42-072a-4804-a46a-619e3740720d', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:13 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1bad0f28-b4dc-4057-b192-2f876398e3f9 tempest-CinderUnicodeTest-1245637133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac051089-b672-4687-bf7b-3aa5d302f487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:13 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-6e906d13-dc75-4c46-824c-9c1fd0054179 tempest-VolumeDependencyTests-1974362274 None] Creating offline snapshot 12724b0b-a3b7-43aa-8bce-728790bd2853 of volume cff6b113-8f61-4e71-bb0d-b05b298a6486 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:32:13 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-1bad0f28-b4dc-4057-b192-2f876398e3f9 tempest-CinderUnicodeTest-1245637133 None] Volume volume-dbdd0d42-072a-4804-a46a-619e3740720d (dbdd0d42-072a-4804-a46a-619e3740720d): created successfully Sep 23 00:32:13 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1bad0f28-b4dc-4057-b192-2f876398e3f9 tempest-CinderUnicodeTest-1245637133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac051089-b672-4687-bf7b-3aa5d302f487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:13 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-1bad0f28-b4dc-4057-b192-2f876398e3f9 tempest-CinderUnicodeTest-1245637133 None] Flow 'volume_create_manager' (c18e0a02-beb4-4b27-be8b-d8026b72baa2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:13 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[06578672-79b9-447a-b8ee-a04ba6811549]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6e906d13-dc75-4c46-824c-9c1fd0054179 tempest-VolumeDependencyTests-1974362274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cff6b113-8f61-4e71-bb0d-b05b298a6486 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:13 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-1bad0f28-b4dc-4057-b192-2f876398e3f9 tempest-CinderUnicodeTest-1245637133 None] Created volume successfully. Sep 23 00:32:13 devstack sudo[105311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cff6b113-8f61-4e71-bb0d-b05b298a6486 Sep 23 00:32:13 devstack sudo[105311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:14 devstack sudo[105311]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6e906d13-dc75-4c46-824c-9c1fd0054179 tempest-VolumeDependencyTests-1974362274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cff6b113-8f61-4e71-bb0d-b05b298a6486" returned: 0 in 0.415s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6e906d13-dc75-4c46-824c-9c1fd0054179 tempest-VolumeDependencyTests-1974362274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cff6b113-8f61-4e71-bb0d-b05b298a6486,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cff6b113-8f61-4e71-bb0d-b05b298a6486.12724b0b-a3b7-43aa-8bce-728790bd2853 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:14 devstack sudo[105317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cff6b113-8f61-4e71-bb0d-b05b298a6486,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cff6b113-8f61-4e71-bb0d-b05b298a6486.12724b0b-a3b7-43aa-8bce-728790bd2853 1G Sep 23 00:32:14 devstack sudo[105317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:14 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-fb799f72-c1ca-4782-8877-26ad4a54c4d7 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Acquiring lock "cinder-982cf9b5-7c4d-497f-917d-e13b36a38e8e-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:14 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-fb799f72-c1ca-4782-8877-26ad4a54c4d7 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Lock "cinder-982cf9b5-7c4d-497f-917d-e13b36a38e8e-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:14 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-fb799f72-c1ca-4782-8877-26ad4a54c4d7 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Acquiring lock "cinder-quobyte-982cf9b5-7c4d-497f-917d-e13b36a38e8e" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:14 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-fb799f72-c1ca-4782-8877-26ad4a54c4d7 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Lock "cinder-quobyte-982cf9b5-7c4d-497f-917d-e13b36a38e8e" acquired by "delete_volume" :: waited 0.032s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:14 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f823e38-4730-4e9c-9b66-66f1d10356cb]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fb799f72-c1ca-4782-8877-26ad4a54c4d7 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-982cf9b5-7c4d-497f-917d-e13b36a38e8e {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:14 devstack sudo[105317]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6e906d13-dc75-4c46-824c-9c1fd0054179 tempest-VolumeDependencyTests-1974362274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cff6b113-8f61-4e71-bb0d-b05b298a6486,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cff6b113-8f61-4e71-bb0d-b05b298a6486.12724b0b-a3b7-43aa-8bce-728790bd2853 1G" returned: 0 in 0.617s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6e906d13-dc75-4c46-824c-9c1fd0054179 tempest-VolumeDependencyTests-1974362274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cff6b113-8f61-4e71-bb0d-b05b298a6486 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cff6b113-8f61-4e71-bb0d-b05b298a6486.12724b0b-a3b7-43aa-8bce-728790bd2853 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:14 devstack sudo[105324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cff6b113-8f61-4e71-bb0d-b05b298a6486 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cff6b113-8f61-4e71-bb0d-b05b298a6486.12724b0b-a3b7-43aa-8bce-728790bd2853 Sep 23 00:32:14 devstack sudo[105324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:15 devstack sudo[105323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-982cf9b5-7c4d-497f-917d-e13b36a38e8e Sep 23 00:32:15 devstack sudo[105323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e6c2a058-fdc1-4b1d-83c3-78cdbee9395f tempest-CinderUnicodeTest-1245637133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:15 devstack sudo[105324]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6e906d13-dc75-4c46-824c-9c1fd0054179 tempest-VolumeDependencyTests-1974362274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cff6b113-8f61-4e71-bb0d-b05b298a6486 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cff6b113-8f61-4e71-bb0d-b05b298a6486.12724b0b-a3b7-43aa-8bce-728790bd2853" returned: 0 in 0.417s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:15 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-6e906d13-dc75-4c46-824c-9c1fd0054179 tempest-VolumeDependencyTests-1974362274 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cff6b113-8f61-4e71-bb0d-b05b298a6486.12724b0b-a3b7-43aa-8bce-728790bd2853 is being set with open permissions: ugo+rw Sep 23 00:32:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6e906d13-dc75-4c46-824c-9c1fd0054179 tempest-VolumeDependencyTests-1974362274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cff6b113-8f61-4e71-bb0d-b05b298a6486.12724b0b-a3b7-43aa-8bce-728790bd2853 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:15 devstack sudo[105332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cff6b113-8f61-4e71-bb0d-b05b298a6486.12724b0b-a3b7-43aa-8bce-728790bd2853 Sep 23 00:32:15 devstack sudo[105332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:15 devstack sudo[105323]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fb799f72-c1ca-4782-8877-26ad4a54c4d7 tempest-CreateVolumesFromSnapshotTest-1109491162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-982cf9b5-7c4d-497f-917d-e13b36a38e8e" returned: 0 in 0.565s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fb799f72-c1ca-4782-8877-26ad4a54c4d7 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-982cf9b5-7c4d-497f-917d-e13b36a38e8e {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:15 devstack sudo[105335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-982cf9b5-7c4d-497f-917d-e13b36a38e8e Sep 23 00:32:15 devstack sudo[105335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:15 devstack sudo[105332]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6e906d13-dc75-4c46-824c-9c1fd0054179 tempest-VolumeDependencyTests-1974362274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cff6b113-8f61-4e71-bb0d-b05b298a6486.12724b0b-a3b7-43aa-8bce-728790bd2853" returned: 0 in 0.347s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6e906d13-dc75-4c46-824c-9c1fd0054179 tempest-VolumeDependencyTests-1974362274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cff6b113-8f61-4e71-bb0d-b05b298a6486.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:15 devstack sudo[105335]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fb799f72-c1ca-4782-8877-26ad4a54c4d7 tempest-CreateVolumesFromSnapshotTest-1109491162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-982cf9b5-7c4d-497f-917d-e13b36a38e8e" returned: 0 in 0.302s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:15 devstack sudo[105339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cff6b113-8f61-4e71-bb0d-b05b298a6486.info Sep 23 00:32:15 devstack sudo[105339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-fb799f72-c1ca-4782-8877-26ad4a54c4d7 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Lock "cinder-quobyte-982cf9b5-7c4d-497f-917d-e13b36a38e8e" released by "delete_volume" :: held 0.956s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:15 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-fb799f72-c1ca-4782-8877-26ad4a54c4d7 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Created reservations ['3bdaf5f6-0c92-4a65-b1eb-9b4394f10b35', '4303a6bf-f0dd-48ef-a117-95bf0cc6de81', '35124991-5ba6-46be-926d-cd37c4ff3e7f', '48e67557-d5cc-4081-b155-343a93173bf8'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-fb799f72-c1ca-4782-8877-26ad4a54c4d7 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-fb799f72-c1ca-4782-8877-26ad4a54c4d7 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:15 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-fb799f72-c1ca-4782-8877-26ad4a54c4d7 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:15 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-fb799f72-c1ca-4782-8877-26ad4a54c4d7 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-fb799f72-c1ca-4782-8877-26ad4a54c4d7 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fb799f72-c1ca-4782-8877-26ad4a54c4d7 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:15 devstack sudo[105341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:32:15 devstack sudo[105341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:16 devstack sudo[105339]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6e906d13-dc75-4c46-824c-9c1fd0054179 tempest-VolumeDependencyTests-1974362274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cff6b113-8f61-4e71-bb0d-b05b298a6486.info" returned: 0 in 0.330s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:16 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-6e906d13-dc75-4c46-824c-9c1fd0054179 tempest-VolumeDependencyTests-1974362274 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cff6b113-8f61-4e71-bb0d-b05b298a6486.info is being set with open permissions: ugo+rw Sep 23 00:32:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6e906d13-dc75-4c46-824c-9c1fd0054179 tempest-VolumeDependencyTests-1974362274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cff6b113-8f61-4e71-bb0d-b05b298a6486.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:16 devstack sudo[105344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cff6b113-8f61-4e71-bb0d-b05b298a6486.info Sep 23 00:32:16 devstack sudo[105344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:16 devstack sudo[105341]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-fb799f72-c1ca-4782-8877-26ad4a54c4d7 tempest-CreateVolumesFromSnapshotTest-1109491162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.324s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:16 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-fb799f72-c1ca-4782-8877-26ad4a54c4d7 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:16 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-fb799f72-c1ca-4782-8877-26ad4a54c4d7 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Deleted volume successfully. Sep 23 00:32:16 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-fb799f72-c1ca-4782-8877-26ad4a54c4d7 tempest-CreateVolumesFromSnapshotTest-1109491162 None] Lock "cinder-982cf9b5-7c4d-497f-917d-e13b36a38e8e-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:16 devstack sudo[105344]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6e906d13-dc75-4c46-824c-9c1fd0054179 tempest-VolumeDependencyTests-1974362274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cff6b113-8f61-4e71-bb0d-b05b298a6486.info" returned: 0 in 0.273s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6e906d13-dc75-4c46-824c-9c1fd0054179 tempest-VolumeDependencyTests-1974362274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.568s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e6c2a058-fdc1-4b1d-83c3-78cdbee9395f tempest-CinderUnicodeTest-1245637133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.151s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-e6c2a058-fdc1-4b1d-83c3-78cdbee9395f tempest-CinderUnicodeTest-1245637133 None] Creating offline snapshot a504a682-3641-4f00-9253-b581f30e3edf of volume dbdd0d42-072a-4804-a46a-619e3740720d {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:32:16 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-6e906d13-dc75-4c46-824c-9c1fd0054179 tempest-VolumeDependencyTests-1974362274 None] Create snapshot completed successfully Sep 23 00:32:16 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[4baa442f-6844-4865-9624-019f82d32f49]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e6c2a058-fdc1-4b1d-83c3-78cdbee9395f tempest-CinderUnicodeTest-1245637133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-dbdd0d42-072a-4804-a46a-619e3740720d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:16 devstack sudo[105348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-dbdd0d42-072a-4804-a46a-619e3740720d Sep 23 00:32:16 devstack sudo[105348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:16 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:32:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:16 devstack sudo[105350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:32:16 devstack sudo[105350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:16 devstack sudo[105348]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e6c2a058-fdc1-4b1d-83c3-78cdbee9395f tempest-CinderUnicodeTest-1245637133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-dbdd0d42-072a-4804-a46a-619e3740720d" returned: 0 in 0.453s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e6c2a058-fdc1-4b1d-83c3-78cdbee9395f tempest-CinderUnicodeTest-1245637133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-dbdd0d42-072a-4804-a46a-619e3740720d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-dbdd0d42-072a-4804-a46a-619e3740720d.a504a682-3641-4f00-9253-b581f30e3edf 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:16 devstack sudo[105355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-dbdd0d42-072a-4804-a46a-619e3740720d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-dbdd0d42-072a-4804-a46a-619e3740720d.a504a682-3641-4f00-9253-b581f30e3edf 1G Sep 23 00:32:16 devstack sudo[105355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:17 devstack sudo[105350]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.317s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:17 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:17 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running periodic task VolumeManager._thread_info {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:32:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] thread count: 29 {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:32:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] thread info: [<_MainThread(MainThread, started 135440660459648)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:32:17 devstack sudo[105355]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e6c2a058-fdc1-4b1d-83c3-78cdbee9395f tempest-CinderUnicodeTest-1245637133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-dbdd0d42-072a-4804-a46a-619e3740720d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-dbdd0d42-072a-4804-a46a-619e3740720d.a504a682-3641-4f00-9253-b581f30e3edf 1G" returned: 0 in 0.616s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e6c2a058-fdc1-4b1d-83c3-78cdbee9395f tempest-CinderUnicodeTest-1245637133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbdd0d42-072a-4804-a46a-619e3740720d -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-dbdd0d42-072a-4804-a46a-619e3740720d.a504a682-3641-4f00-9253-b581f30e3edf {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:17 devstack sudo[105362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbdd0d42-072a-4804-a46a-619e3740720d -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-dbdd0d42-072a-4804-a46a-619e3740720d.a504a682-3641-4f00-9253-b581f30e3edf Sep 23 00:32:17 devstack sudo[105362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:17 devstack sudo[105362]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e6c2a058-fdc1-4b1d-83c3-78cdbee9395f tempest-CinderUnicodeTest-1245637133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbdd0d42-072a-4804-a46a-619e3740720d -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-dbdd0d42-072a-4804-a46a-619e3740720d.a504a682-3641-4f00-9253-b581f30e3edf" returned: 0 in 0.467s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:17 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-e6c2a058-fdc1-4b1d-83c3-78cdbee9395f tempest-CinderUnicodeTest-1245637133 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-dbdd0d42-072a-4804-a46a-619e3740720d.a504a682-3641-4f00-9253-b581f30e3edf is being set with open permissions: ugo+rw Sep 23 00:32:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e6c2a058-fdc1-4b1d-83c3-78cdbee9395f tempest-CinderUnicodeTest-1245637133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-dbdd0d42-072a-4804-a46a-619e3740720d.a504a682-3641-4f00-9253-b581f30e3edf {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:17 devstack sudo[105367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-dbdd0d42-072a-4804-a46a-619e3740720d.a504a682-3641-4f00-9253-b581f30e3edf Sep 23 00:32:17 devstack sudo[105367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:18 devstack sudo[105367]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e6c2a058-fdc1-4b1d-83c3-78cdbee9395f tempest-CinderUnicodeTest-1245637133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-dbdd0d42-072a-4804-a46a-619e3740720d.a504a682-3641-4f00-9253-b581f30e3edf" returned: 0 in 0.401s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e6c2a058-fdc1-4b1d-83c3-78cdbee9395f tempest-CinderUnicodeTest-1245637133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-dbdd0d42-072a-4804-a46a-619e3740720d.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:18 devstack sudo[105406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-dbdd0d42-072a-4804-a46a-619e3740720d.info Sep 23 00:32:18 devstack sudo[105406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:18 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c5dfe34-670e-4be8-83f7-f36ce91f892f tempest-VolumeDependencyTests-1974362274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:32:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4c5dfe34-670e-4be8-83f7-f36ce91f892f tempest-VolumeDependencyTests-1974362274 None] Flow 'volume_create_manager' (783d21c6-cb11-40a3-a609-8a5c6e10dc79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4c5dfe34-670e-4be8-83f7-f36ce91f892f tempest-VolumeDependencyTests-1974362274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9b17e0a-5dfd-44d1-b8a2-68688bb2c138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4c5dfe34-670e-4be8-83f7-f36ce91f892f tempest-VolumeDependencyTests-1974362274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9b17e0a-5dfd-44d1-b8a2-68688bb2c138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-84088831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=173f652c-2f3a-44ee-80da-a687d98151d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='798a7a7af80f4a75ab52bdc958eb10c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=12724b0b-a3b7-43aa-8bce-728790bd2853,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:18Z,use_quota=True,user_id='70792315b47d42dfaafd9fd5d8379d08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4c5dfe34-670e-4be8-83f7-f36ce91f892f tempest-VolumeDependencyTests-1974362274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb806faf-dcaf-4385-8c0b-47d8215862ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4c5dfe34-670e-4be8-83f7-f36ce91f892f tempest-VolumeDependencyTests-1974362274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb806faf-dcaf-4385-8c0b-47d8215862ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4c5dfe34-670e-4be8-83f7-f36ce91f892f tempest-VolumeDependencyTests-1974362274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c15274bf-9296-42fe-a00d-fa385338199c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4c5dfe34-670e-4be8-83f7-f36ce91f892f tempest-VolumeDependencyTests-1974362274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c15274bf-9296-42fe-a00d-fa385338199c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '173f652c-2f3a-44ee-80da-a687d98151d8', 'volume_name': 'volume-173f652c-2f3a-44ee-80da-a687d98151d8', 'volume_size': 1, 'snapshot_id': '12724b0b-a3b7-43aa-8bce-728790bd2853'}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4c5dfe34-670e-4be8-83f7-f36ce91f892f tempest-VolumeDependencyTests-1974362274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb02d9a8-9ae7-4a07-9e13-2ccb1a8d67d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4c5dfe34-670e-4be8-83f7-f36ce91f892f tempest-VolumeDependencyTests-1974362274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb02d9a8-9ae7-4a07-9e13-2ccb1a8d67d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4c5dfe34-670e-4be8-83f7-f36ce91f892f tempest-VolumeDependencyTests-1974362274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d3fe55d-b793-424f-b400-2e5d51c99759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:18 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-4c5dfe34-670e-4be8-83f7-f36ce91f892f tempest-VolumeDependencyTests-1974362274 None] Volume 173f652c-2f3a-44ee-80da-a687d98151d8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-173f652c-2f3a-44ee-80da-a687d98151d8', 'volume_size': 1, 'snapshot_id': '12724b0b-a3b7-43aa-8bce-728790bd2853'} Sep 23 00:32:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4c5dfe34-670e-4be8-83f7-f36ce91f892f tempest-VolumeDependencyTests-1974362274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:18 devstack sudo[105406]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e6c2a058-fdc1-4b1d-83c3-78cdbee9395f tempest-CinderUnicodeTest-1245637133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-dbdd0d42-072a-4804-a46a-619e3740720d.info" returned: 0 in 0.451s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:18 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-e6c2a058-fdc1-4b1d-83c3-78cdbee9395f tempest-CinderUnicodeTest-1245637133 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-dbdd0d42-072a-4804-a46a-619e3740720d.info is being set with open permissions: ugo+rw Sep 23 00:32:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e6c2a058-fdc1-4b1d-83c3-78cdbee9395f tempest-CinderUnicodeTest-1245637133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-dbdd0d42-072a-4804-a46a-619e3740720d.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:18 devstack sudo[105411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-dbdd0d42-072a-4804-a46a-619e3740720d.info Sep 23 00:32:18 devstack sudo[105411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:19 devstack sudo[105411]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e6c2a058-fdc1-4b1d-83c3-78cdbee9395f tempest-CinderUnicodeTest-1245637133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-dbdd0d42-072a-4804-a46a-619e3740720d.info" returned: 0 in 0.373s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e6c2a058-fdc1-4b1d-83c3-78cdbee9395f tempest-CinderUnicodeTest-1245637133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.889s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4c5dfe34-670e-4be8-83f7-f36ce91f892f tempest-VolumeDependencyTests-1974362274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.497s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4c5dfe34-670e-4be8-83f7-f36ce91f892f tempest-VolumeDependencyTests-1974362274 None] Acquiring lock "cinder-quobyte-12724b0b-a3b7-43aa-8bce-728790bd2853-173f652c-2f3a-44ee-80da-a687d98151d8" by "_create_volume_from_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:19 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-e6c2a058-fdc1-4b1d-83c3-78cdbee9395f tempest-CinderUnicodeTest-1245637133 None] Create snapshot completed successfully Sep 23 00:32:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4c5dfe34-670e-4be8-83f7-f36ce91f892f tempest-VolumeDependencyTests-1974362274 None] Lock "cinder-quobyte-12724b0b-a3b7-43aa-8bce-728790bd2853-173f652c-2f3a-44ee-80da-a687d98151d8" acquired by "_create_volume_from_snapshot" :: waited 0.052s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:19 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4c5dfe34-670e-4be8-83f7-f36ce91f892f tempest-VolumeDependencyTests-1974362274 None] Creating volume 173f652c-2f3a-44ee-80da-a687d98151d8 from snapshot 12724b0b-a3b7-43aa-8bce-728790bd2853 {{(pid=86591) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 00:32:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4c5dfe34-670e-4be8-83f7-f36ce91f892f tempest-VolumeDependencyTests-1974362274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4c5dfe34-670e-4be8-83f7-f36ce91f892f tempest-VolumeDependencyTests-1974362274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:19 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4c5dfe34-670e-4be8-83f7-f36ce91f892f tempest-VolumeDependencyTests-1974362274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:19 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4c5dfe34-670e-4be8-83f7-f36ce91f892f tempest-VolumeDependencyTests-1974362274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4c5dfe34-670e-4be8-83f7-f36ce91f892f tempest-VolumeDependencyTests-1974362274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:19 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4c5dfe34-670e-4be8-83f7-f36ce91f892f tempest-VolumeDependencyTests-1974362274 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:32:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4c5dfe34-670e-4be8-83f7-f36ce91f892f tempest-VolumeDependencyTests-1974362274 None] Acquiring lock "cinder-quobyte-173f652c-2f3a-44ee-80da-a687d98151d8" by "_copy_volume_from_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4c5dfe34-670e-4be8-83f7-f36ce91f892f tempest-VolumeDependencyTests-1974362274 None] Lock "cinder-quobyte-173f652c-2f3a-44ee-80da-a687d98151d8" acquired by "_copy_volume_from_snapshot" :: waited 0.041s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:19 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4c5dfe34-670e-4be8-83f7-f36ce91f892f tempest-VolumeDependencyTests-1974362274 None] snapshot: 12724b0b-a3b7-43aa-8bce-728790bd2853, volume: 173f652c-2f3a-44ee-80da-a687d98151d8, {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:32:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4c5dfe34-670e-4be8-83f7-f36ce91f892f tempest-VolumeDependencyTests-1974362274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4c5dfe34-670e-4be8-83f7-f36ce91f892f tempest-VolumeDependencyTests-1974362274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:19 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4c5dfe34-670e-4be8-83f7-f36ce91f892f tempest-VolumeDependencyTests-1974362274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:19 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4c5dfe34-670e-4be8-83f7-f36ce91f892f tempest-VolumeDependencyTests-1974362274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4c5dfe34-670e-4be8-83f7-f36ce91f892f tempest-VolumeDependencyTests-1974362274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:19 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a57d739-8aca-47b5-bf1e-5eb6226070f5]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4c5dfe34-670e-4be8-83f7-f36ce91f892f tempest-VolumeDependencyTests-1974362274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cff6b113-8f61-4e71-bb0d-b05b298a6486.12724b0b-a3b7-43aa-8bce-728790bd2853 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-eba0cb5b-25ef-40af-9432-f8555ab96850 tempest-CinderUnicodeTest-1245637133 None] Acquiring lock "cinder-a504a682-3641-4f00-9253-b581f30e3edf-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-eba0cb5b-25ef-40af-9432-f8555ab96850 tempest-CinderUnicodeTest-1245637133 None] Lock "cinder-a504a682-3641-4f00-9253-b581f30e3edf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-eba0cb5b-25ef-40af-9432-f8555ab96850 tempest-CinderUnicodeTest-1245637133 None] Acquiring lock "cinder-quobyte-dbdd0d42-072a-4804-a46a-619e3740720d" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-eba0cb5b-25ef-40af-9432-f8555ab96850 tempest-CinderUnicodeTest-1245637133 None] Lock "cinder-quobyte-dbdd0d42-072a-4804-a46a-619e3740720d" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-eba0cb5b-25ef-40af-9432-f8555ab96850 tempest-CinderUnicodeTest-1245637133 None] Acquiring lock "cinder-quobyte-a504a682-3641-4f00-9253-b581f30e3edf" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-eba0cb5b-25ef-40af-9432-f8555ab96850 tempest-CinderUnicodeTest-1245637133 None] Lock "cinder-quobyte-a504a682-3641-4f00-9253-b581f30e3edf" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:19 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-eba0cb5b-25ef-40af-9432-f8555ab96850 tempest-CinderUnicodeTest-1245637133 None] Deleting offline snapshot a504a682-3641-4f00-9253-b581f30e3edf of volume dbdd0d42-072a-4804-a46a-619e3740720d {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:32:19 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-eba0cb5b-25ef-40af-9432-f8555ab96850 tempest-CinderUnicodeTest-1245637133 None] snapshot_file for this snap is: volume-dbdd0d42-072a-4804-a46a-619e3740720d.a504a682-3641-4f00-9253-b581f30e3edf {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:32:19 devstack sudo[105414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cff6b113-8f61-4e71-bb0d-b05b298a6486.12724b0b-a3b7-43aa-8bce-728790bd2853 Sep 23 00:32:19 devstack sudo[105414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:19 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ea30f5-bf4c-4252-9435-f4d2fa10e992]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-eba0cb5b-25ef-40af-9432-f8555ab96850 tempest-CinderUnicodeTest-1245637133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-dbdd0d42-072a-4804-a46a-619e3740720d.a504a682-3641-4f00-9253-b581f30e3edf {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:19 devstack sudo[105416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-dbdd0d42-072a-4804-a46a-619e3740720d.a504a682-3641-4f00-9253-b581f30e3edf Sep 23 00:32:19 devstack sudo[105416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:20 devstack sudo[105414]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4c5dfe34-670e-4be8-83f7-f36ce91f892f tempest-VolumeDependencyTests-1974362274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cff6b113-8f61-4e71-bb0d-b05b298a6486.12724b0b-a3b7-43aa-8bce-728790bd2853" returned: 0 in 0.552s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:20 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-4c5dfe34-670e-4be8-83f7-f36ce91f892f tempest-VolumeDependencyTests-1974362274 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cff6b113-8f61-4e71-bb0d-b05b298a6486(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:32:20 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a79459-a9cc-45ed-bdb0-9385e17e1a94]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4c5dfe34-670e-4be8-83f7-f36ce91f892f tempest-VolumeDependencyTests-1974362274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cff6b113-8f61-4e71-bb0d-b05b298a6486 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:20 devstack sudo[105422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cff6b113-8f61-4e71-bb0d-b05b298a6486 Sep 23 00:32:20 devstack sudo[105422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:20 devstack sudo[105416]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-eba0cb5b-25ef-40af-9432-f8555ab96850 tempest-CinderUnicodeTest-1245637133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-dbdd0d42-072a-4804-a46a-619e3740720d.a504a682-3641-4f00-9253-b581f30e3edf" returned: 0 in 0.588s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:20 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-eba0cb5b-25ef-40af-9432-f8555ab96850 tempest-CinderUnicodeTest-1245637133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dbdd0d42-072a-4804-a46a-619e3740720d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:32:20 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[0acb11f7-92e0-414b-8917-b70c2419be30]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-eba0cb5b-25ef-40af-9432-f8555ab96850 tempest-CinderUnicodeTest-1245637133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-dbdd0d42-072a-4804-a46a-619e3740720d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:20 devstack sudo[105427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-dbdd0d42-072a-4804-a46a-619e3740720d Sep 23 00:32:20 devstack sudo[105427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:20 devstack sudo[105422]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4c5dfe34-670e-4be8-83f7-f36ce91f892f tempest-VolumeDependencyTests-1974362274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cff6b113-8f61-4e71-bb0d-b05b298a6486" returned: 0 in 0.490s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:20 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4c5dfe34-670e-4be8-83f7-f36ce91f892f tempest-VolumeDependencyTests-1974362274 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cff6b113-8f61-4e71-bb0d-b05b298a6486 {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:32:20 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4c5dfe34-670e-4be8-83f7-f36ce91f892f tempest-VolumeDependencyTests-1974362274 None] Creating direct copy from snapshot {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:32:20 devstack cinder-volume[86591]: DEBUG cinder.utils [None req-4c5dfe34-670e-4be8-83f7-f36ce91f892f tempest-VolumeDependencyTests-1974362274 None] Path /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-173f652c-2f3a-44ee-80da-a687d98151d8 not found in is_blk_device check {{(pid=86591) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:32:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4c5dfe34-670e-4be8-83f7-f36ce91f892f tempest-VolumeDependencyTests-1974362274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cff6b113-8f61-4e71-bb0d-b05b298a6486 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-173f652c-2f3a-44ee-80da-a687d98151d8 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:20 devstack sudo[105433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cff6b113-8f61-4e71-bb0d-b05b298a6486 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-173f652c-2f3a-44ee-80da-a687d98151d8 Sep 23 00:32:20 devstack sudo[105433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:20 devstack sudo[105427]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-eba0cb5b-25ef-40af-9432-f8555ab96850 tempest-CinderUnicodeTest-1245637133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-dbdd0d42-072a-4804-a46a-619e3740720d" returned: 0 in 0.529s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-eba0cb5b-25ef-40af-9432-f8555ab96850 tempest-CinderUnicodeTest-1245637133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-dbdd0d42-072a-4804-a46a-619e3740720d.a504a682-3641-4f00-9253-b581f30e3edf {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:20 devstack sudo[105438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-dbdd0d42-072a-4804-a46a-619e3740720d.a504a682-3641-4f00-9253-b581f30e3edf Sep 23 00:32:20 devstack sudo[105438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:21 devstack sudo[105438]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-eba0cb5b-25ef-40af-9432-f8555ab96850 tempest-CinderUnicodeTest-1245637133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-dbdd0d42-072a-4804-a46a-619e3740720d.a504a682-3641-4f00-9253-b581f30e3edf" returned: 0 in 0.899s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-eba0cb5b-25ef-40af-9432-f8555ab96850 tempest-CinderUnicodeTest-1245637133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-dbdd0d42-072a-4804-a46a-619e3740720d.a504a682-3641-4f00-9253-b581f30e3edf {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:21 devstack sudo[105454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-dbdd0d42-072a-4804-a46a-619e3740720d.a504a682-3641-4f00-9253-b581f30e3edf Sep 23 00:32:21 devstack sudo[105454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:22 devstack sudo[105454]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-eba0cb5b-25ef-40af-9432-f8555ab96850 tempest-CinderUnicodeTest-1245637133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-dbdd0d42-072a-4804-a46a-619e3740720d.a504a682-3641-4f00-9253-b581f30e3edf" returned: 0 in 0.483s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:22 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-eba0cb5b-25ef-40af-9432-f8555ab96850 tempest-CinderUnicodeTest-1245637133 None] Lock "cinder-quobyte-a504a682-3641-4f00-9253-b581f30e3edf" released by "_delete_snapshot" :: held 2.832s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:22 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-eba0cb5b-25ef-40af-9432-f8555ab96850 tempest-CinderUnicodeTest-1245637133 None] Lock "cinder-quobyte-dbdd0d42-072a-4804-a46a-619e3740720d" released by "delete_snapshot" :: held 2.879s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:22 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-8373fce8-e9fd-430d-bdc4-c696dae955de tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:32:22 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8373fce8-e9fd-430d-bdc4-c696dae955de tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Flow 'volume_create_manager' (61202ffa-ccb2-493d-b468-a1ba73793963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:22 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8373fce8-e9fd-430d-bdc4-c696dae955de tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44797668-7148-4cfc-9165-0c3c717a640c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:22 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8373fce8-e9fd-430d-bdc4-c696dae955de tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44797668-7148-4cfc-9165-0c3c717a640c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1708041554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c2d286e-8d91-443c-b618-9fa1c3c978c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='777565d0809645098f5972ff04b2b9d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:22Z,use_quota=True,user_id='b147d8f530294010be7edfba237d722e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:22 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8373fce8-e9fd-430d-bdc4-c696dae955de tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc2c6523-482f-403b-8872-c69a4ddb4d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:22 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8373fce8-e9fd-430d-bdc4-c696dae955de tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc2c6523-482f-403b-8872-c69a4ddb4d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:22 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8373fce8-e9fd-430d-bdc4-c696dae955de tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (973239c6-635b-4f84-b64c-d6f397c191f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:22 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8373fce8-e9fd-430d-bdc4-c696dae955de tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (973239c6-635b-4f84-b64c-d6f397c191f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c2d286e-8d91-443c-b618-9fa1c3c978c3', 'volume_name': 'volume-1c2d286e-8d91-443c-b618-9fa1c3c978c3', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:22 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8373fce8-e9fd-430d-bdc4-c696dae955de tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62e8d6ab-7e70-4659-a92e-58e148b11f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:22 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8373fce8-e9fd-430d-bdc4-c696dae955de tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62e8d6ab-7e70-4659-a92e-58e148b11f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:22 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8373fce8-e9fd-430d-bdc4-c696dae955de tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8251b69-4245-4954-b93c-11cc878f835b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:22 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-8373fce8-e9fd-430d-bdc4-c696dae955de tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Volume 1c2d286e-8d91-443c-b618-9fa1c3c978c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c2d286e-8d91-443c-b618-9fa1c3c978c3', 'volume_size': 1} Sep 23 00:32:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8373fce8-e9fd-430d-bdc4-c696dae955de tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:22 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-eba0cb5b-25ef-40af-9432-f8555ab96850 tempest-CinderUnicodeTest-1245637133 None] Created reservations ['4f04cf29-56b3-47ad-a53d-1bda22f90acc', 'd4b064a0-085f-445b-99a7-fb41a873c65d', 'd717e423-717f-45b5-bcd3-4a9fb9b538a9', 'e5417b9d-2534-4479-997c-5d835b5a5ac6'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:22 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-eba0cb5b-25ef-40af-9432-f8555ab96850 tempest-CinderUnicodeTest-1245637133 None] Delete snapshot completed successfully. Sep 23 00:32:22 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-eba0cb5b-25ef-40af-9432-f8555ab96850 tempest-CinderUnicodeTest-1245637133 None] Lock "cinder-a504a682-3641-4f00-9253-b581f30e3edf-delete_snapshot" released by "delete_snapshot" :: held 3.442s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:23 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-94c7f6b7-847f-4220-8dff-48484b3008f4 tempest-CinderUnicodeTest-1245637133 None] Acquiring lock "cinder-dbdd0d42-072a-4804-a46a-619e3740720d-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:24 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-94c7f6b7-847f-4220-8dff-48484b3008f4 tempest-CinderUnicodeTest-1245637133 None] Lock "cinder-dbdd0d42-072a-4804-a46a-619e3740720d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:24 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-94c7f6b7-847f-4220-8dff-48484b3008f4 tempest-CinderUnicodeTest-1245637133 None] Acquiring lock "cinder-quobyte-dbdd0d42-072a-4804-a46a-619e3740720d" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:24 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-94c7f6b7-847f-4220-8dff-48484b3008f4 tempest-CinderUnicodeTest-1245637133 None] Lock "cinder-quobyte-dbdd0d42-072a-4804-a46a-619e3740720d" acquired by "delete_volume" :: waited 0.039s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:24 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb472b67-3f5c-4e60-baa1-7cd9e56f467f]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-94c7f6b7-847f-4220-8dff-48484b3008f4 tempest-CinderUnicodeTest-1245637133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-dbdd0d42-072a-4804-a46a-619e3740720d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:24 devstack sudo[105457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-dbdd0d42-072a-4804-a46a-619e3740720d Sep 23 00:32:24 devstack sudo[105457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:25 devstack sudo[105457]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-94c7f6b7-847f-4220-8dff-48484b3008f4 tempest-CinderUnicodeTest-1245637133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-dbdd0d42-072a-4804-a46a-619e3740720d" returned: 0 in 0.723s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-94c7f6b7-847f-4220-8dff-48484b3008f4 tempest-CinderUnicodeTest-1245637133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-dbdd0d42-072a-4804-a46a-619e3740720d {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:25 devstack sudo[105462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-dbdd0d42-072a-4804-a46a-619e3740720d Sep 23 00:32:25 devstack sudo[105462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:25 devstack sudo[105462]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-94c7f6b7-847f-4220-8dff-48484b3008f4 tempest-CinderUnicodeTest-1245637133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-dbdd0d42-072a-4804-a46a-619e3740720d" returned: 0 in 0.511s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:25 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-94c7f6b7-847f-4220-8dff-48484b3008f4 tempest-CinderUnicodeTest-1245637133 None] Lock "cinder-quobyte-dbdd0d42-072a-4804-a46a-619e3740720d" released by "delete_volume" :: held 1.430s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:25 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-94c7f6b7-847f-4220-8dff-48484b3008f4 tempest-CinderUnicodeTest-1245637133 None] Created reservations ['fd0018bb-be33-4741-866a-be8f9cb9cf70', '78842bae-854c-4b55-ae8e-36247c2688be', '530ec2c2-87f1-4f46-be67-eac17e6d7ec2', 'f92f622c-5641-49d3-b0aa-69bb8f1e4835'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-94c7f6b7-847f-4220-8dff-48484b3008f4 tempest-CinderUnicodeTest-1245637133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-94c7f6b7-847f-4220-8dff-48484b3008f4 tempest-CinderUnicodeTest-1245637133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:25 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-94c7f6b7-847f-4220-8dff-48484b3008f4 tempest-CinderUnicodeTest-1245637133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:25 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-94c7f6b7-847f-4220-8dff-48484b3008f4 tempest-CinderUnicodeTest-1245637133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-94c7f6b7-847f-4220-8dff-48484b3008f4 tempest-CinderUnicodeTest-1245637133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-94c7f6b7-847f-4220-8dff-48484b3008f4 tempest-CinderUnicodeTest-1245637133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:25 devstack sudo[105466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:32:26 devstack sudo[105466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:26 devstack sudo[105466]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-94c7f6b7-847f-4220-8dff-48484b3008f4 tempest-CinderUnicodeTest-1245637133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.421s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:26 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-94c7f6b7-847f-4220-8dff-48484b3008f4 tempest-CinderUnicodeTest-1245637133 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:26 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-94c7f6b7-847f-4220-8dff-48484b3008f4 tempest-CinderUnicodeTest-1245637133 None] Deleted volume successfully. Sep 23 00:32:26 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-94c7f6b7-847f-4220-8dff-48484b3008f4 tempest-CinderUnicodeTest-1245637133 None] Lock "cinder-dbdd0d42-072a-4804-a46a-619e3740720d-delete_volume" released by "delete_volume" :: held 2.365s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:26 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-511b579c-48db-45d1-bdbb-73c68b2f1035 tempest-CinderUnicodeTest-1245637133 None] Acquiring lock "cinder-135410a7-8b55-4e37-9f67-f3cfcfae2e94-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:26 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-511b579c-48db-45d1-bdbb-73c68b2f1035 tempest-CinderUnicodeTest-1245637133 None] Lock "cinder-135410a7-8b55-4e37-9f67-f3cfcfae2e94-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:26 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-511b579c-48db-45d1-bdbb-73c68b2f1035 tempest-CinderUnicodeTest-1245637133 None] Acquiring lock "cinder-quobyte-135410a7-8b55-4e37-9f67-f3cfcfae2e94" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:26 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-511b579c-48db-45d1-bdbb-73c68b2f1035 tempest-CinderUnicodeTest-1245637133 None] Lock "cinder-quobyte-135410a7-8b55-4e37-9f67-f3cfcfae2e94" acquired by "delete_volume" :: waited 0.036s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:26 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee62fc78-51ca-476a-8e70-0752861c4263]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-511b579c-48db-45d1-bdbb-73c68b2f1035 tempest-CinderUnicodeTest-1245637133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-135410a7-8b55-4e37-9f67-f3cfcfae2e94 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:27 devstack sudo[105469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-135410a7-8b55-4e37-9f67-f3cfcfae2e94 Sep 23 00:32:27 devstack sudo[105469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:27 devstack sudo[105469]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-511b579c-48db-45d1-bdbb-73c68b2f1035 tempest-CinderUnicodeTest-1245637133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-135410a7-8b55-4e37-9f67-f3cfcfae2e94" returned: 0 in 1.060s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-511b579c-48db-45d1-bdbb-73c68b2f1035 tempest-CinderUnicodeTest-1245637133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-135410a7-8b55-4e37-9f67-f3cfcfae2e94 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:27 devstack sudo[105475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-135410a7-8b55-4e37-9f67-f3cfcfae2e94 Sep 23 00:32:27 devstack sudo[105475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:28 devstack sudo[105475]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-511b579c-48db-45d1-bdbb-73c68b2f1035 tempest-CinderUnicodeTest-1245637133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-135410a7-8b55-4e37-9f67-f3cfcfae2e94" returned: 0 in 0.589s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:28 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-511b579c-48db-45d1-bdbb-73c68b2f1035 tempest-CinderUnicodeTest-1245637133 None] Lock "cinder-quobyte-135410a7-8b55-4e37-9f67-f3cfcfae2e94" released by "delete_volume" :: held 1.744s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:28 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-511b579c-48db-45d1-bdbb-73c68b2f1035 tempest-CinderUnicodeTest-1245637133 None] Created reservations ['fdcfb444-1c16-4489-b8ad-93d3a4bb29e0', 'ff6b9f8a-f3c3-45dd-8ec9-9c161f79d152', 'a68151b7-3b98-4829-be1c-059154ed0017', '758c6d50-59e9-4291-86aa-de9076309c4e'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-511b579c-48db-45d1-bdbb-73c68b2f1035 tempest-CinderUnicodeTest-1245637133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-511b579c-48db-45d1-bdbb-73c68b2f1035 tempest-CinderUnicodeTest-1245637133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:28 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-511b579c-48db-45d1-bdbb-73c68b2f1035 tempest-CinderUnicodeTest-1245637133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:28 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-511b579c-48db-45d1-bdbb-73c68b2f1035 tempest-CinderUnicodeTest-1245637133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-511b579c-48db-45d1-bdbb-73c68b2f1035 tempest-CinderUnicodeTest-1245637133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-511b579c-48db-45d1-bdbb-73c68b2f1035 tempest-CinderUnicodeTest-1245637133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:28 devstack sudo[105480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:32:28 devstack sudo[105480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:29 devstack sudo[105480]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-511b579c-48db-45d1-bdbb-73c68b2f1035 tempest-CinderUnicodeTest-1245637133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.459s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:29 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-511b579c-48db-45d1-bdbb-73c68b2f1035 tempest-CinderUnicodeTest-1245637133 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:29 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-511b579c-48db-45d1-bdbb-73c68b2f1035 tempest-CinderUnicodeTest-1245637133 None] Deleted volume successfully. Sep 23 00:32:29 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-511b579c-48db-45d1-bdbb-73c68b2f1035 tempest-CinderUnicodeTest-1245637133 None] Lock "cinder-135410a7-8b55-4e37-9f67-f3cfcfae2e94-delete_volume" released by "delete_volume" :: held 2.692s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:29 devstack sudo[105433]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4c5dfe34-670e-4be8-83f7-f36ce91f892f tempest-VolumeDependencyTests-1974362274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cff6b113-8f61-4e71-bb0d-b05b298a6486 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-173f652c-2f3a-44ee-80da-a687d98151d8" returned: 0 in 8.883s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:29 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-4c5dfe34-670e-4be8-83f7-f36ce91f892f tempest-VolumeDependencyTests-1974362274 None] Image conversion details: src /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cff6b113-8f61-4e71-bb0d-b05b298a6486, size 1024.00 MB, duration 8.89 sec, destination /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-173f652c-2f3a-44ee-80da-a687d98151d8 {{(pid=86591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:32:29 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-4c5dfe34-670e-4be8-83f7-f36ce91f892f tempest-VolumeDependencyTests-1974362274 None] Converted 1024.00 MB image at 115.22 MB/s Sep 23 00:32:29 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-4c5dfe34-670e-4be8-83f7-f36ce91f892f tempest-VolumeDependencyTests-1974362274 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-173f652c-2f3a-44ee-80da-a687d98151d8 is being set with open permissions: ugo+rw Sep 23 00:32:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4c5dfe34-670e-4be8-83f7-f36ce91f892f tempest-VolumeDependencyTests-1974362274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-173f652c-2f3a-44ee-80da-a687d98151d8 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:29 devstack sudo[105483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-173f652c-2f3a-44ee-80da-a687d98151d8 Sep 23 00:32:29 devstack sudo[105483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:29 devstack sudo[105483]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4c5dfe34-670e-4be8-83f7-f36ce91f892f tempest-VolumeDependencyTests-1974362274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-173f652c-2f3a-44ee-80da-a687d98151d8" returned: 0 in 0.270s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:29 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4c5dfe34-670e-4be8-83f7-f36ce91f892f tempest-VolumeDependencyTests-1974362274 None] Lock "cinder-quobyte-173f652c-2f3a-44ee-80da-a687d98151d8" released by "_copy_volume_from_snapshot" :: held 10.333s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:29 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4c5dfe34-670e-4be8-83f7-f36ce91f892f tempest-VolumeDependencyTests-1974362274 None] Lock "cinder-quobyte-12724b0b-a3b7-43aa-8bce-728790bd2853-173f652c-2f3a-44ee-80da-a687d98151d8" released by "_create_volume_from_snapshot" :: held 10.451s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4c5dfe34-670e-4be8-83f7-f36ce91f892f tempest-VolumeDependencyTests-1974362274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.504s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8373fce8-e9fd-430d-bdc4-c696dae955de tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.055s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:29 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-8373fce8-e9fd-430d-bdc4-c696dae955de tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1708041554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c2d286e-8d91-443c-b618-9fa1c3c978c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='777565d0809645098f5972ff04b2b9d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:22Z,use_quota=True,user_id='b147d8f530294010be7edfba237d722e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:32:29 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-8373fce8-e9fd-430d-bdc4-c696dae955de tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Creating volume 1c2d286e-8d91-443c-b618-9fa1c3c978c3 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:32:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8373fce8-e9fd-430d-bdc4-c696dae955de tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8373fce8-e9fd-430d-bdc4-c696dae955de tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:29 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-8373fce8-e9fd-430d-bdc4-c696dae955de tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:29 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-8373fce8-e9fd-430d-bdc4-c696dae955de tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8373fce8-e9fd-430d-bdc4-c696dae955de tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:29 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-8373fce8-e9fd-430d-bdc4-c696dae955de tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:32:29 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-8373fce8-e9fd-430d-bdc4-c696dae955de tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:32:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8373fce8-e9fd-430d-bdc4-c696dae955de tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1c2d286e-8d91-443c-b618-9fa1c3c978c3 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:29 devstack sudo[105486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1c2d286e-8d91-443c-b618-9fa1c3c978c3 1073741824 Sep 23 00:32:29 devstack sudo[105486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:29 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4c5dfe34-670e-4be8-83f7-f36ce91f892f tempest-VolumeDependencyTests-1974362274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d3fe55d-b793-424f-b400-2e5d51c99759) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-173f652c-2f3a-44ee-80da-a687d98151d8', 'volume_size': 1, 'snapshot_id': '12724b0b-a3b7-43aa-8bce-728790bd2853'}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:29 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4c5dfe34-670e-4be8-83f7-f36ce91f892f tempest-VolumeDependencyTests-1974362274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4ee1baf-e560-45b2-887f-3649581124e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:29 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-4c5dfe34-670e-4be8-83f7-f36ce91f892f tempest-VolumeDependencyTests-1974362274 None] Volume volume-173f652c-2f3a-44ee-80da-a687d98151d8 (173f652c-2f3a-44ee-80da-a687d98151d8): created successfully Sep 23 00:32:29 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4c5dfe34-670e-4be8-83f7-f36ce91f892f tempest-VolumeDependencyTests-1974362274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4ee1baf-e560-45b2-887f-3649581124e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:29 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4c5dfe34-670e-4be8-83f7-f36ce91f892f tempest-VolumeDependencyTests-1974362274 None] Flow 'volume_create_manager' (783d21c6-cb11-40a3-a609-8a5c6e10dc79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:29 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-4c5dfe34-670e-4be8-83f7-f36ce91f892f tempest-VolumeDependencyTests-1974362274 None] Created volume successfully. Sep 23 00:32:30 devstack sudo[105486]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8373fce8-e9fd-430d-bdc4-c696dae955de tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1c2d286e-8d91-443c-b618-9fa1c3c978c3 1073741824" returned: 0 in 0.621s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8373fce8-e9fd-430d-bdc4-c696dae955de tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1c2d286e-8d91-443c-b618-9fa1c3c978c3 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:30 devstack sudo[105492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1c2d286e-8d91-443c-b618-9fa1c3c978c3 Sep 23 00:32:30 devstack sudo[105492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:30 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-1fdd737a-d06b-414b-a91a-418c6de99d11 tempest-VolumeDependencyTests-1974362274 None] Acquiring lock "cinder-12724b0b-a3b7-43aa-8bce-728790bd2853-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:30 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-1fdd737a-d06b-414b-a91a-418c6de99d11 tempest-VolumeDependencyTests-1974362274 None] Lock "cinder-12724b0b-a3b7-43aa-8bce-728790bd2853-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:30 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-1fdd737a-d06b-414b-a91a-418c6de99d11 tempest-VolumeDependencyTests-1974362274 None] Acquiring lock "cinder-quobyte-cff6b113-8f61-4e71-bb0d-b05b298a6486" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:30 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-1fdd737a-d06b-414b-a91a-418c6de99d11 tempest-VolumeDependencyTests-1974362274 None] Lock "cinder-quobyte-cff6b113-8f61-4e71-bb0d-b05b298a6486" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:30 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-1fdd737a-d06b-414b-a91a-418c6de99d11 tempest-VolumeDependencyTests-1974362274 None] Acquiring lock "cinder-quobyte-12724b0b-a3b7-43aa-8bce-728790bd2853" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:30 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-1fdd737a-d06b-414b-a91a-418c6de99d11 tempest-VolumeDependencyTests-1974362274 None] Lock "cinder-quobyte-12724b0b-a3b7-43aa-8bce-728790bd2853" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:30 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-1fdd737a-d06b-414b-a91a-418c6de99d11 tempest-VolumeDependencyTests-1974362274 None] Deleting offline snapshot 12724b0b-a3b7-43aa-8bce-728790bd2853 of volume cff6b113-8f61-4e71-bb0d-b05b298a6486 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:32:30 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-1fdd737a-d06b-414b-a91a-418c6de99d11 tempest-VolumeDependencyTests-1974362274 None] snapshot_file for this snap is: volume-cff6b113-8f61-4e71-bb0d-b05b298a6486.12724b0b-a3b7-43aa-8bce-728790bd2853 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:32:30 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e1e7cc-2012-487f-b0a2-2480d7cc36bf]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1fdd737a-d06b-414b-a91a-418c6de99d11 tempest-VolumeDependencyTests-1974362274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cff6b113-8f61-4e71-bb0d-b05b298a6486.12724b0b-a3b7-43aa-8bce-728790bd2853 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:30 devstack sudo[105492]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8373fce8-e9fd-430d-bdc4-c696dae955de tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1c2d286e-8d91-443c-b618-9fa1c3c978c3" returned: 0 in 0.399s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:30 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-8373fce8-e9fd-430d-bdc4-c696dae955de tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:32:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8373fce8-e9fd-430d-bdc4-c696dae955de tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:30 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8373fce8-e9fd-430d-bdc4-c696dae955de tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8251b69-4245-4954-b93c-11cc878f835b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c2d286e-8d91-443c-b618-9fa1c3c978c3', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:30 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8373fce8-e9fd-430d-bdc4-c696dae955de tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (300cf598-f90d-4bbd-93f1-edb3c17a6a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:30 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-8373fce8-e9fd-430d-bdc4-c696dae955de tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Volume volume-1c2d286e-8d91-443c-b618-9fa1c3c978c3 (1c2d286e-8d91-443c-b618-9fa1c3c978c3): created successfully Sep 23 00:32:30 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8373fce8-e9fd-430d-bdc4-c696dae955de tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (300cf598-f90d-4bbd-93f1-edb3c17a6a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:30 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8373fce8-e9fd-430d-bdc4-c696dae955de tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Flow 'volume_create_manager' (61202ffa-ccb2-493d-b468-a1ba73793963) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:30 devstack sudo[105494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cff6b113-8f61-4e71-bb0d-b05b298a6486.12724b0b-a3b7-43aa-8bce-728790bd2853 Sep 23 00:32:30 devstack sudo[105494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:30 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-8373fce8-e9fd-430d-bdc4-c696dae955de tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Created volume successfully. Sep 23 00:32:31 devstack sudo[105494]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1fdd737a-d06b-414b-a91a-418c6de99d11 tempest-VolumeDependencyTests-1974362274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cff6b113-8f61-4e71-bb0d-b05b298a6486.12724b0b-a3b7-43aa-8bce-728790bd2853" returned: 0 in 0.473s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:31 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-1fdd737a-d06b-414b-a91a-418c6de99d11 tempest-VolumeDependencyTests-1974362274 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cff6b113-8f61-4e71-bb0d-b05b298a6486(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:32:31 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21dbf0b-0524-4b7d-912d-24f0b0670539]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1fdd737a-d06b-414b-a91a-418c6de99d11 tempest-VolumeDependencyTests-1974362274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cff6b113-8f61-4e71-bb0d-b05b298a6486 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:31 devstack sudo[105500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cff6b113-8f61-4e71-bb0d-b05b298a6486 Sep 23 00:32:31 devstack sudo[105500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:31 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-c02b3619-aeb0-4052-ae40-db7bb25731b9 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:32:32 devstack sudo[105500]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c02b3619-aeb0-4052-ae40-db7bb25731b9 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Flow 'volume_create_manager' (b4556a83-89cc-4b31-96d3-3e0c2a82a77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c02b3619-aeb0-4052-ae40-db7bb25731b9 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80aa4d2d-6db6-4cd6-9c4a-a2b02edbc451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1fdd737a-d06b-414b-a91a-418c6de99d11 tempest-VolumeDependencyTests-1974362274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cff6b113-8f61-4e71-bb0d-b05b298a6486" returned: 0 in 0.815s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1fdd737a-d06b-414b-a91a-418c6de99d11 tempest-VolumeDependencyTests-1974362274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cff6b113-8f61-4e71-bb0d-b05b298a6486.12724b0b-a3b7-43aa-8bce-728790bd2853 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c02b3619-aeb0-4052-ae40-db7bb25731b9 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80aa4d2d-6db6-4cd6-9c4a-a2b02edbc451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-561535271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f53af69-80aa-43cd-98e8-2295910fba1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='777565d0809645098f5972ff04b2b9d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:32Z,use_quota=True,user_id='b147d8f530294010be7edfba237d722e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c02b3619-aeb0-4052-ae40-db7bb25731b9 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4c2b8b1-b5ec-4c27-b19c-2c7a9f2d38d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:32 devstack sudo[105506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cff6b113-8f61-4e71-bb0d-b05b298a6486.12724b0b-a3b7-43aa-8bce-728790bd2853 Sep 23 00:32:32 devstack sudo[105506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c02b3619-aeb0-4052-ae40-db7bb25731b9 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4c2b8b1-b5ec-4c27-b19c-2c7a9f2d38d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c02b3619-aeb0-4052-ae40-db7bb25731b9 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b81b1f5-1b01-4812-9c5d-a5c5ff1c3d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c02b3619-aeb0-4052-ae40-db7bb25731b9 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b81b1f5-1b01-4812-9c5d-a5c5ff1c3d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f53af69-80aa-43cd-98e8-2295910fba1a', 'volume_name': 'volume-9f53af69-80aa-43cd-98e8-2295910fba1a', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c02b3619-aeb0-4052-ae40-db7bb25731b9 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (378012b9-7fdf-478e-b49a-4dabcf8fbe32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c02b3619-aeb0-4052-ae40-db7bb25731b9 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (378012b9-7fdf-478e-b49a-4dabcf8fbe32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:32 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c02b3619-aeb0-4052-ae40-db7bb25731b9 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (149a9aff-c1e2-4f23-b953-bc663df570f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:32 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-c02b3619-aeb0-4052-ae40-db7bb25731b9 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Volume 9f53af69-80aa-43cd-98e8-2295910fba1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f53af69-80aa-43cd-98e8-2295910fba1a', 'volume_size': 1} Sep 23 00:32:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c02b3619-aeb0-4052-ae40-db7bb25731b9 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c02b3619-aeb0-4052-ae40-db7bb25731b9 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:32 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c02b3619-aeb0-4052-ae40-db7bb25731b9 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-561535271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f53af69-80aa-43cd-98e8-2295910fba1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='777565d0809645098f5972ff04b2b9d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:32Z,use_quota=True,user_id='b147d8f530294010be7edfba237d722e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:32:32 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-c02b3619-aeb0-4052-ae40-db7bb25731b9 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Creating volume 9f53af69-80aa-43cd-98e8-2295910fba1a {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:32:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c02b3619-aeb0-4052-ae40-db7bb25731b9 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c02b3619-aeb0-4052-ae40-db7bb25731b9 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:32 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c02b3619-aeb0-4052-ae40-db7bb25731b9 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:32 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c02b3619-aeb0-4052-ae40-db7bb25731b9 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c02b3619-aeb0-4052-ae40-db7bb25731b9 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:32 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c02b3619-aeb0-4052-ae40-db7bb25731b9 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:32:32 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-c02b3619-aeb0-4052-ae40-db7bb25731b9 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:32:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c02b3619-aeb0-4052-ae40-db7bb25731b9 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9f53af69-80aa-43cd-98e8-2295910fba1a 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:32 devstack sudo[105508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9f53af69-80aa-43cd-98e8-2295910fba1a 1073741824 Sep 23 00:32:32 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:32 devstack sudo[105506]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1fdd737a-d06b-414b-a91a-418c6de99d11 tempest-VolumeDependencyTests-1974362274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cff6b113-8f61-4e71-bb0d-b05b298a6486.12724b0b-a3b7-43aa-8bce-728790bd2853" returned: 0 in 0.631s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1fdd737a-d06b-414b-a91a-418c6de99d11 tempest-VolumeDependencyTests-1974362274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cff6b113-8f61-4e71-bb0d-b05b298a6486.12724b0b-a3b7-43aa-8bce-728790bd2853 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:32 devstack sudo[105516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cff6b113-8f61-4e71-bb0d-b05b298a6486.12724b0b-a3b7-43aa-8bce-728790bd2853 Sep 23 00:32:32 devstack sudo[105516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:32 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-25aecadc-2d7a-443b-b79d-4aac863d8220 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:32:33 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-25aecadc-2d7a-443b-b79d-4aac863d8220 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Flow 'volume_create_manager' (41298cfc-c360-45c2-b8eb-ab86b7711fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-25aecadc-2d7a-443b-b79d-4aac863d8220 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a1c5162-a0d4-4493-aad7-0d2445561148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c02b3619-aeb0-4052-ae40-db7bb25731b9 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9f53af69-80aa-43cd-98e8-2295910fba1a 1073741824" returned: 0 in 0.882s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-25aecadc-2d7a-443b-b79d-4aac863d8220 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a1c5162-a0d4-4493-aad7-0d2445561148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2061744492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b23afe00-4f52-4042-ad74-7a3ecff37ba4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='777565d0809645098f5972ff04b2b9d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:33Z,use_quota=True,user_id='b147d8f530294010be7edfba237d722e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-25aecadc-2d7a-443b-b79d-4aac863d8220 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1b4533f-8d07-497b-b989-f7a53641b719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-25aecadc-2d7a-443b-b79d-4aac863d8220 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1b4533f-8d07-497b-b989-f7a53641b719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-25aecadc-2d7a-443b-b79d-4aac863d8220 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d41f498b-0af4-4b28-9aa7-78ee3774f6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-25aecadc-2d7a-443b-b79d-4aac863d8220 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d41f498b-0af4-4b28-9aa7-78ee3774f6e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b23afe00-4f52-4042-ad74-7a3ecff37ba4', 'volume_name': 'volume-b23afe00-4f52-4042-ad74-7a3ecff37ba4', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-25aecadc-2d7a-443b-b79d-4aac863d8220 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2ca94d6-f788-4ec0-88a9-f35693f594e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-25aecadc-2d7a-443b-b79d-4aac863d8220 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2ca94d6-f788-4ec0-88a9-f35693f594e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-25aecadc-2d7a-443b-b79d-4aac863d8220 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40b4df00-dd36-4223-b891-94e451b7a814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:33 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-25aecadc-2d7a-443b-b79d-4aac863d8220 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Volume b23afe00-4f52-4042-ad74-7a3ecff37ba4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b23afe00-4f52-4042-ad74-7a3ecff37ba4', 'volume_size': 1} Sep 23 00:32:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-25aecadc-2d7a-443b-b79d-4aac863d8220 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:33 devstack sudo[105516]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1fdd737a-d06b-414b-a91a-418c6de99d11 tempest-VolumeDependencyTests-1974362274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cff6b113-8f61-4e71-bb0d-b05b298a6486.12724b0b-a3b7-43aa-8bce-728790bd2853" returned: 0 in 0.508s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:33 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-1fdd737a-d06b-414b-a91a-418c6de99d11 tempest-VolumeDependencyTests-1974362274 None] Lock "cinder-quobyte-12724b0b-a3b7-43aa-8bce-728790bd2853" released by "_delete_snapshot" :: held 2.608s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c02b3619-aeb0-4052-ae40-db7bb25731b9 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9f53af69-80aa-43cd-98e8-2295910fba1a {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:33 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-1fdd737a-d06b-414b-a91a-418c6de99d11 tempest-VolumeDependencyTests-1974362274 None] Lock "cinder-quobyte-cff6b113-8f61-4e71-bb0d-b05b298a6486" released by "delete_snapshot" :: held 2.670s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:33 devstack sudo[105520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9f53af69-80aa-43cd-98e8-2295910fba1a Sep 23 00:32:33 devstack sudo[105520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:33 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-1fdd737a-d06b-414b-a91a-418c6de99d11 tempest-VolumeDependencyTests-1974362274 None] Created reservations ['45136edf-4e0c-45cd-99de-3c5658e08a12', 'aae78909-69ce-41a6-a437-f5da442a9fcd', '0a68da9d-585b-4c92-aec4-3464bc5e046f', 'ba207365-f2e1-440e-8051-3b0c6ebfdb84'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:33 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5d774f7-71d6-4fc6-a0c1-ed4d2041f1bc tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:32:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c5d774f7-71d6-4fc6-a0c1-ed4d2041f1bc tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Flow 'volume_create_manager' (aba0e743-1b8a-4445-830a-8de93126a17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c5d774f7-71d6-4fc6-a0c1-ed4d2041f1bc tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04362b6a-a4c7-43ba-8dc9-4695a28cabb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c5d774f7-71d6-4fc6-a0c1-ed4d2041f1bc tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04362b6a-a4c7-43ba-8dc9-4695a28cabb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-868190449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fccb400-77c6-4a40-8d3f-e23fa6e72127,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='777565d0809645098f5972ff04b2b9d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:33Z,use_quota=True,user_id='b147d8f530294010be7edfba237d722e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c5d774f7-71d6-4fc6-a0c1-ed4d2041f1bc tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77325a99-b032-4b61-8e13-168deb5702c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c5d774f7-71d6-4fc6-a0c1-ed4d2041f1bc tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77325a99-b032-4b61-8e13-168deb5702c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c5d774f7-71d6-4fc6-a0c1-ed4d2041f1bc tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d6577b0-d41f-42e0-977f-672f8e524fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c5d774f7-71d6-4fc6-a0c1-ed4d2041f1bc tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d6577b0-d41f-42e0-977f-672f8e524fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fccb400-77c6-4a40-8d3f-e23fa6e72127', 'volume_name': 'volume-3fccb400-77c6-4a40-8d3f-e23fa6e72127', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c5d774f7-71d6-4fc6-a0c1-ed4d2041f1bc tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e10066b-756d-4353-b97e-db689e92661a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c5d774f7-71d6-4fc6-a0c1-ed4d2041f1bc tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e10066b-756d-4353-b97e-db689e92661a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c5d774f7-71d6-4fc6-a0c1-ed4d2041f1bc tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6e2ab6d-c1da-4b78-b7ac-bbd0fa6ce281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:33 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-c5d774f7-71d6-4fc6-a0c1-ed4d2041f1bc tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Volume 3fccb400-77c6-4a40-8d3f-e23fa6e72127: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fccb400-77c6-4a40-8d3f-e23fa6e72127', 'volume_size': 1} Sep 23 00:32:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c5d774f7-71d6-4fc6-a0c1-ed4d2041f1bc tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:33 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-1fdd737a-d06b-414b-a91a-418c6de99d11 tempest-VolumeDependencyTests-1974362274 None] Delete snapshot completed successfully. Sep 23 00:32:33 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-1fdd737a-d06b-414b-a91a-418c6de99d11 tempest-VolumeDependencyTests-1974362274 None] Lock "cinder-12724b0b-a3b7-43aa-8bce-728790bd2853-delete_snapshot" released by "delete_snapshot" :: held 3.134s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:33 devstack sudo[105520]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c02b3619-aeb0-4052-ae40-db7bb25731b9 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9f53af69-80aa-43cd-98e8-2295910fba1a" returned: 0 in 0.513s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:33 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c02b3619-aeb0-4052-ae40-db7bb25731b9 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] <== create_volume: return (1637ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:32:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c02b3619-aeb0-4052-ae40-db7bb25731b9 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.646s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-25aecadc-2d7a-443b-b79d-4aac863d8220 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.628s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:33 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-25aecadc-2d7a-443b-b79d-4aac863d8220 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2061744492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b23afe00-4f52-4042-ad74-7a3ecff37ba4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='777565d0809645098f5972ff04b2b9d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:33Z,use_quota=True,user_id='b147d8f530294010be7edfba237d722e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:32:33 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-25aecadc-2d7a-443b-b79d-4aac863d8220 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Creating volume b23afe00-4f52-4042-ad74-7a3ecff37ba4 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:32:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-25aecadc-2d7a-443b-b79d-4aac863d8220 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-25aecadc-2d7a-443b-b79d-4aac863d8220 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:33 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-25aecadc-2d7a-443b-b79d-4aac863d8220 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:33 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-25aecadc-2d7a-443b-b79d-4aac863d8220 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-25aecadc-2d7a-443b-b79d-4aac863d8220 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:33 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-25aecadc-2d7a-443b-b79d-4aac863d8220 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:32:33 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-25aecadc-2d7a-443b-b79d-4aac863d8220 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:32:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-25aecadc-2d7a-443b-b79d-4aac863d8220 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b23afe00-4f52-4042-ad74-7a3ecff37ba4 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:33 devstack sudo[105523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b23afe00-4f52-4042-ad74-7a3ecff37ba4 1073741824 Sep 23 00:32:33 devstack sudo[105523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c02b3619-aeb0-4052-ae40-db7bb25731b9 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (149a9aff-c1e2-4f23-b953-bc663df570f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f53af69-80aa-43cd-98e8-2295910fba1a', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c02b3619-aeb0-4052-ae40-db7bb25731b9 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (354e5ffe-ea49-4597-8312-84aaa6d7fd92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:33 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-c02b3619-aeb0-4052-ae40-db7bb25731b9 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Volume volume-9f53af69-80aa-43cd-98e8-2295910fba1a (9f53af69-80aa-43cd-98e8-2295910fba1a): created successfully Sep 23 00:32:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c02b3619-aeb0-4052-ae40-db7bb25731b9 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (354e5ffe-ea49-4597-8312-84aaa6d7fd92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:33 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c02b3619-aeb0-4052-ae40-db7bb25731b9 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Flow 'volume_create_manager' (b4556a83-89cc-4b31-96d3-3e0c2a82a77b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:33 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-c02b3619-aeb0-4052-ae40-db7bb25731b9 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Created volume successfully. Sep 23 00:32:34 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-3461cf2c-f679-4a8b-b101-9e1b17579a48 tempest-VolumeDependencyTests-1974362274 None] Acquiring lock "cinder-cff6b113-8f61-4e71-bb0d-b05b298a6486-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:34 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-3461cf2c-f679-4a8b-b101-9e1b17579a48 tempest-VolumeDependencyTests-1974362274 None] Lock "cinder-cff6b113-8f61-4e71-bb0d-b05b298a6486-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:34 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-3461cf2c-f679-4a8b-b101-9e1b17579a48 tempest-VolumeDependencyTests-1974362274 None] Acquiring lock "cinder-quobyte-cff6b113-8f61-4e71-bb0d-b05b298a6486" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:34 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-3461cf2c-f679-4a8b-b101-9e1b17579a48 tempest-VolumeDependencyTests-1974362274 None] Lock "cinder-quobyte-cff6b113-8f61-4e71-bb0d-b05b298a6486" acquired by "delete_volume" :: waited 0.043s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:34 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ddfbf5-13ca-4657-b0e4-c3352ea43caa]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3461cf2c-f679-4a8b-b101-9e1b17579a48 tempest-VolumeDependencyTests-1974362274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cff6b113-8f61-4e71-bb0d-b05b298a6486 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:34 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ea7041d-0703-4899-88a5-2dcc95a3bc74 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:32:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7ea7041d-0703-4899-88a5-2dcc95a3bc74 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Flow 'volume_create_manager' (b999f9d8-0e50-44a4-833c-8fce9177425d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7ea7041d-0703-4899-88a5-2dcc95a3bc74 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0b8ff92-3c23-438b-8a2c-326467f51986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7ea7041d-0703-4899-88a5-2dcc95a3bc74 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0b8ff92-3c23-438b-8a2c-326467f51986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-717158671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0a6c189-1fc4-471e-b9cf-c517cefa9866,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='777565d0809645098f5972ff04b2b9d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:34Z,use_quota=True,user_id='b147d8f530294010be7edfba237d722e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7ea7041d-0703-4899-88a5-2dcc95a3bc74 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90488bc4-b113-46c4-8c0c-810d853629fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7ea7041d-0703-4899-88a5-2dcc95a3bc74 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90488bc4-b113-46c4-8c0c-810d853629fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7ea7041d-0703-4899-88a5-2dcc95a3bc74 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (233f12e0-c608-48dc-8da0-e30ba7a995c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7ea7041d-0703-4899-88a5-2dcc95a3bc74 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (233f12e0-c608-48dc-8da0-e30ba7a995c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0a6c189-1fc4-471e-b9cf-c517cefa9866', 'volume_name': 'volume-a0a6c189-1fc4-471e-b9cf-c517cefa9866', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7ea7041d-0703-4899-88a5-2dcc95a3bc74 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16e2154f-abd6-42fb-b762-ecd574d21900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7ea7041d-0703-4899-88a5-2dcc95a3bc74 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16e2154f-abd6-42fb-b762-ecd574d21900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:34 devstack sudo[105528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cff6b113-8f61-4e71-bb0d-b05b298a6486 Sep 23 00:32:34 devstack sudo[105528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:34 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7ea7041d-0703-4899-88a5-2dcc95a3bc74 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61458493-2d5b-4e09-a488-089da2254f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:34 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-7ea7041d-0703-4899-88a5-2dcc95a3bc74 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Volume a0a6c189-1fc4-471e-b9cf-c517cefa9866: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0a6c189-1fc4-471e-b9cf-c517cefa9866', 'volume_size': 1} Sep 23 00:32:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7ea7041d-0703-4899-88a5-2dcc95a3bc74 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:34 devstack sudo[105523]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-25aecadc-2d7a-443b-b79d-4aac863d8220 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b23afe00-4f52-4042-ad74-7a3ecff37ba4 1073741824" returned: 0 in 0.753s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-25aecadc-2d7a-443b-b79d-4aac863d8220 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b23afe00-4f52-4042-ad74-7a3ecff37ba4 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:34 devstack sudo[105531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b23afe00-4f52-4042-ad74-7a3ecff37ba4 Sep 23 00:32:34 devstack sudo[105531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:35 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-afd83346-3930-4533-bba0-3b5edfe92075 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:32:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-afd83346-3930-4533-bba0-3b5edfe92075 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Flow 'volume_create_manager' (efc12e04-8ee3-4eb4-896a-4760a5c6baf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-afd83346-3930-4533-bba0-3b5edfe92075 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bafdc65c-949e-41b0-9e4c-75d927d4e849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-afd83346-3930-4533-bba0-3b5edfe92075 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bafdc65c-949e-41b0-9e4c-75d927d4e849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-836788926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c53601f8-798f-4aa1-ad94-27eb78a9ea42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='777565d0809645098f5972ff04b2b9d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:35Z,use_quota=True,user_id='b147d8f530294010be7edfba237d722e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-afd83346-3930-4533-bba0-3b5edfe92075 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ac32a30-c5e3-4b13-9d72-dee4909de077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-afd83346-3930-4533-bba0-3b5edfe92075 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ac32a30-c5e3-4b13-9d72-dee4909de077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-afd83346-3930-4533-bba0-3b5edfe92075 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ca9f474-7160-43a0-96a4-8c5087cc38b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-afd83346-3930-4533-bba0-3b5edfe92075 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ca9f474-7160-43a0-96a4-8c5087cc38b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c53601f8-798f-4aa1-ad94-27eb78a9ea42', 'volume_name': 'volume-c53601f8-798f-4aa1-ad94-27eb78a9ea42', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-afd83346-3930-4533-bba0-3b5edfe92075 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61e35cd4-830f-4334-9b03-62aa8273a50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-afd83346-3930-4533-bba0-3b5edfe92075 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61e35cd4-830f-4334-9b03-62aa8273a50e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-afd83346-3930-4533-bba0-3b5edfe92075 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67562d41-a0b7-4ff9-b419-59209fa211b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:35 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-afd83346-3930-4533-bba0-3b5edfe92075 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Volume c53601f8-798f-4aa1-ad94-27eb78a9ea42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c53601f8-798f-4aa1-ad94-27eb78a9ea42', 'volume_size': 1} Sep 23 00:32:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-afd83346-3930-4533-bba0-3b5edfe92075 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:35 devstack sudo[105528]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3461cf2c-f679-4a8b-b101-9e1b17579a48 tempest-VolumeDependencyTests-1974362274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cff6b113-8f61-4e71-bb0d-b05b298a6486" returned: 0 in 0.850s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3461cf2c-f679-4a8b-b101-9e1b17579a48 tempest-VolumeDependencyTests-1974362274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cff6b113-8f61-4e71-bb0d-b05b298a6486 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:35 devstack sudo[105539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cff6b113-8f61-4e71-bb0d-b05b298a6486 Sep 23 00:32:35 devstack sudo[105539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:35 devstack sudo[105531]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-25aecadc-2d7a-443b-b79d-4aac863d8220 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b23afe00-4f52-4042-ad74-7a3ecff37ba4" returned: 0 in 0.539s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:35 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-25aecadc-2d7a-443b-b79d-4aac863d8220 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] <== create_volume: return (1390ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:32:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-25aecadc-2d7a-443b-b79d-4aac863d8220 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.398s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c5d774f7-71d6-4fc6-a0c1-ed4d2041f1bc tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.524s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:35 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c5d774f7-71d6-4fc6-a0c1-ed4d2041f1bc tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-868190449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fccb400-77c6-4a40-8d3f-e23fa6e72127,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='777565d0809645098f5972ff04b2b9d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:33Z,use_quota=True,user_id='b147d8f530294010be7edfba237d722e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:32:35 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-c5d774f7-71d6-4fc6-a0c1-ed4d2041f1bc tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Creating volume 3fccb400-77c6-4a40-8d3f-e23fa6e72127 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:32:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c5d774f7-71d6-4fc6-a0c1-ed4d2041f1bc tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c5d774f7-71d6-4fc6-a0c1-ed4d2041f1bc tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:35 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c5d774f7-71d6-4fc6-a0c1-ed4d2041f1bc tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:35 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c5d774f7-71d6-4fc6-a0c1-ed4d2041f1bc tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c5d774f7-71d6-4fc6-a0c1-ed4d2041f1bc tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:35 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c5d774f7-71d6-4fc6-a0c1-ed4d2041f1bc tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:32:35 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-c5d774f7-71d6-4fc6-a0c1-ed4d2041f1bc tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:32:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c5d774f7-71d6-4fc6-a0c1-ed4d2041f1bc tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fccb400-77c6-4a40-8d3f-e23fa6e72127 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-25aecadc-2d7a-443b-b79d-4aac863d8220 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40b4df00-dd36-4223-b891-94e451b7a814) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b23afe00-4f52-4042-ad74-7a3ecff37ba4', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-25aecadc-2d7a-443b-b79d-4aac863d8220 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86a494b4-1d31-48f1-a72c-bd423a59f7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:35 devstack sudo[105541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fccb400-77c6-4a40-8d3f-e23fa6e72127 1073741824 Sep 23 00:32:35 devstack sudo[105541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:35 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-25aecadc-2d7a-443b-b79d-4aac863d8220 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Volume volume-b23afe00-4f52-4042-ad74-7a3ecff37ba4 (b23afe00-4f52-4042-ad74-7a3ecff37ba4): created successfully Sep 23 00:32:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-25aecadc-2d7a-443b-b79d-4aac863d8220 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86a494b4-1d31-48f1-a72c-bd423a59f7b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:35 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-25aecadc-2d7a-443b-b79d-4aac863d8220 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Flow 'volume_create_manager' (41298cfc-c360-45c2-b8eb-ab86b7711fe2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:35 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-25aecadc-2d7a-443b-b79d-4aac863d8220 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Created volume successfully. Sep 23 00:32:35 devstack sudo[105539]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3461cf2c-f679-4a8b-b101-9e1b17579a48 tempest-VolumeDependencyTests-1974362274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-cff6b113-8f61-4e71-bb0d-b05b298a6486" returned: 0 in 0.378s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:35 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-3461cf2c-f679-4a8b-b101-9e1b17579a48 tempest-VolumeDependencyTests-1974362274 None] Lock "cinder-quobyte-cff6b113-8f61-4e71-bb0d-b05b298a6486" released by "delete_volume" :: held 1.331s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:35 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-3461cf2c-f679-4a8b-b101-9e1b17579a48 tempest-VolumeDependencyTests-1974362274 None] Created reservations ['0f35f7b1-224a-4f6e-9020-d049621ad743', 'f1fbc920-b459-45eb-9a97-da0f6b8a7a4d', 'ae84bdda-1fc3-4ce1-8430-0243bb97a666', 'd1679ffe-5551-46e5-a91a-86fa4cfac842'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-3461cf2c-f679-4a8b-b101-9e1b17579a48 tempest-VolumeDependencyTests-1974362274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-3461cf2c-f679-4a8b-b101-9e1b17579a48 tempest-VolumeDependencyTests-1974362274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:35 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-3461cf2c-f679-4a8b-b101-9e1b17579a48 tempest-VolumeDependencyTests-1974362274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:35 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-3461cf2c-f679-4a8b-b101-9e1b17579a48 tempest-VolumeDependencyTests-1974362274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-3461cf2c-f679-4a8b-b101-9e1b17579a48 tempest-VolumeDependencyTests-1974362274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3461cf2c-f679-4a8b-b101-9e1b17579a48 tempest-VolumeDependencyTests-1974362274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:35 devstack sudo[105550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:32:35 devstack sudo[105550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:35 devstack sudo[105541]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c5d774f7-71d6-4fc6-a0c1-ed4d2041f1bc tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fccb400-77c6-4a40-8d3f-e23fa6e72127 1073741824" returned: 0 in 0.765s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c5d774f7-71d6-4fc6-a0c1-ed4d2041f1bc tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fccb400-77c6-4a40-8d3f-e23fa6e72127 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:36 devstack sudo[105552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fccb400-77c6-4a40-8d3f-e23fa6e72127 Sep 23 00:32:36 devstack sudo[105552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:36 devstack sudo[105550]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3461cf2c-f679-4a8b-b101-9e1b17579a48 tempest-VolumeDependencyTests-1974362274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.366s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:36 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-3461cf2c-f679-4a8b-b101-9e1b17579a48 tempest-VolumeDependencyTests-1974362274 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:36 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-3461cf2c-f679-4a8b-b101-9e1b17579a48 tempest-VolumeDependencyTests-1974362274 None] Deleted volume successfully. Sep 23 00:32:36 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-3461cf2c-f679-4a8b-b101-9e1b17579a48 tempest-VolumeDependencyTests-1974362274 None] Lock "cinder-cff6b113-8f61-4e71-bb0d-b05b298a6486-delete_volume" released by "delete_volume" :: held 2.150s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:36 devstack sudo[105552]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c5d774f7-71d6-4fc6-a0c1-ed4d2041f1bc tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fccb400-77c6-4a40-8d3f-e23fa6e72127" returned: 0 in 0.331s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:36 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-c5d774f7-71d6-4fc6-a0c1-ed4d2041f1bc tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] <== create_volume: return (1173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:32:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-c5d774f7-71d6-4fc6-a0c1-ed4d2041f1bc tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.179s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7ea7041d-0703-4899-88a5-2dcc95a3bc74 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.850s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:36 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7ea7041d-0703-4899-88a5-2dcc95a3bc74 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-717158671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0a6c189-1fc4-471e-b9cf-c517cefa9866,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='777565d0809645098f5972ff04b2b9d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:34Z,use_quota=True,user_id='b147d8f530294010be7edfba237d722e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:32:36 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-7ea7041d-0703-4899-88a5-2dcc95a3bc74 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Creating volume a0a6c189-1fc4-471e-b9cf-c517cefa9866 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:32:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7ea7041d-0703-4899-88a5-2dcc95a3bc74 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7ea7041d-0703-4899-88a5-2dcc95a3bc74 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:36 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7ea7041d-0703-4899-88a5-2dcc95a3bc74 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:36 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7ea7041d-0703-4899-88a5-2dcc95a3bc74 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7ea7041d-0703-4899-88a5-2dcc95a3bc74 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:36 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7ea7041d-0703-4899-88a5-2dcc95a3bc74 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:32:36 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-7ea7041d-0703-4899-88a5-2dcc95a3bc74 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:32:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7ea7041d-0703-4899-88a5-2dcc95a3bc74 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a0a6c189-1fc4-471e-b9cf-c517cefa9866 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c5d774f7-71d6-4fc6-a0c1-ed4d2041f1bc tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6e2ab6d-c1da-4b78-b7ac-bbd0fa6ce281) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fccb400-77c6-4a40-8d3f-e23fa6e72127', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:36 devstack sudo[105556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a0a6c189-1fc4-471e-b9cf-c517cefa9866 1073741824 Sep 23 00:32:36 devstack sudo[105556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c5d774f7-71d6-4fc6-a0c1-ed4d2041f1bc tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (283a74ef-0d96-4b44-930a-773071532be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:36 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-c5d774f7-71d6-4fc6-a0c1-ed4d2041f1bc tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Volume volume-3fccb400-77c6-4a40-8d3f-e23fa6e72127 (3fccb400-77c6-4a40-8d3f-e23fa6e72127): created successfully Sep 23 00:32:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c5d774f7-71d6-4fc6-a0c1-ed4d2041f1bc tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (283a74ef-0d96-4b44-930a-773071532be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-c5d774f7-71d6-4fc6-a0c1-ed4d2041f1bc tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Flow 'volume_create_manager' (aba0e743-1b8a-4445-830a-8de93126a17d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:36 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4d8e8baf-a9e9-4a1f-886e-fb5010910810 tempest-VolumeDependencyTests-1974362274 None] Acquiring lock "cinder-173f652c-2f3a-44ee-80da-a687d98151d8-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:36 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-c5d774f7-71d6-4fc6-a0c1-ed4d2041f1bc tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Created volume successfully. Sep 23 00:32:36 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4d8e8baf-a9e9-4a1f-886e-fb5010910810 tempest-VolumeDependencyTests-1974362274 None] Lock "cinder-173f652c-2f3a-44ee-80da-a687d98151d8-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:36 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4d8e8baf-a9e9-4a1f-886e-fb5010910810 tempest-VolumeDependencyTests-1974362274 None] Acquiring lock "cinder-quobyte-173f652c-2f3a-44ee-80da-a687d98151d8" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:36 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4d8e8baf-a9e9-4a1f-886e-fb5010910810 tempest-VolumeDependencyTests-1974362274 None] Lock "cinder-quobyte-173f652c-2f3a-44ee-80da-a687d98151d8" acquired by "delete_volume" :: waited 0.034s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:36 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d0855d-cd07-4eb7-8ba7-07a240430bc2]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4d8e8baf-a9e9-4a1f-886e-fb5010910810 tempest-VolumeDependencyTests-1974362274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-173f652c-2f3a-44ee-80da-a687d98151d8 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:36 devstack sudo[105558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-173f652c-2f3a-44ee-80da-a687d98151d8 Sep 23 00:32:36 devstack sudo[105558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:37 devstack sudo[105556]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7ea7041d-0703-4899-88a5-2dcc95a3bc74 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a0a6c189-1fc4-471e-b9cf-c517cefa9866 1073741824" returned: 0 in 0.599s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7ea7041d-0703-4899-88a5-2dcc95a3bc74 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a0a6c189-1fc4-471e-b9cf-c517cefa9866 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:37 devstack sudo[105564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a0a6c189-1fc4-471e-b9cf-c517cefa9866 Sep 23 00:32:37 devstack sudo[105564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:37 devstack sudo[105558]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4d8e8baf-a9e9-4a1f-886e-fb5010910810 tempest-VolumeDependencyTests-1974362274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-173f652c-2f3a-44ee-80da-a687d98151d8" returned: 0 in 0.513s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4d8e8baf-a9e9-4a1f-886e-fb5010910810 tempest-VolumeDependencyTests-1974362274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-173f652c-2f3a-44ee-80da-a687d98151d8 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:37 devstack sudo[105570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-173f652c-2f3a-44ee-80da-a687d98151d8 Sep 23 00:32:37 devstack sudo[105570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:37 devstack sudo[105564]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7ea7041d-0703-4899-88a5-2dcc95a3bc74 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a0a6c189-1fc4-471e-b9cf-c517cefa9866" returned: 0 in 0.369s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7ea7041d-0703-4899-88a5-2dcc95a3bc74 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:32:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7ea7041d-0703-4899-88a5-2dcc95a3bc74 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-afd83346-3930-4533-bba0-3b5edfe92075 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.294s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-afd83346-3930-4533-bba0-3b5edfe92075 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-836788926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c53601f8-798f-4aa1-ad94-27eb78a9ea42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='777565d0809645098f5972ff04b2b9d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:35Z,use_quota=True,user_id='b147d8f530294010be7edfba237d722e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:32:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-afd83346-3930-4533-bba0-3b5edfe92075 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Creating volume c53601f8-798f-4aa1-ad94-27eb78a9ea42 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:32:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-afd83346-3930-4533-bba0-3b5edfe92075 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-afd83346-3930-4533-bba0-3b5edfe92075 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-afd83346-3930-4533-bba0-3b5edfe92075 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-afd83346-3930-4533-bba0-3b5edfe92075 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-afd83346-3930-4533-bba0-3b5edfe92075 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-afd83346-3930-4533-bba0-3b5edfe92075 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:32:37 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-afd83346-3930-4533-bba0-3b5edfe92075 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:32:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-afd83346-3930-4533-bba0-3b5edfe92075 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c53601f8-798f-4aa1-ad94-27eb78a9ea42 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:37 devstack sudo[105574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c53601f8-798f-4aa1-ad94-27eb78a9ea42 1073741824 Sep 23 00:32:37 devstack sudo[105574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7ea7041d-0703-4899-88a5-2dcc95a3bc74 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61458493-2d5b-4e09-a488-089da2254f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0a6c189-1fc4-471e-b9cf-c517cefa9866', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7ea7041d-0703-4899-88a5-2dcc95a3bc74 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64e49cd9-f0c7-4c82-8506-d96372251f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:37 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-7ea7041d-0703-4899-88a5-2dcc95a3bc74 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Volume volume-a0a6c189-1fc4-471e-b9cf-c517cefa9866 (a0a6c189-1fc4-471e-b9cf-c517cefa9866): created successfully Sep 23 00:32:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7ea7041d-0703-4899-88a5-2dcc95a3bc74 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64e49cd9-f0c7-4c82-8506-d96372251f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7ea7041d-0703-4899-88a5-2dcc95a3bc74 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Flow 'volume_create_manager' (b999f9d8-0e50-44a4-833c-8fce9177425d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:37 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-7ea7041d-0703-4899-88a5-2dcc95a3bc74 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Created volume successfully. Sep 23 00:32:37 devstack sudo[105570]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4d8e8baf-a9e9-4a1f-886e-fb5010910810 tempest-VolumeDependencyTests-1974362274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-173f652c-2f3a-44ee-80da-a687d98151d8" returned: 0 in 0.379s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:37 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4d8e8baf-a9e9-4a1f-886e-fb5010910810 tempest-VolumeDependencyTests-1974362274 None] Lock "cinder-quobyte-173f652c-2f3a-44ee-80da-a687d98151d8" released by "delete_volume" :: held 1.005s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:37 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-4d8e8baf-a9e9-4a1f-886e-fb5010910810 tempest-VolumeDependencyTests-1974362274 None] Created reservations ['31aae627-a768-4ae1-8e4d-5e23531913f0', 'b3b99f04-ac47-4c45-9d58-ac6a77231ea7', 'f8936d81-bc8d-4523-bafc-53ee0b5dd445', 'd215b801-0ef6-4a6e-bd95-dd07387b0e22'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4d8e8baf-a9e9-4a1f-886e-fb5010910810 tempest-VolumeDependencyTests-1974362274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4d8e8baf-a9e9-4a1f-886e-fb5010910810 tempest-VolumeDependencyTests-1974362274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4d8e8baf-a9e9-4a1f-886e-fb5010910810 tempest-VolumeDependencyTests-1974362274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4d8e8baf-a9e9-4a1f-886e-fb5010910810 tempest-VolumeDependencyTests-1974362274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4d8e8baf-a9e9-4a1f-886e-fb5010910810 tempest-VolumeDependencyTests-1974362274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4d8e8baf-a9e9-4a1f-886e-fb5010910810 tempest-VolumeDependencyTests-1974362274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:37 devstack sudo[105577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:32:37 devstack sudo[105577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:38 devstack sudo[105574]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-afd83346-3930-4533-bba0-3b5edfe92075 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c53601f8-798f-4aa1-ad94-27eb78a9ea42 1073741824" returned: 0 in 0.770s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:38 devstack sudo[105577]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4d8e8baf-a9e9-4a1f-886e-fb5010910810 tempest-VolumeDependencyTests-1974362274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.418s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:38 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-4d8e8baf-a9e9-4a1f-886e-fb5010910810 tempest-VolumeDependencyTests-1974362274 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:38 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-4d8e8baf-a9e9-4a1f-886e-fb5010910810 tempest-VolumeDependencyTests-1974362274 None] Deleted volume successfully. Sep 23 00:32:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-afd83346-3930-4533-bba0-3b5edfe92075 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c53601f8-798f-4aa1-ad94-27eb78a9ea42 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:38 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4d8e8baf-a9e9-4a1f-886e-fb5010910810 tempest-VolumeDependencyTests-1974362274 None] Lock "cinder-173f652c-2f3a-44ee-80da-a687d98151d8-delete_volume" released by "delete_volume" :: held 1.774s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:38 devstack sudo[105584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c53601f8-798f-4aa1-ad94-27eb78a9ea42 Sep 23 00:32:38 devstack sudo[105584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:38 devstack sudo[105584]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-afd83346-3930-4533-bba0-3b5edfe92075 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c53601f8-798f-4aa1-ad94-27eb78a9ea42" returned: 0 in 0.406s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:38 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-afd83346-3930-4533-bba0-3b5edfe92075 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] <== create_volume: return (1263ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:32:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-afd83346-3930-4533-bba0-3b5edfe92075 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.267s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:38 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-afd83346-3930-4533-bba0-3b5edfe92075 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67562d41-a0b7-4ff9-b419-59209fa211b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c53601f8-798f-4aa1-ad94-27eb78a9ea42', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:38 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-afd83346-3930-4533-bba0-3b5edfe92075 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48220999-0624-4fb3-852d-8a9804393489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:38 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-afd83346-3930-4533-bba0-3b5edfe92075 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Volume volume-c53601f8-798f-4aa1-ad94-27eb78a9ea42 (c53601f8-798f-4aa1-ad94-27eb78a9ea42): created successfully Sep 23 00:32:38 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-afd83346-3930-4533-bba0-3b5edfe92075 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48220999-0624-4fb3-852d-8a9804393489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:38 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-afd83346-3930-4533-bba0-3b5edfe92075 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Flow 'volume_create_manager' (efc12e04-8ee3-4eb4-896a-4760a5c6baf5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:38 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-afd83346-3930-4533-bba0-3b5edfe92075 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Created volume successfully. Sep 23 00:32:39 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-88c44bec-8aae-4af3-b983-6180c28f9206 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Acquiring lock "cinder-c53601f8-798f-4aa1-ad94-27eb78a9ea42-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:39 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-88c44bec-8aae-4af3-b983-6180c28f9206 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Lock "cinder-c53601f8-798f-4aa1-ad94-27eb78a9ea42-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:39 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:UPDATE=226,cinder:SELECT=169,cinder:DELETE=23,cinder:INSERT=61 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:32:39 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-88c44bec-8aae-4af3-b983-6180c28f9206 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Acquiring lock "cinder-quobyte-c53601f8-798f-4aa1-ad94-27eb78a9ea42" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:40 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-88c44bec-8aae-4af3-b983-6180c28f9206 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Lock "cinder-quobyte-c53601f8-798f-4aa1-ad94-27eb78a9ea42" acquired by "delete_volume" :: waited 0.021s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:40 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5e156a-6a29-48b4-af8e-278875f339ef]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-88c44bec-8aae-4af3-b983-6180c28f9206 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c53601f8-798f-4aa1-ad94-27eb78a9ea42 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:40 devstack sudo[105587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c53601f8-798f-4aa1-ad94-27eb78a9ea42 Sep 23 00:32:40 devstack sudo[105587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:40 devstack sudo[105587]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-88c44bec-8aae-4af3-b983-6180c28f9206 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c53601f8-798f-4aa1-ad94-27eb78a9ea42" returned: 0 in 0.544s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-88c44bec-8aae-4af3-b983-6180c28f9206 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c53601f8-798f-4aa1-ad94-27eb78a9ea42 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:40 devstack sudo[105593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c53601f8-798f-4aa1-ad94-27eb78a9ea42 Sep 23 00:32:40 devstack sudo[105593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:40 devstack sudo[105593]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-88c44bec-8aae-4af3-b983-6180c28f9206 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c53601f8-798f-4aa1-ad94-27eb78a9ea42" returned: 0 in 0.361s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:40 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-88c44bec-8aae-4af3-b983-6180c28f9206 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Lock "cinder-quobyte-c53601f8-798f-4aa1-ad94-27eb78a9ea42" released by "delete_volume" :: held 0.963s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:40 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=176,cinder:UPDATE=233,cinder:INSERT=64,cinder:DELETE=20 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:32:41 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-88c44bec-8aae-4af3-b983-6180c28f9206 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Created reservations ['5921ac88-14f3-4a60-bcc0-30fa75f6bcfe', '8731687e-be5d-4347-97ef-dffedaf31816', 'c549d911-888f-4641-a5fb-9a238baf1c77', 'c35e5974-c8a3-4f6b-8551-c7e4238c80f6'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-88c44bec-8aae-4af3-b983-6180c28f9206 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-88c44bec-8aae-4af3-b983-6180c28f9206 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-88c44bec-8aae-4af3-b983-6180c28f9206 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-88c44bec-8aae-4af3-b983-6180c28f9206 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-88c44bec-8aae-4af3-b983-6180c28f9206 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-88c44bec-8aae-4af3-b983-6180c28f9206 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:41 devstack sudo[105596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:32:41 devstack sudo[105596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:41 devstack sudo[105596]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-88c44bec-8aae-4af3-b983-6180c28f9206 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.436s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:41 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-88c44bec-8aae-4af3-b983-6180c28f9206 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:41 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-88c44bec-8aae-4af3-b983-6180c28f9206 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Deleted volume successfully. Sep 23 00:32:41 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-88c44bec-8aae-4af3-b983-6180c28f9206 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Lock "cinder-c53601f8-798f-4aa1-ad94-27eb78a9ea42-delete_volume" released by "delete_volume" :: held 1.804s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:42 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-67a335ce-6b97-4c00-ab72-e883eeb41ddc tempest-ProjectMemberTests-2104250010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:32:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-67a335ce-6b97-4c00-ab72-e883eeb41ddc tempest-ProjectMemberTests-2104250010 None] Flow 'volume_create_manager' (a861dce9-c51c-4dbb-b053-dca7148c65b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-67a335ce-6b97-4c00-ab72-e883eeb41ddc tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a59bfdb5-ac74-4fc5-ab69-d2c619151629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-67a335ce-6b97-4c00-ab72-e883eeb41ddc tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a59bfdb5-ac74-4fc5-ab69-d2c619151629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-624790240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dae52d1-ae8a-4125-8cd9-5b71677106af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='105e2fcb253445d18a9a36e4adbf6662',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:42Z,use_quota=True,user_id='6f62c0bf87c2488e987066aaecad1a03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-67a335ce-6b97-4c00-ab72-e883eeb41ddc tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57156b72-5536-4d3d-8fea-181518c48d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-67a335ce-6b97-4c00-ab72-e883eeb41ddc tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57156b72-5536-4d3d-8fea-181518c48d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-67a335ce-6b97-4c00-ab72-e883eeb41ddc tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb3f103e-8772-4467-815c-32aaf67d4089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-67a335ce-6b97-4c00-ab72-e883eeb41ddc tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb3f103e-8772-4467-815c-32aaf67d4089) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dae52d1-ae8a-4125-8cd9-5b71677106af', 'volume_name': 'volume-8dae52d1-ae8a-4125-8cd9-5b71677106af', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-67a335ce-6b97-4c00-ab72-e883eeb41ddc tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c2b20f9-b954-4638-ba1d-b87f63536a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-67a335ce-6b97-4c00-ab72-e883eeb41ddc tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c2b20f9-b954-4638-ba1d-b87f63536a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-67a335ce-6b97-4c00-ab72-e883eeb41ddc tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68ac4144-56af-4dbb-aedc-56d07dcd1a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:42 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-67a335ce-6b97-4c00-ab72-e883eeb41ddc tempest-ProjectMemberTests-2104250010 None] Volume 8dae52d1-ae8a-4125-8cd9-5b71677106af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dae52d1-ae8a-4125-8cd9-5b71677106af', 'volume_size': 1} Sep 23 00:32:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-67a335ce-6b97-4c00-ab72-e883eeb41ddc tempest-ProjectMemberTests-2104250010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-67a335ce-6b97-4c00-ab72-e883eeb41ddc tempest-ProjectMemberTests-2104250010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-67a335ce-6b97-4c00-ab72-e883eeb41ddc tempest-ProjectMemberTests-2104250010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-624790240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dae52d1-ae8a-4125-8cd9-5b71677106af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='105e2fcb253445d18a9a36e4adbf6662',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:42Z,use_quota=True,user_id='6f62c0bf87c2488e987066aaecad1a03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:32:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-67a335ce-6b97-4c00-ab72-e883eeb41ddc tempest-ProjectMemberTests-2104250010 None] Creating volume 8dae52d1-ae8a-4125-8cd9-5b71677106af {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:32:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-67a335ce-6b97-4c00-ab72-e883eeb41ddc tempest-ProjectMemberTests-2104250010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-67a335ce-6b97-4c00-ab72-e883eeb41ddc tempest-ProjectMemberTests-2104250010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-67a335ce-6b97-4c00-ab72-e883eeb41ddc tempest-ProjectMemberTests-2104250010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-67a335ce-6b97-4c00-ab72-e883eeb41ddc tempest-ProjectMemberTests-2104250010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-67a335ce-6b97-4c00-ab72-e883eeb41ddc tempest-ProjectMemberTests-2104250010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-67a335ce-6b97-4c00-ab72-e883eeb41ddc tempest-ProjectMemberTests-2104250010 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:32:42 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-67a335ce-6b97-4c00-ab72-e883eeb41ddc tempest-ProjectMemberTests-2104250010 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:32:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-67a335ce-6b97-4c00-ab72-e883eeb41ddc tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dae52d1-ae8a-4125-8cd9-5b71677106af 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:42 devstack sudo[105599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dae52d1-ae8a-4125-8cd9-5b71677106af 1073741824 Sep 23 00:32:42 devstack sudo[105599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:42 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-23dfc765-c80f-43a9-98c0-eeded0bbc169 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Acquiring lock "cinder-a0a6c189-1fc4-471e-b9cf-c517cefa9866-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:42 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-23dfc765-c80f-43a9-98c0-eeded0bbc169 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Lock "cinder-a0a6c189-1fc4-471e-b9cf-c517cefa9866-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:42 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-23dfc765-c80f-43a9-98c0-eeded0bbc169 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Acquiring lock "cinder-quobyte-a0a6c189-1fc4-471e-b9cf-c517cefa9866" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:42 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-23dfc765-c80f-43a9-98c0-eeded0bbc169 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Lock "cinder-quobyte-a0a6c189-1fc4-471e-b9cf-c517cefa9866" acquired by "delete_volume" :: waited 0.030s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:42 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[12dd1a28-0c00-481a-ad88-57448350edc2]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-23dfc765-c80f-43a9-98c0-eeded0bbc169 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a0a6c189-1fc4-471e-b9cf-c517cefa9866 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:42 devstack sudo[105604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a0a6c189-1fc4-471e-b9cf-c517cefa9866 Sep 23 00:32:42 devstack sudo[105604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:42 devstack sudo[105599]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-67a335ce-6b97-4c00-ab72-e883eeb41ddc tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dae52d1-ae8a-4125-8cd9-5b71677106af 1073741824" returned: 0 in 0.708s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-67a335ce-6b97-4c00-ab72-e883eeb41ddc tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dae52d1-ae8a-4125-8cd9-5b71677106af {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:42 devstack sudo[105607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dae52d1-ae8a-4125-8cd9-5b71677106af Sep 23 00:32:42 devstack sudo[105607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:43 devstack sudo[105604]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-23dfc765-c80f-43a9-98c0-eeded0bbc169 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a0a6c189-1fc4-471e-b9cf-c517cefa9866" returned: 0 in 0.703s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-23dfc765-c80f-43a9-98c0-eeded0bbc169 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a0a6c189-1fc4-471e-b9cf-c517cefa9866 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:43 devstack sudo[105613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a0a6c189-1fc4-471e-b9cf-c517cefa9866 Sep 23 00:32:43 devstack sudo[105613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:43 devstack sudo[105607]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-67a335ce-6b97-4c00-ab72-e883eeb41ddc tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dae52d1-ae8a-4125-8cd9-5b71677106af" returned: 0 in 0.360s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:43 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-67a335ce-6b97-4c00-ab72-e883eeb41ddc tempest-ProjectMemberTests-2104250010 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:32:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-67a335ce-6b97-4c00-ab72-e883eeb41ddc tempest-ProjectMemberTests-2104250010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:43 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-67a335ce-6b97-4c00-ab72-e883eeb41ddc tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68ac4144-56af-4dbb-aedc-56d07dcd1a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dae52d1-ae8a-4125-8cd9-5b71677106af', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:43 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-67a335ce-6b97-4c00-ab72-e883eeb41ddc tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43cbe5d3-47aa-4235-a775-2450de5b41af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:43 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-67a335ce-6b97-4c00-ab72-e883eeb41ddc tempest-ProjectMemberTests-2104250010 None] Volume volume-8dae52d1-ae8a-4125-8cd9-5b71677106af (8dae52d1-ae8a-4125-8cd9-5b71677106af): created successfully Sep 23 00:32:43 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-67a335ce-6b97-4c00-ab72-e883eeb41ddc tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43cbe5d3-47aa-4235-a775-2450de5b41af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:43 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-67a335ce-6b97-4c00-ab72-e883eeb41ddc tempest-ProjectMemberTests-2104250010 None] Flow 'volume_create_manager' (a861dce9-c51c-4dbb-b053-dca7148c65b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:43 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-67a335ce-6b97-4c00-ab72-e883eeb41ddc tempest-ProjectMemberTests-2104250010 None] Created volume successfully. Sep 23 00:32:43 devstack sudo[105613]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-23dfc765-c80f-43a9-98c0-eeded0bbc169 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a0a6c189-1fc4-471e-b9cf-c517cefa9866" returned: 0 in 0.365s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:43 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-23dfc765-c80f-43a9-98c0-eeded0bbc169 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Lock "cinder-quobyte-a0a6c189-1fc4-471e-b9cf-c517cefa9866" released by "delete_volume" :: held 1.152s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:43 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-23dfc765-c80f-43a9-98c0-eeded0bbc169 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Created reservations ['64568259-8994-495d-a55b-c57ac2877568', '0a6d48b0-af98-42ea-96eb-f5a9c14a8fa1', '005c56ab-9e3e-49dc-ae31-83e8b36925b9', '00fc422c-0856-4ccb-925c-30b3c8e164d1'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-23dfc765-c80f-43a9-98c0-eeded0bbc169 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-23dfc765-c80f-43a9-98c0-eeded0bbc169 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:43 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-23dfc765-c80f-43a9-98c0-eeded0bbc169 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:43 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-23dfc765-c80f-43a9-98c0-eeded0bbc169 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-23dfc765-c80f-43a9-98c0-eeded0bbc169 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-23dfc765-c80f-43a9-98c0-eeded0bbc169 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:43 devstack sudo[105616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:32:43 devstack sudo[105616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:44 devstack sudo[105616]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-23dfc765-c80f-43a9-98c0-eeded0bbc169 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.390s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:44 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-23dfc765-c80f-43a9-98c0-eeded0bbc169 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:44 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-23dfc765-c80f-43a9-98c0-eeded0bbc169 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Deleted volume successfully. Sep 23 00:32:44 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-23dfc765-c80f-43a9-98c0-eeded0bbc169 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Lock "cinder-a0a6c189-1fc4-471e-b9cf-c517cefa9866-delete_volume" released by "delete_volume" :: held 1.946s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:44 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0713be42-cb9a-4976-8327-c2d56cb6de31 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Acquiring lock "cinder-3fccb400-77c6-4a40-8d3f-e23fa6e72127-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:44 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0713be42-cb9a-4976-8327-c2d56cb6de31 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Lock "cinder-3fccb400-77c6-4a40-8d3f-e23fa6e72127-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:44 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0713be42-cb9a-4976-8327-c2d56cb6de31 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Acquiring lock "cinder-quobyte-3fccb400-77c6-4a40-8d3f-e23fa6e72127" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:45 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0713be42-cb9a-4976-8327-c2d56cb6de31 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Lock "cinder-quobyte-3fccb400-77c6-4a40-8d3f-e23fa6e72127" acquired by "delete_volume" :: waited 0.029s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:45 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[8578ab96-7120-4ad2-987f-74ecd0044a60]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0713be42-cb9a-4976-8327-c2d56cb6de31 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fccb400-77c6-4a40-8d3f-e23fa6e72127 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-94c793e0-01e6-49a3-ab5c-6382c90f3d19 tempest-ProjectMemberTests-2104250010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-94c793e0-01e6-49a3-ab5c-6382c90f3d19 tempest-ProjectMemberTests-2104250010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:45 devstack sudo[105619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fccb400-77c6-4a40-8d3f-e23fa6e72127 Sep 23 00:32:45 devstack sudo[105619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:45 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-94c793e0-01e6-49a3-ab5c-6382c90f3d19 tempest-ProjectMemberTests-2104250010 None] Creating offline snapshot b45994e5-0064-4e7b-86fe-05618a475f8f of volume 8dae52d1-ae8a-4125-8cd9-5b71677106af {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:32:45 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f94d27-8ea8-4449-8179-2455cd539a4a]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-94c793e0-01e6-49a3-ab5c-6382c90f3d19 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dae52d1-ae8a-4125-8cd9-5b71677106af {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:45 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-287bacf6-d052-47d5-bbb7-8836ccef110e tempest-ProjectReaderTests-1672073403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:32:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-287bacf6-d052-47d5-bbb7-8836ccef110e tempest-ProjectReaderTests-1672073403 None] Flow 'volume_create_manager' (a764080b-39c3-491d-8f17-0738c0d28272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-287bacf6-d052-47d5-bbb7-8836ccef110e tempest-ProjectReaderTests-1672073403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99fd38e8-9618-4470-9375-8a9119736e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-287bacf6-d052-47d5-bbb7-8836ccef110e tempest-ProjectReaderTests-1672073403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99fd38e8-9618-4470-9375-8a9119736e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-920774261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=920d9234-ee87-4dfe-bfdc-8efcbb536cd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a361786c5d944c5a73653e654c80def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:45Z,use_quota=True,user_id='f01a5c248a78434fb39a1d6e1e81a391',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-287bacf6-d052-47d5-bbb7-8836ccef110e tempest-ProjectReaderTests-1672073403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15b27452-1ef8-4c1c-95ed-73cc2279ce27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-287bacf6-d052-47d5-bbb7-8836ccef110e tempest-ProjectReaderTests-1672073403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15b27452-1ef8-4c1c-95ed-73cc2279ce27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-287bacf6-d052-47d5-bbb7-8836ccef110e tempest-ProjectReaderTests-1672073403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9a73a25-b47a-4af8-abdb-5b0e39e61529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-287bacf6-d052-47d5-bbb7-8836ccef110e tempest-ProjectReaderTests-1672073403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9a73a25-b47a-4af8-abdb-5b0e39e61529) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '920d9234-ee87-4dfe-bfdc-8efcbb536cd2', 'volume_name': 'volume-920d9234-ee87-4dfe-bfdc-8efcbb536cd2', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-287bacf6-d052-47d5-bbb7-8836ccef110e tempest-ProjectReaderTests-1672073403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (349c3e6c-cc8f-41bf-87a6-c085abdd2c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-287bacf6-d052-47d5-bbb7-8836ccef110e tempest-ProjectReaderTests-1672073403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (349c3e6c-cc8f-41bf-87a6-c085abdd2c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-287bacf6-d052-47d5-bbb7-8836ccef110e tempest-ProjectReaderTests-1672073403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66022e13-ceca-426e-9cbd-24da765cec59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:45 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-287bacf6-d052-47d5-bbb7-8836ccef110e tempest-ProjectReaderTests-1672073403 None] Volume 920d9234-ee87-4dfe-bfdc-8efcbb536cd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-920d9234-ee87-4dfe-bfdc-8efcbb536cd2', 'volume_size': 1} Sep 23 00:32:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-287bacf6-d052-47d5-bbb7-8836ccef110e tempest-ProjectReaderTests-1672073403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:45 devstack sudo[105621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dae52d1-ae8a-4125-8cd9-5b71677106af Sep 23 00:32:45 devstack sudo[105621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:45 devstack sudo[105619]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0713be42-cb9a-4976-8327-c2d56cb6de31 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fccb400-77c6-4a40-8d3f-e23fa6e72127" returned: 0 in 0.531s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0713be42-cb9a-4976-8327-c2d56cb6de31 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fccb400-77c6-4a40-8d3f-e23fa6e72127 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:45 devstack sudo[105626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fccb400-77c6-4a40-8d3f-e23fa6e72127 Sep 23 00:32:45 devstack sudo[105626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:45 devstack sudo[105621]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-94c793e0-01e6-49a3-ab5c-6382c90f3d19 tempest-ProjectMemberTests-2104250010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dae52d1-ae8a-4125-8cd9-5b71677106af" returned: 0 in 0.542s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-94c793e0-01e6-49a3-ab5c-6382c90f3d19 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dae52d1-ae8a-4125-8cd9-5b71677106af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dae52d1-ae8a-4125-8cd9-5b71677106af.b45994e5-0064-4e7b-86fe-05618a475f8f 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:45 devstack sudo[105632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dae52d1-ae8a-4125-8cd9-5b71677106af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dae52d1-ae8a-4125-8cd9-5b71677106af.b45994e5-0064-4e7b-86fe-05618a475f8f 1G Sep 23 00:32:45 devstack sudo[105632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:45 devstack sudo[105626]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0713be42-cb9a-4976-8327-c2d56cb6de31 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3fccb400-77c6-4a40-8d3f-e23fa6e72127" returned: 0 in 0.361s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:45 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0713be42-cb9a-4976-8327-c2d56cb6de31 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Lock "cinder-quobyte-3fccb400-77c6-4a40-8d3f-e23fa6e72127" released by "delete_volume" :: held 0.952s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:46 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-0713be42-cb9a-4976-8327-c2d56cb6de31 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Created reservations ['1ef7b9e0-2f90-484b-a25d-eb4f8ab01eb6', '99c12368-0671-4a01-95b4-a8fddcf241e4', 'c70565bb-eb7c-44aa-a5b8-3414ca354dc2', '493ee0a9-693e-41b5-90e4-7d91160ff44d'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0713be42-cb9a-4976-8327-c2d56cb6de31 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0713be42-cb9a-4976-8327-c2d56cb6de31 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0713be42-cb9a-4976-8327-c2d56cb6de31 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0713be42-cb9a-4976-8327-c2d56cb6de31 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0713be42-cb9a-4976-8327-c2d56cb6de31 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0713be42-cb9a-4976-8327-c2d56cb6de31 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:46 devstack sudo[105638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:32:46 devstack sudo[105638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:46 devstack sudo[105632]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-94c793e0-01e6-49a3-ab5c-6382c90f3d19 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dae52d1-ae8a-4125-8cd9-5b71677106af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dae52d1-ae8a-4125-8cd9-5b71677106af.b45994e5-0064-4e7b-86fe-05618a475f8f 1G" returned: 0 in 0.599s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-94c793e0-01e6-49a3-ab5c-6382c90f3d19 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dae52d1-ae8a-4125-8cd9-5b71677106af -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dae52d1-ae8a-4125-8cd9-5b71677106af.b45994e5-0064-4e7b-86fe-05618a475f8f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:46 devstack sudo[105642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dae52d1-ae8a-4125-8cd9-5b71677106af -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dae52d1-ae8a-4125-8cd9-5b71677106af.b45994e5-0064-4e7b-86fe-05618a475f8f Sep 23 00:32:46 devstack sudo[105642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:46 devstack sudo[105638]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0713be42-cb9a-4976-8327-c2d56cb6de31 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.297s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:46 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-0713be42-cb9a-4976-8327-c2d56cb6de31 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:46 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-0713be42-cb9a-4976-8327-c2d56cb6de31 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Deleted volume successfully. Sep 23 00:32:46 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-0713be42-cb9a-4976-8327-c2d56cb6de31 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Lock "cinder-3fccb400-77c6-4a40-8d3f-e23fa6e72127-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:46 devstack sudo[105642]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-94c793e0-01e6-49a3-ab5c-6382c90f3d19 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dae52d1-ae8a-4125-8cd9-5b71677106af -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dae52d1-ae8a-4125-8cd9-5b71677106af.b45994e5-0064-4e7b-86fe-05618a475f8f" returned: 0 in 0.457s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:46 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-94c793e0-01e6-49a3-ab5c-6382c90f3d19 tempest-ProjectMemberTests-2104250010 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dae52d1-ae8a-4125-8cd9-5b71677106af.b45994e5-0064-4e7b-86fe-05618a475f8f is being set with open permissions: ugo+rw Sep 23 00:32:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-94c793e0-01e6-49a3-ab5c-6382c90f3d19 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dae52d1-ae8a-4125-8cd9-5b71677106af.b45994e5-0064-4e7b-86fe-05618a475f8f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:46 devstack sudo[105647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dae52d1-ae8a-4125-8cd9-5b71677106af.b45994e5-0064-4e7b-86fe-05618a475f8f Sep 23 00:32:46 devstack sudo[105647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:47 devstack sudo[105647]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-94c793e0-01e6-49a3-ab5c-6382c90f3d19 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dae52d1-ae8a-4125-8cd9-5b71677106af.b45994e5-0064-4e7b-86fe-05618a475f8f" returned: 0 in 0.306s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-94c793e0-01e6-49a3-ab5c-6382c90f3d19 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dae52d1-ae8a-4125-8cd9-5b71677106af.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:47 devstack sudo[105650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dae52d1-ae8a-4125-8cd9-5b71677106af.info Sep 23 00:32:47 devstack sudo[105650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:47 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-11d3eec2-3f62-4c11-9b6e-3b19cd26204f tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Acquiring lock "cinder-b23afe00-4f52-4042-ad74-7a3ecff37ba4-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:47 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-11d3eec2-3f62-4c11-9b6e-3b19cd26204f tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Lock "cinder-b23afe00-4f52-4042-ad74-7a3ecff37ba4-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:47 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-11d3eec2-3f62-4c11-9b6e-3b19cd26204f tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Acquiring lock "cinder-quobyte-b23afe00-4f52-4042-ad74-7a3ecff37ba4" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:47 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-11d3eec2-3f62-4c11-9b6e-3b19cd26204f tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Lock "cinder-quobyte-b23afe00-4f52-4042-ad74-7a3ecff37ba4" acquired by "delete_volume" :: waited 0.025s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:47 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d81b90-cfaf-40f5-af27-951da1690554]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-11d3eec2-3f62-4c11-9b6e-3b19cd26204f tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b23afe00-4f52-4042-ad74-7a3ecff37ba4 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:47 devstack sudo[105650]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-94c793e0-01e6-49a3-ab5c-6382c90f3d19 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dae52d1-ae8a-4125-8cd9-5b71677106af.info" returned: 0 in 0.336s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:47 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-94c793e0-01e6-49a3-ab5c-6382c90f3d19 tempest-ProjectMemberTests-2104250010 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dae52d1-ae8a-4125-8cd9-5b71677106af.info is being set with open permissions: ugo+rw Sep 23 00:32:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-94c793e0-01e6-49a3-ab5c-6382c90f3d19 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dae52d1-ae8a-4125-8cd9-5b71677106af.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:47 devstack sudo[105653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b23afe00-4f52-4042-ad74-7a3ecff37ba4 Sep 23 00:32:47 devstack sudo[105653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:47 devstack sudo[105655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dae52d1-ae8a-4125-8cd9-5b71677106af.info Sep 23 00:32:47 devstack sudo[105655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:47 devstack sudo[105655]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-94c793e0-01e6-49a3-ab5c-6382c90f3d19 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dae52d1-ae8a-4125-8cd9-5b71677106af.info" returned: 0 in 0.301s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-94c793e0-01e6-49a3-ab5c-6382c90f3d19 tempest-ProjectMemberTests-2104250010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.710s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-287bacf6-d052-47d5-bbb7-8836ccef110e tempest-ProjectReaderTests-1672073403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.507s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:47 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-287bacf6-d052-47d5-bbb7-8836ccef110e tempest-ProjectReaderTests-1672073403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-920774261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=920d9234-ee87-4dfe-bfdc-8efcbb536cd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a361786c5d944c5a73653e654c80def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:45Z,use_quota=True,user_id='f01a5c248a78434fb39a1d6e1e81a391',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:32:47 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-287bacf6-d052-47d5-bbb7-8836ccef110e tempest-ProjectReaderTests-1672073403 None] Creating volume 920d9234-ee87-4dfe-bfdc-8efcbb536cd2 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:32:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-287bacf6-d052-47d5-bbb7-8836ccef110e tempest-ProjectReaderTests-1672073403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-287bacf6-d052-47d5-bbb7-8836ccef110e tempest-ProjectReaderTests-1672073403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:47 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-287bacf6-d052-47d5-bbb7-8836ccef110e tempest-ProjectReaderTests-1672073403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:47 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-287bacf6-d052-47d5-bbb7-8836ccef110e tempest-ProjectReaderTests-1672073403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-287bacf6-d052-47d5-bbb7-8836ccef110e tempest-ProjectReaderTests-1672073403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:47 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-287bacf6-d052-47d5-bbb7-8836ccef110e tempest-ProjectReaderTests-1672073403 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:32:47 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-287bacf6-d052-47d5-bbb7-8836ccef110e tempest-ProjectReaderTests-1672073403 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:32:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-287bacf6-d052-47d5-bbb7-8836ccef110e tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-920d9234-ee87-4dfe-bfdc-8efcbb536cd2 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:47 devstack sudo[105653]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-11d3eec2-3f62-4c11-9b6e-3b19cd26204f tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b23afe00-4f52-4042-ad74-7a3ecff37ba4" returned: 0 in 0.462s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-11d3eec2-3f62-4c11-9b6e-3b19cd26204f tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b23afe00-4f52-4042-ad74-7a3ecff37ba4 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:47 devstack sudo[105662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-920d9234-ee87-4dfe-bfdc-8efcbb536cd2 1073741824 Sep 23 00:32:47 devstack sudo[105662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:47 devstack sudo[105664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b23afe00-4f52-4042-ad74-7a3ecff37ba4 Sep 23 00:32:47 devstack sudo[105664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:47 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-94c793e0-01e6-49a3-ab5c-6382c90f3d19 tempest-ProjectMemberTests-2104250010 None] Create snapshot completed successfully Sep 23 00:32:48 devstack sudo[105664]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-11d3eec2-3f62-4c11-9b6e-3b19cd26204f tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-b23afe00-4f52-4042-ad74-7a3ecff37ba4" returned: 0 in 0.358s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:48 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-11d3eec2-3f62-4c11-9b6e-3b19cd26204f tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Lock "cinder-quobyte-b23afe00-4f52-4042-ad74-7a3ecff37ba4" released by "delete_volume" :: held 0.886s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:48 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-11d3eec2-3f62-4c11-9b6e-3b19cd26204f tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Created reservations ['18e6aecc-4f16-44a8-81d6-ff250a58a8f1', '269c66a9-4b9c-4073-b9f8-9972f185036c', '0229b8dc-1a3f-4c34-bb77-52091e506923', '7923f009-1950-421d-a22d-d20ece8abad3'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-11d3eec2-3f62-4c11-9b6e-3b19cd26204f tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-11d3eec2-3f62-4c11-9b6e-3b19cd26204f tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:48 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-11d3eec2-3f62-4c11-9b6e-3b19cd26204f tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:48 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-11d3eec2-3f62-4c11-9b6e-3b19cd26204f tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-11d3eec2-3f62-4c11-9b6e-3b19cd26204f tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-11d3eec2-3f62-4c11-9b6e-3b19cd26204f tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:48 devstack sudo[105671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:32:48 devstack sudo[105671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:48 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f6d61594-d289-4718-abfc-09e9ff4f29aa tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Acquiring lock "cinder-9f53af69-80aa-43cd-98e8-2295910fba1a-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:48 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f6d61594-d289-4718-abfc-09e9ff4f29aa tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Lock "cinder-9f53af69-80aa-43cd-98e8-2295910fba1a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:48 devstack sudo[105662]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-287bacf6-d052-47d5-bbb7-8836ccef110e tempest-ProjectReaderTests-1672073403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-920d9234-ee87-4dfe-bfdc-8efcbb536cd2 1073741824" returned: 0 in 0.716s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:48 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f6d61594-d289-4718-abfc-09e9ff4f29aa tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Acquiring lock "cinder-quobyte-9f53af69-80aa-43cd-98e8-2295910fba1a" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:48 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f6d61594-d289-4718-abfc-09e9ff4f29aa tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Lock "cinder-quobyte-9f53af69-80aa-43cd-98e8-2295910fba1a" acquired by "delete_volume" :: waited 0.022s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-287bacf6-d052-47d5-bbb7-8836ccef110e tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-920d9234-ee87-4dfe-bfdc-8efcbb536cd2 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:48 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee9fe6f-789d-4a7d-8cc0-c50704929051]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f6d61594-d289-4718-abfc-09e9ff4f29aa tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9f53af69-80aa-43cd-98e8-2295910fba1a {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:48 devstack sudo[105673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-920d9234-ee87-4dfe-bfdc-8efcbb536cd2 Sep 23 00:32:48 devstack sudo[105673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:48 devstack sudo[105671]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-11d3eec2-3f62-4c11-9b6e-3b19cd26204f tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.385s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:48 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-11d3eec2-3f62-4c11-9b6e-3b19cd26204f tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:48 devstack sudo[105674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9f53af69-80aa-43cd-98e8-2295910fba1a Sep 23 00:32:48 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:48 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-11d3eec2-3f62-4c11-9b6e-3b19cd26204f tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Deleted volume successfully. Sep 23 00:32:48 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-11d3eec2-3f62-4c11-9b6e-3b19cd26204f tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Lock "cinder-b23afe00-4f52-4042-ad74-7a3ecff37ba4-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:48 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-dabb36ef-85ab-42ff-8f2f-67ab2774bc5a tempest-ProjectMemberTests-2104250010 None] Acquiring lock "cinder-b45994e5-0064-4e7b-86fe-05618a475f8f-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:49 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-dabb36ef-85ab-42ff-8f2f-67ab2774bc5a tempest-ProjectMemberTests-2104250010 None] Lock "cinder-b45994e5-0064-4e7b-86fe-05618a475f8f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:49 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-dabb36ef-85ab-42ff-8f2f-67ab2774bc5a tempest-ProjectMemberTests-2104250010 None] Acquiring lock "cinder-quobyte-8dae52d1-ae8a-4125-8cd9-5b71677106af" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:49 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-dabb36ef-85ab-42ff-8f2f-67ab2774bc5a tempest-ProjectMemberTests-2104250010 None] Lock "cinder-quobyte-8dae52d1-ae8a-4125-8cd9-5b71677106af" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:49 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-dabb36ef-85ab-42ff-8f2f-67ab2774bc5a tempest-ProjectMemberTests-2104250010 None] Acquiring lock "cinder-quobyte-b45994e5-0064-4e7b-86fe-05618a475f8f" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:49 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-dabb36ef-85ab-42ff-8f2f-67ab2774bc5a tempest-ProjectMemberTests-2104250010 None] Lock "cinder-quobyte-b45994e5-0064-4e7b-86fe-05618a475f8f" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:49 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-dabb36ef-85ab-42ff-8f2f-67ab2774bc5a tempest-ProjectMemberTests-2104250010 None] Deleting offline snapshot b45994e5-0064-4e7b-86fe-05618a475f8f of volume 8dae52d1-ae8a-4125-8cd9-5b71677106af {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:32:49 devstack sudo[105673]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:49 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-dabb36ef-85ab-42ff-8f2f-67ab2774bc5a tempest-ProjectMemberTests-2104250010 None] snapshot_file for this snap is: volume-8dae52d1-ae8a-4125-8cd9-5b71677106af.b45994e5-0064-4e7b-86fe-05618a475f8f {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:32:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-287bacf6-d052-47d5-bbb7-8836ccef110e tempest-ProjectReaderTests-1672073403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-920d9234-ee87-4dfe-bfdc-8efcbb536cd2" returned: 0 in 0.459s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:49 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-287bacf6-d052-47d5-bbb7-8836ccef110e tempest-ProjectReaderTests-1672073403 None] <== create_volume: return (1289ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:32:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-287bacf6-d052-47d5-bbb7-8836ccef110e tempest-ProjectReaderTests-1672073403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.294s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-287bacf6-d052-47d5-bbb7-8836ccef110e tempest-ProjectReaderTests-1672073403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66022e13-ceca-426e-9cbd-24da765cec59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-920d9234-ee87-4dfe-bfdc-8efcbb536cd2', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-287bacf6-d052-47d5-bbb7-8836ccef110e tempest-ProjectReaderTests-1672073403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf816045-ffe3-4319-8105-c963745075fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:49 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc87a00-65ea-45c2-8ec8-e63b0f2a91c2]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dabb36ef-85ab-42ff-8f2f-67ab2774bc5a tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dae52d1-ae8a-4125-8cd9-5b71677106af.b45994e5-0064-4e7b-86fe-05618a475f8f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:49 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-287bacf6-d052-47d5-bbb7-8836ccef110e tempest-ProjectReaderTests-1672073403 None] Volume volume-920d9234-ee87-4dfe-bfdc-8efcbb536cd2 (920d9234-ee87-4dfe-bfdc-8efcbb536cd2): created successfully Sep 23 00:32:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-287bacf6-d052-47d5-bbb7-8836ccef110e tempest-ProjectReaderTests-1672073403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf816045-ffe3-4319-8105-c963745075fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-287bacf6-d052-47d5-bbb7-8836ccef110e tempest-ProjectReaderTests-1672073403 None] Flow 'volume_create_manager' (a764080b-39c3-491d-8f17-0738c0d28272) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:49 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-287bacf6-d052-47d5-bbb7-8836ccef110e tempest-ProjectReaderTests-1672073403 None] Created volume successfully. Sep 23 00:32:49 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f6d61594-d289-4718-abfc-09e9ff4f29aa tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9f53af69-80aa-43cd-98e8-2295910fba1a" returned: 0 in 0.566s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f6d61594-d289-4718-abfc-09e9ff4f29aa tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9f53af69-80aa-43cd-98e8-2295910fba1a {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:49 devstack sudo[105683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9f53af69-80aa-43cd-98e8-2295910fba1a Sep 23 00:32:49 devstack sudo[105683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:49 devstack sudo[105681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dae52d1-ae8a-4125-8cd9-5b71677106af.b45994e5-0064-4e7b-86fe-05618a475f8f Sep 23 00:32:49 devstack sudo[105681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:49 devstack sudo[105681]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dabb36ef-85ab-42ff-8f2f-67ab2774bc5a tempest-ProjectMemberTests-2104250010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dae52d1-ae8a-4125-8cd9-5b71677106af.b45994e5-0064-4e7b-86fe-05618a475f8f" returned: 0 in 0.519s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:49 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-dabb36ef-85ab-42ff-8f2f-67ab2774bc5a tempest-ProjectMemberTests-2104250010 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8dae52d1-ae8a-4125-8cd9-5b71677106af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:32:49 devstack sudo[105683]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f6d61594-d289-4718-abfc-09e9ff4f29aa tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9f53af69-80aa-43cd-98e8-2295910fba1a" returned: 0 in 0.488s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:49 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d3469c-2f86-4cd4-b3f9-8ea6fd1c950c]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dabb36ef-85ab-42ff-8f2f-67ab2774bc5a tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dae52d1-ae8a-4125-8cd9-5b71677106af {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:49 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f6d61594-d289-4718-abfc-09e9ff4f29aa tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Lock "cinder-quobyte-9f53af69-80aa-43cd-98e8-2295910fba1a" released by "delete_volume" :: held 1.144s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:49 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-f6d61594-d289-4718-abfc-09e9ff4f29aa tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Created reservations ['707d7337-b69b-403f-a7cb-dc2558721b61', '1c47d16e-8b7a-4c44-bf92-8a2345d67e55', '0ad81d59-64dd-48cd-8047-43597dfd8d89', '7aa13423-2de2-4f5f-bc74-c4726ac2ba87'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:49 devstack sudo[105691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dae52d1-ae8a-4125-8cd9-5b71677106af Sep 23 00:32:49 devstack sudo[105691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f6d61594-d289-4718-abfc-09e9ff4f29aa tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f6d61594-d289-4718-abfc-09e9ff4f29aa tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:49 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f6d61594-d289-4718-abfc-09e9ff4f29aa tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:49 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-f6d61594-d289-4718-abfc-09e9ff4f29aa tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f6d61594-d289-4718-abfc-09e9ff4f29aa tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f6d61594-d289-4718-abfc-09e9ff4f29aa tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:50 devstack sudo[105693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:32:50 devstack sudo[105693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:50 devstack sudo[105691]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dabb36ef-85ab-42ff-8f2f-67ab2774bc5a tempest-ProjectMemberTests-2104250010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dae52d1-ae8a-4125-8cd9-5b71677106af" returned: 0 in 0.505s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dabb36ef-85ab-42ff-8f2f-67ab2774bc5a tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dae52d1-ae8a-4125-8cd9-5b71677106af.b45994e5-0064-4e7b-86fe-05618a475f8f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:50 devstack sudo[105693]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-f6d61594-d289-4718-abfc-09e9ff4f29aa tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.347s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:50 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-f6d61594-d289-4718-abfc-09e9ff4f29aa tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:50 devstack sudo[105699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dae52d1-ae8a-4125-8cd9-5b71677106af.b45994e5-0064-4e7b-86fe-05618a475f8f Sep 23 00:32:50 devstack sudo[105699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:50 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-f6d61594-d289-4718-abfc-09e9ff4f29aa tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Deleted volume successfully. Sep 23 00:32:50 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-f6d61594-d289-4718-abfc-09e9ff4f29aa tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Lock "cinder-9f53af69-80aa-43cd-98e8-2295910fba1a-delete_volume" released by "delete_volume" :: held 1.797s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1c417cac-e2ff-429d-ad2f-a219067a424d tempest-ProjectReaderTests-1672073403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1c417cac-e2ff-429d-ad2f-a219067a424d tempest-ProjectReaderTests-1672073403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:50 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-1c417cac-e2ff-429d-ad2f-a219067a424d tempest-ProjectReaderTests-1672073403 None] Creating offline snapshot 70667491-1c37-448e-9eb3-53cb8f8fb4e7 of volume 920d9234-ee87-4dfe-bfdc-8efcbb536cd2 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:32:50 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead6258c-dd26-4175-95f2-04e7d21d43fd]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1c417cac-e2ff-429d-ad2f-a219067a424d tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-920d9234-ee87-4dfe-bfdc-8efcbb536cd2 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:50 devstack sudo[105699]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dabb36ef-85ab-42ff-8f2f-67ab2774bc5a tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dae52d1-ae8a-4125-8cd9-5b71677106af.b45994e5-0064-4e7b-86fe-05618a475f8f" returned: 0 in 0.570s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dabb36ef-85ab-42ff-8f2f-67ab2774bc5a tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dae52d1-ae8a-4125-8cd9-5b71677106af.b45994e5-0064-4e7b-86fe-05618a475f8f {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:50 devstack sudo[105704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-920d9234-ee87-4dfe-bfdc-8efcbb536cd2 Sep 23 00:32:50 devstack sudo[105704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:50 devstack sudo[105706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dae52d1-ae8a-4125-8cd9-5b71677106af.b45994e5-0064-4e7b-86fe-05618a475f8f Sep 23 00:32:50 devstack sudo[105706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:50 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-011037ec-9c53-483d-8eeb-d9b0506c37e1 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Acquiring lock "cinder-1c2d286e-8d91-443c-b618-9fa1c3c978c3-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:50 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-011037ec-9c53-483d-8eeb-d9b0506c37e1 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Lock "cinder-1c2d286e-8d91-443c-b618-9fa1c3c978c3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:51 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-011037ec-9c53-483d-8eeb-d9b0506c37e1 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Acquiring lock "cinder-quobyte-1c2d286e-8d91-443c-b618-9fa1c3c978c3" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:51 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-011037ec-9c53-483d-8eeb-d9b0506c37e1 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Lock "cinder-quobyte-1c2d286e-8d91-443c-b618-9fa1c3c978c3" acquired by "delete_volume" :: waited 0.026s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:51 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b1704b-f935-41e5-9a98-a15fae46c739]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-011037ec-9c53-483d-8eeb-d9b0506c37e1 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1c2d286e-8d91-443c-b618-9fa1c3c978c3 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:51 devstack sudo[105706]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dabb36ef-85ab-42ff-8f2f-67ab2774bc5a tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dae52d1-ae8a-4125-8cd9-5b71677106af.b45994e5-0064-4e7b-86fe-05618a475f8f" returned: 0 in 0.338s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:51 devstack sudo[105704]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:51 devstack sudo[105709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1c2d286e-8d91-443c-b618-9fa1c3c978c3 Sep 23 00:32:51 devstack sudo[105709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1c417cac-e2ff-429d-ad2f-a219067a424d tempest-ProjectReaderTests-1672073403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-920d9234-ee87-4dfe-bfdc-8efcbb536cd2" returned: 0 in 0.532s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1c417cac-e2ff-429d-ad2f-a219067a424d tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-920d9234-ee87-4dfe-bfdc-8efcbb536cd2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-920d9234-ee87-4dfe-bfdc-8efcbb536cd2.70667491-1c37-448e-9eb3-53cb8f8fb4e7 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:51 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-dabb36ef-85ab-42ff-8f2f-67ab2774bc5a tempest-ProjectMemberTests-2104250010 None] Lock "cinder-quobyte-b45994e5-0064-4e7b-86fe-05618a475f8f" released by "_delete_snapshot" :: held 2.156s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:51 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-dabb36ef-85ab-42ff-8f2f-67ab2774bc5a tempest-ProjectMemberTests-2104250010 None] Lock "cinder-quobyte-8dae52d1-ae8a-4125-8cd9-5b71677106af" released by "delete_snapshot" :: held 2.192s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:51 devstack sudo[105715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-920d9234-ee87-4dfe-bfdc-8efcbb536cd2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-920d9234-ee87-4dfe-bfdc-8efcbb536cd2.70667491-1c37-448e-9eb3-53cb8f8fb4e7 1G Sep 23 00:32:51 devstack sudo[105715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:51 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-dabb36ef-85ab-42ff-8f2f-67ab2774bc5a tempest-ProjectMemberTests-2104250010 None] Created reservations ['4896d1d2-5523-4373-ae0b-c0c2afcf0bb5', '9645f785-9849-4743-a790-3de7050e4bf4', '87f45a72-98fb-4c6a-a48a-53b1bdb57dd8', '4fa326df-9494-4ef3-9fd9-6dee3e50be9c'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:51 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-dabb36ef-85ab-42ff-8f2f-67ab2774bc5a tempest-ProjectMemberTests-2104250010 None] Delete snapshot completed successfully. Sep 23 00:32:51 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-dabb36ef-85ab-42ff-8f2f-67ab2774bc5a tempest-ProjectMemberTests-2104250010 None] Lock "cinder-b45994e5-0064-4e7b-86fe-05618a475f8f-delete_snapshot" released by "delete_snapshot" :: held 2.431s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:51 devstack sudo[105709]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-011037ec-9c53-483d-8eeb-d9b0506c37e1 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1c2d286e-8d91-443c-b618-9fa1c3c978c3" returned: 0 in 0.568s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-011037ec-9c53-483d-8eeb-d9b0506c37e1 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1c2d286e-8d91-443c-b618-9fa1c3c978c3 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:51 devstack sudo[105723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1c2d286e-8d91-443c-b618-9fa1c3c978c3 Sep 23 00:32:51 devstack sudo[105723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:51 devstack sudo[105715]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1c417cac-e2ff-429d-ad2f-a219067a424d tempest-ProjectReaderTests-1672073403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-920d9234-ee87-4dfe-bfdc-8efcbb536cd2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-920d9234-ee87-4dfe-bfdc-8efcbb536cd2.70667491-1c37-448e-9eb3-53cb8f8fb4e7 1G" returned: 0 in 0.639s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1c417cac-e2ff-429d-ad2f-a219067a424d tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-920d9234-ee87-4dfe-bfdc-8efcbb536cd2 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-920d9234-ee87-4dfe-bfdc-8efcbb536cd2.70667491-1c37-448e-9eb3-53cb8f8fb4e7 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:51 devstack sudo[105725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-920d9234-ee87-4dfe-bfdc-8efcbb536cd2 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-920d9234-ee87-4dfe-bfdc-8efcbb536cd2.70667491-1c37-448e-9eb3-53cb8f8fb4e7 Sep 23 00:32:51 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:52 devstack sudo[105723]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-011037ec-9c53-483d-8eeb-d9b0506c37e1 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-1c2d286e-8d91-443c-b618-9fa1c3c978c3" returned: 0 in 0.393s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:52 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-011037ec-9c53-483d-8eeb-d9b0506c37e1 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Lock "cinder-quobyte-1c2d286e-8d91-443c-b618-9fa1c3c978c3" released by "delete_volume" :: held 1.029s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:52 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-011037ec-9c53-483d-8eeb-d9b0506c37e1 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Created reservations ['2618758d-93bc-4426-8c31-ce3ef5289225', 'f4b58152-2b6f-4d2f-b562-e26f6b98c298', 'eec1439e-fff0-4eef-99a7-26ef365ed162', '168c2218-3a23-4dde-8093-d8f69f3c71cc'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-011037ec-9c53-483d-8eeb-d9b0506c37e1 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-011037ec-9c53-483d-8eeb-d9b0506c37e1 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:52 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-011037ec-9c53-483d-8eeb-d9b0506c37e1 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:52 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-011037ec-9c53-483d-8eeb-d9b0506c37e1 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-011037ec-9c53-483d-8eeb-d9b0506c37e1 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-011037ec-9c53-483d-8eeb-d9b0506c37e1 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:52 devstack sudo[105731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:32:52 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:52 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-91b574bf-a4ac-4c88-8fd3-84cfa581a026 tempest-ProjectMemberTests-2104250010 None] Acquiring lock "cinder-8dae52d1-ae8a-4125-8cd9-5b71677106af-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:52 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1c417cac-e2ff-429d-ad2f-a219067a424d tempest-ProjectReaderTests-1672073403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-920d9234-ee87-4dfe-bfdc-8efcbb536cd2 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-920d9234-ee87-4dfe-bfdc-8efcbb536cd2.70667491-1c37-448e-9eb3-53cb8f8fb4e7" returned: 0 in 0.488s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:52 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-1c417cac-e2ff-429d-ad2f-a219067a424d tempest-ProjectReaderTests-1672073403 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-920d9234-ee87-4dfe-bfdc-8efcbb536cd2.70667491-1c37-448e-9eb3-53cb8f8fb4e7 is being set with open permissions: ugo+rw Sep 23 00:32:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1c417cac-e2ff-429d-ad2f-a219067a424d tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-920d9234-ee87-4dfe-bfdc-8efcbb536cd2.70667491-1c37-448e-9eb3-53cb8f8fb4e7 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:52 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-91b574bf-a4ac-4c88-8fd3-84cfa581a026 tempest-ProjectMemberTests-2104250010 None] Lock "cinder-8dae52d1-ae8a-4125-8cd9-5b71677106af-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:52 devstack sudo[105733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-920d9234-ee87-4dfe-bfdc-8efcbb536cd2.70667491-1c37-448e-9eb3-53cb8f8fb4e7 Sep 23 00:32:52 devstack sudo[105733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:52 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-91b574bf-a4ac-4c88-8fd3-84cfa581a026 tempest-ProjectMemberTests-2104250010 None] Acquiring lock "cinder-quobyte-8dae52d1-ae8a-4125-8cd9-5b71677106af" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:52 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-91b574bf-a4ac-4c88-8fd3-84cfa581a026 tempest-ProjectMemberTests-2104250010 None] Lock "cinder-quobyte-8dae52d1-ae8a-4125-8cd9-5b71677106af" acquired by "delete_volume" :: waited 0.023s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:52 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[44846d94-6dab-4a11-b8ef-509329884d52]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-91b574bf-a4ac-4c88-8fd3-84cfa581a026 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dae52d1-ae8a-4125-8cd9-5b71677106af {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:52 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-011037ec-9c53-483d-8eeb-d9b0506c37e1 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.364s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:52 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-011037ec-9c53-483d-8eeb-d9b0506c37e1 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:52 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-011037ec-9c53-483d-8eeb-d9b0506c37e1 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Deleted volume successfully. Sep 23 00:32:52 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-011037ec-9c53-483d-8eeb-d9b0506c37e1 tempest-CreateVolumesFromSourceVolumeTest-1233035412 None] Lock "cinder-1c2d286e-8d91-443c-b618-9fa1c3c978c3-delete_volume" released by "delete_volume" :: held 1.765s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:52 devstack sudo[105735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dae52d1-ae8a-4125-8cd9-5b71677106af Sep 23 00:32:52 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:52 devstack sudo[105733]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1c417cac-e2ff-429d-ad2f-a219067a424d tempest-ProjectReaderTests-1672073403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-920d9234-ee87-4dfe-bfdc-8efcbb536cd2.70667491-1c37-448e-9eb3-53cb8f8fb4e7" returned: 0 in 0.394s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1c417cac-e2ff-429d-ad2f-a219067a424d tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-920d9234-ee87-4dfe-bfdc-8efcbb536cd2.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:52 devstack sudo[105739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-920d9234-ee87-4dfe-bfdc-8efcbb536cd2.info Sep 23 00:32:52 devstack sudo[105739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:53 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-91b574bf-a4ac-4c88-8fd3-84cfa581a026 tempest-ProjectMemberTests-2104250010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dae52d1-ae8a-4125-8cd9-5b71677106af" returned: 0 in 0.477s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-91b574bf-a4ac-4c88-8fd3-84cfa581a026 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dae52d1-ae8a-4125-8cd9-5b71677106af {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:53 devstack sudo[105745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dae52d1-ae8a-4125-8cd9-5b71677106af Sep 23 00:32:53 devstack sudo[105745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:53 devstack sudo[105739]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1c417cac-e2ff-429d-ad2f-a219067a424d tempest-ProjectReaderTests-1672073403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-920d9234-ee87-4dfe-bfdc-8efcbb536cd2.info" returned: 0 in 0.292s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:53 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-1c417cac-e2ff-429d-ad2f-a219067a424d tempest-ProjectReaderTests-1672073403 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-920d9234-ee87-4dfe-bfdc-8efcbb536cd2.info is being set with open permissions: ugo+rw Sep 23 00:32:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1c417cac-e2ff-429d-ad2f-a219067a424d tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-920d9234-ee87-4dfe-bfdc-8efcbb536cd2.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:53 devstack sudo[105747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-920d9234-ee87-4dfe-bfdc-8efcbb536cd2.info Sep 23 00:32:53 devstack sudo[105747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:53 devstack sudo[105745]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-91b574bf-a4ac-4c88-8fd3-84cfa581a026 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-8dae52d1-ae8a-4125-8cd9-5b71677106af" returned: 0 in 0.299s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:53 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-91b574bf-a4ac-4c88-8fd3-84cfa581a026 tempest-ProjectMemberTests-2104250010 None] Lock "cinder-quobyte-8dae52d1-ae8a-4125-8cd9-5b71677106af" released by "delete_volume" :: held 0.864s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:53 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-91b574bf-a4ac-4c88-8fd3-84cfa581a026 tempest-ProjectMemberTests-2104250010 None] Created reservations ['82c556dd-8f11-47ed-b744-b9ef8c0367db', '6a65e78e-9510-431c-9709-df448e75d4ff', 'd3246836-f79e-45d4-88bc-2346d53485ec', 'fbf21c37-e068-4bdb-99b5-2130fbe233bc'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:53 devstack sudo[105747]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1c417cac-e2ff-429d-ad2f-a219067a424d tempest-ProjectReaderTests-1672073403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-920d9234-ee87-4dfe-bfdc-8efcbb536cd2.info" returned: 0 in 0.361s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1c417cac-e2ff-429d-ad2f-a219067a424d tempest-ProjectReaderTests-1672073403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.821s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:53 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-1c417cac-e2ff-429d-ad2f-a219067a424d tempest-ProjectReaderTests-1672073403 None] Create snapshot completed successfully Sep 23 00:32:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-91b574bf-a4ac-4c88-8fd3-84cfa581a026 tempest-ProjectMemberTests-2104250010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-91b574bf-a4ac-4c88-8fd3-84cfa581a026 tempest-ProjectMemberTests-2104250010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:53 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-91b574bf-a4ac-4c88-8fd3-84cfa581a026 tempest-ProjectMemberTests-2104250010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:53 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-91b574bf-a4ac-4c88-8fd3-84cfa581a026 tempest-ProjectMemberTests-2104250010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-91b574bf-a4ac-4c88-8fd3-84cfa581a026 tempest-ProjectMemberTests-2104250010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-91b574bf-a4ac-4c88-8fd3-84cfa581a026 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:53 devstack sudo[105751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:32:53 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:54 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-91b574bf-a4ac-4c88-8fd3-84cfa581a026 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.465s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:54 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-91b574bf-a4ac-4c88-8fd3-84cfa581a026 tempest-ProjectMemberTests-2104250010 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:54 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-91b574bf-a4ac-4c88-8fd3-84cfa581a026 tempest-ProjectMemberTests-2104250010 None] Deleted volume successfully. Sep 23 00:32:54 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-91b574bf-a4ac-4c88-8fd3-84cfa581a026 tempest-ProjectMemberTests-2104250010 None] Lock "cinder-8dae52d1-ae8a-4125-8cd9-5b71677106af-delete_volume" released by "delete_volume" :: held 1.738s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:54 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-82681871-7989-4017-9892-7a048c37a9f9 tempest-ProjectMemberTests-2104250010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:32:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-82681871-7989-4017-9892-7a048c37a9f9 tempest-ProjectMemberTests-2104250010 None] Flow 'volume_create_manager' (d2f8b163-fdca-4920-9ff1-04ad8a23256e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-82681871-7989-4017-9892-7a048c37a9f9 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c713c820-278c-4299-852a-516213d74e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:54 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-30bf67fa-07fe-4392-a272-dc00084e7762 tempest-ProjectReaderTests-1672073403 None] Acquiring lock "cinder-70667491-1c37-448e-9eb3-53cb8f8fb4e7-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-82681871-7989-4017-9892-7a048c37a9f9 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c713c820-278c-4299-852a-516213d74e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1824747795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de13b674-e15c-4c0a-a2a9-336aa6f8da21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='105e2fcb253445d18a9a36e4adbf6662',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:54Z,use_quota=True,user_id='6f62c0bf87c2488e987066aaecad1a03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-82681871-7989-4017-9892-7a048c37a9f9 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ca6648e-192d-4f5a-9c40-8d9a8c475a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-82681871-7989-4017-9892-7a048c37a9f9 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ca6648e-192d-4f5a-9c40-8d9a8c475a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-82681871-7989-4017-9892-7a048c37a9f9 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1044188-234a-4d1b-a4d9-c29f825b19f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-82681871-7989-4017-9892-7a048c37a9f9 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1044188-234a-4d1b-a4d9-c29f825b19f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de13b674-e15c-4c0a-a2a9-336aa6f8da21', 'volume_name': 'volume-de13b674-e15c-4c0a-a2a9-336aa6f8da21', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-82681871-7989-4017-9892-7a048c37a9f9 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2296378-0b6c-43a4-bbdb-bf0f81bf4068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-82681871-7989-4017-9892-7a048c37a9f9 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2296378-0b6c-43a4-bbdb-bf0f81bf4068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:54 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-82681871-7989-4017-9892-7a048c37a9f9 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b2ee0dc-9d4d-4736-951e-f9b305397f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:54 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-82681871-7989-4017-9892-7a048c37a9f9 tempest-ProjectMemberTests-2104250010 None] Volume de13b674-e15c-4c0a-a2a9-336aa6f8da21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de13b674-e15c-4c0a-a2a9-336aa6f8da21', 'volume_size': 1} Sep 23 00:32:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-82681871-7989-4017-9892-7a048c37a9f9 tempest-ProjectMemberTests-2104250010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-82681871-7989-4017-9892-7a048c37a9f9 tempest-ProjectMemberTests-2104250010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-82681871-7989-4017-9892-7a048c37a9f9 tempest-ProjectMemberTests-2104250010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1824747795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de13b674-e15c-4c0a-a2a9-336aa6f8da21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='105e2fcb253445d18a9a36e4adbf6662',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:54Z,use_quota=True,user_id='6f62c0bf87c2488e987066aaecad1a03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:32:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-82681871-7989-4017-9892-7a048c37a9f9 tempest-ProjectMemberTests-2104250010 None] Creating volume de13b674-e15c-4c0a-a2a9-336aa6f8da21 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:32:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-82681871-7989-4017-9892-7a048c37a9f9 tempest-ProjectMemberTests-2104250010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-82681871-7989-4017-9892-7a048c37a9f9 tempest-ProjectMemberTests-2104250010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-82681871-7989-4017-9892-7a048c37a9f9 tempest-ProjectMemberTests-2104250010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-82681871-7989-4017-9892-7a048c37a9f9 tempest-ProjectMemberTests-2104250010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-82681871-7989-4017-9892-7a048c37a9f9 tempest-ProjectMemberTests-2104250010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-82681871-7989-4017-9892-7a048c37a9f9 tempest-ProjectMemberTests-2104250010 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:32:54 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-82681871-7989-4017-9892-7a048c37a9f9 tempest-ProjectMemberTests-2104250010 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:32:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-82681871-7989-4017-9892-7a048c37a9f9 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-de13b674-e15c-4c0a-a2a9-336aa6f8da21 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:54 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-30bf67fa-07fe-4392-a272-dc00084e7762 tempest-ProjectReaderTests-1672073403 None] Lock "cinder-70667491-1c37-448e-9eb3-53cb8f8fb4e7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.142s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:54 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-30bf67fa-07fe-4392-a272-dc00084e7762 tempest-ProjectReaderTests-1672073403 None] Acquiring lock "cinder-quobyte-920d9234-ee87-4dfe-bfdc-8efcbb536cd2" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:54 devstack sudo[105754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-de13b674-e15c-4c0a-a2a9-336aa6f8da21 1073741824 Sep 23 00:32:54 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:54 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-30bf67fa-07fe-4392-a272-dc00084e7762 tempest-ProjectReaderTests-1672073403 None] Lock "cinder-quobyte-920d9234-ee87-4dfe-bfdc-8efcbb536cd2" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:54 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-30bf67fa-07fe-4392-a272-dc00084e7762 tempest-ProjectReaderTests-1672073403 None] Acquiring lock "cinder-quobyte-70667491-1c37-448e-9eb3-53cb8f8fb4e7" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:54 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-30bf67fa-07fe-4392-a272-dc00084e7762 tempest-ProjectReaderTests-1672073403 None] Lock "cinder-quobyte-70667491-1c37-448e-9eb3-53cb8f8fb4e7" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-30bf67fa-07fe-4392-a272-dc00084e7762 tempest-ProjectReaderTests-1672073403 None] Deleting offline snapshot 70667491-1c37-448e-9eb3-53cb8f8fb4e7 of volume 920d9234-ee87-4dfe-bfdc-8efcbb536cd2 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:32:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-30bf67fa-07fe-4392-a272-dc00084e7762 tempest-ProjectReaderTests-1672073403 None] snapshot_file for this snap is: volume-920d9234-ee87-4dfe-bfdc-8efcbb536cd2.70667491-1c37-448e-9eb3-53cb8f8fb4e7 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:32:54 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb0c973-0dbe-4dec-8f15-4e32bc4ab614]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-30bf67fa-07fe-4392-a272-dc00084e7762 tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-920d9234-ee87-4dfe-bfdc-8efcbb536cd2.70667491-1c37-448e-9eb3-53cb8f8fb4e7 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:54 devstack sudo[105756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-920d9234-ee87-4dfe-bfdc-8efcbb536cd2.70667491-1c37-448e-9eb3-53cb8f8fb4e7 Sep 23 00:32:54 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:55 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-82681871-7989-4017-9892-7a048c37a9f9 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-de13b674-e15c-4c0a-a2a9-336aa6f8da21 1073741824" returned: 0 in 0.599s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-82681871-7989-4017-9892-7a048c37a9f9 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-de13b674-e15c-4c0a-a2a9-336aa6f8da21 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:55 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:55 devstack sudo[105765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-de13b674-e15c-4c0a-a2a9-336aa6f8da21 Sep 23 00:32:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-30bf67fa-07fe-4392-a272-dc00084e7762 tempest-ProjectReaderTests-1672073403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-920d9234-ee87-4dfe-bfdc-8efcbb536cd2.70667491-1c37-448e-9eb3-53cb8f8fb4e7" returned: 0 in 0.525s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:55 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-30bf67fa-07fe-4392-a272-dc00084e7762 tempest-ProjectReaderTests-1672073403 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-920d9234-ee87-4dfe-bfdc-8efcbb536cd2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:32:55 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:55 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba06c8c2-44e4-47ea-9cd7-d2c46ea4e2b2]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-30bf67fa-07fe-4392-a272-dc00084e7762 tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-920d9234-ee87-4dfe-bfdc-8efcbb536cd2 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:55 devstack sudo[105767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-920d9234-ee87-4dfe-bfdc-8efcbb536cd2 Sep 23 00:32:55 devstack sudo[105767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:55 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-82681871-7989-4017-9892-7a048c37a9f9 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-de13b674-e15c-4c0a-a2a9-336aa6f8da21" returned: 0 in 0.443s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:55 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-82681871-7989-4017-9892-7a048c37a9f9 tempest-ProjectMemberTests-2104250010 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:32:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-82681871-7989-4017-9892-7a048c37a9f9 tempest-ProjectMemberTests-2104250010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-82681871-7989-4017-9892-7a048c37a9f9 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b2ee0dc-9d4d-4736-951e-f9b305397f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de13b674-e15c-4c0a-a2a9-336aa6f8da21', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-82681871-7989-4017-9892-7a048c37a9f9 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58c51b5a-a5f9-4448-a21f-b3a83d569b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:55 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-82681871-7989-4017-9892-7a048c37a9f9 tempest-ProjectMemberTests-2104250010 None] Volume volume-de13b674-e15c-4c0a-a2a9-336aa6f8da21 (de13b674-e15c-4c0a-a2a9-336aa6f8da21): created successfully Sep 23 00:32:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-82681871-7989-4017-9892-7a048c37a9f9 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58c51b5a-a5f9-4448-a21f-b3a83d569b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:55 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-82681871-7989-4017-9892-7a048c37a9f9 tempest-ProjectMemberTests-2104250010 None] Flow 'volume_create_manager' (d2f8b163-fdca-4920-9ff1-04ad8a23256e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:55 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-82681871-7989-4017-9892-7a048c37a9f9 tempest-ProjectMemberTests-2104250010 None] Created volume successfully. Sep 23 00:32:56 devstack sudo[105767]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-30bf67fa-07fe-4392-a272-dc00084e7762 tempest-ProjectReaderTests-1672073403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-920d9234-ee87-4dfe-bfdc-8efcbb536cd2" returned: 0 in 0.743s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-30bf67fa-07fe-4392-a272-dc00084e7762 tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-920d9234-ee87-4dfe-bfdc-8efcbb536cd2.70667491-1c37-448e-9eb3-53cb8f8fb4e7 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:56 devstack sudo[105773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-920d9234-ee87-4dfe-bfdc-8efcbb536cd2.70667491-1c37-448e-9eb3-53cb8f8fb4e7 Sep 23 00:32:56 devstack sudo[105773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:56 devstack sudo[105773]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-30bf67fa-07fe-4392-a272-dc00084e7762 tempest-ProjectReaderTests-1672073403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-920d9234-ee87-4dfe-bfdc-8efcbb536cd2.70667491-1c37-448e-9eb3-53cb8f8fb4e7" returned: 0 in 0.549s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-30bf67fa-07fe-4392-a272-dc00084e7762 tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-920d9234-ee87-4dfe-bfdc-8efcbb536cd2.70667491-1c37-448e-9eb3-53cb8f8fb4e7 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:56 devstack sudo[105779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-920d9234-ee87-4dfe-bfdc-8efcbb536cd2.70667491-1c37-448e-9eb3-53cb8f8fb4e7 Sep 23 00:32:56 devstack sudo[105779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e44a1689-8585-4612-91cc-e6707c762269 tempest-ProjectMemberTests-2104250010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e44a1689-8585-4612-91cc-e6707c762269 tempest-ProjectMemberTests-2104250010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:56 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-e44a1689-8585-4612-91cc-e6707c762269 tempest-ProjectMemberTests-2104250010 None] Creating offline snapshot a64b3c2f-df9b-472b-b9f0-838753b3268c of volume de13b674-e15c-4c0a-a2a9-336aa6f8da21 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:32:56 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f1537f-9203-4b9b-97ac-8565e0cf1a3f]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e44a1689-8585-4612-91cc-e6707c762269 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-de13b674-e15c-4c0a-a2a9-336aa6f8da21 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:57 devstack sudo[105781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-de13b674-e15c-4c0a-a2a9-336aa6f8da21 Sep 23 00:32:57 devstack sudo[105781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:57 devstack sudo[105779]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-30bf67fa-07fe-4392-a272-dc00084e7762 tempest-ProjectReaderTests-1672073403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-920d9234-ee87-4dfe-bfdc-8efcbb536cd2.70667491-1c37-448e-9eb3-53cb8f8fb4e7" returned: 0 in 0.481s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:57 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-30bf67fa-07fe-4392-a272-dc00084e7762 tempest-ProjectReaderTests-1672073403 None] Lock "cinder-quobyte-70667491-1c37-448e-9eb3-53cb8f8fb4e7" released by "_delete_snapshot" :: held 2.493s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:57 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-30bf67fa-07fe-4392-a272-dc00084e7762 tempest-ProjectReaderTests-1672073403 None] Lock "cinder-quobyte-920d9234-ee87-4dfe-bfdc-8efcbb536cd2" released by "delete_snapshot" :: held 2.542s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:57 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-30bf67fa-07fe-4392-a272-dc00084e7762 tempest-ProjectReaderTests-1672073403 None] Created reservations ['7e42e5a0-dce0-4175-a3ee-3c12b957f131', 'b56fe324-b5dd-452a-9f5b-2917cc8b6795', 'd1559fc1-9a04-4aae-9ad9-ea079080a166', '3ef7f352-45a8-491c-9aa7-ca0c50c8d3aa'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:57 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-30bf67fa-07fe-4392-a272-dc00084e7762 tempest-ProjectReaderTests-1672073403 None] Delete snapshot completed successfully. Sep 23 00:32:57 devstack sudo[105781]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:57 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-30bf67fa-07fe-4392-a272-dc00084e7762 tempest-ProjectReaderTests-1672073403 None] Lock "cinder-70667491-1c37-448e-9eb3-53cb8f8fb4e7-delete_snapshot" released by "delete_snapshot" :: held 2.807s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e44a1689-8585-4612-91cc-e6707c762269 tempest-ProjectMemberTests-2104250010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-de13b674-e15c-4c0a-a2a9-336aa6f8da21" returned: 0 in 0.520s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e44a1689-8585-4612-91cc-e6707c762269 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-de13b674-e15c-4c0a-a2a9-336aa6f8da21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-de13b674-e15c-4c0a-a2a9-336aa6f8da21.a64b3c2f-df9b-472b-b9f0-838753b3268c 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:57 devstack sudo[105787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-de13b674-e15c-4c0a-a2a9-336aa6f8da21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-de13b674-e15c-4c0a-a2a9-336aa6f8da21.a64b3c2f-df9b-472b-b9f0-838753b3268c 1G Sep 23 00:32:57 devstack sudo[105787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:57 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-56fe1863-7215-45c4-9da8-f0789f7b4037 tempest-ProjectReaderTests-1672073403 None] Acquiring lock "cinder-920d9234-ee87-4dfe-bfdc-8efcbb536cd2-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:57 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-56fe1863-7215-45c4-9da8-f0789f7b4037 tempest-ProjectReaderTests-1672073403 None] Lock "cinder-920d9234-ee87-4dfe-bfdc-8efcbb536cd2-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:58 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-56fe1863-7215-45c4-9da8-f0789f7b4037 tempest-ProjectReaderTests-1672073403 None] Acquiring lock "cinder-quobyte-920d9234-ee87-4dfe-bfdc-8efcbb536cd2" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:58 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-56fe1863-7215-45c4-9da8-f0789f7b4037 tempest-ProjectReaderTests-1672073403 None] Lock "cinder-quobyte-920d9234-ee87-4dfe-bfdc-8efcbb536cd2" acquired by "delete_volume" :: waited 0.024s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:58 devstack sudo[105787]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e44a1689-8585-4612-91cc-e6707c762269 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-de13b674-e15c-4c0a-a2a9-336aa6f8da21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-de13b674-e15c-4c0a-a2a9-336aa6f8da21.a64b3c2f-df9b-472b-b9f0-838753b3268c 1G" returned: 0 in 0.696s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e44a1689-8585-4612-91cc-e6707c762269 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de13b674-e15c-4c0a-a2a9-336aa6f8da21 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-de13b674-e15c-4c0a-a2a9-336aa6f8da21.a64b3c2f-df9b-472b-b9f0-838753b3268c {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:58 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1e9c85-b225-4a0b-82b9-03a84abab498]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-56fe1863-7215-45c4-9da8-f0789f7b4037 tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-920d9234-ee87-4dfe-bfdc-8efcbb536cd2 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:58 devstack sudo[105793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de13b674-e15c-4c0a-a2a9-336aa6f8da21 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-de13b674-e15c-4c0a-a2a9-336aa6f8da21.a64b3c2f-df9b-472b-b9f0-838753b3268c Sep 23 00:32:58 devstack sudo[105793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:58 devstack sudo[105795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-920d9234-ee87-4dfe-bfdc-8efcbb536cd2 Sep 23 00:32:58 devstack sudo[105795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0f994ee3-078c-44e0-968f-e5ba30f2f57a tempest-ProjectAdminTests-577478876 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5221061706543, 'free_capacity_gb': 1775.5221061706543, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86591) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 23 00:32:58 devstack sudo[105793]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e44a1689-8585-4612-91cc-e6707c762269 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de13b674-e15c-4c0a-a2a9-336aa6f8da21 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-de13b674-e15c-4c0a-a2a9-336aa6f8da21.a64b3c2f-df9b-472b-b9f0-838753b3268c" returned: 0 in 0.366s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:58 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-e44a1689-8585-4612-91cc-e6707c762269 tempest-ProjectMemberTests-2104250010 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-de13b674-e15c-4c0a-a2a9-336aa6f8da21.a64b3c2f-df9b-472b-b9f0-838753b3268c is being set with open permissions: ugo+rw Sep 23 00:32:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e44a1689-8585-4612-91cc-e6707c762269 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-de13b674-e15c-4c0a-a2a9-336aa6f8da21.a64b3c2f-df9b-472b-b9f0-838753b3268c {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:58 devstack sudo[105800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-de13b674-e15c-4c0a-a2a9-336aa6f8da21.a64b3c2f-df9b-472b-b9f0-838753b3268c Sep 23 00:32:58 devstack sudo[105800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:58 devstack sudo[105795]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-56fe1863-7215-45c4-9da8-f0789f7b4037 tempest-ProjectReaderTests-1672073403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-920d9234-ee87-4dfe-bfdc-8efcbb536cd2" returned: 0 in 0.522s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-56fe1863-7215-45c4-9da8-f0789f7b4037 tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-920d9234-ee87-4dfe-bfdc-8efcbb536cd2 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:58 devstack sudo[105805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-920d9234-ee87-4dfe-bfdc-8efcbb536cd2 Sep 23 00:32:58 devstack sudo[105805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:58 devstack sudo[105800]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e44a1689-8585-4612-91cc-e6707c762269 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-de13b674-e15c-4c0a-a2a9-336aa6f8da21.a64b3c2f-df9b-472b-b9f0-838753b3268c" returned: 0 in 0.461s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e44a1689-8585-4612-91cc-e6707c762269 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-de13b674-e15c-4c0a-a2a9-336aa6f8da21.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:59 devstack sudo[105805]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-56fe1863-7215-45c4-9da8-f0789f7b4037 tempest-ProjectReaderTests-1672073403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-920d9234-ee87-4dfe-bfdc-8efcbb536cd2" returned: 0 in 0.360s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:59 devstack sudo[105809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-de13b674-e15c-4c0a-a2a9-336aa6f8da21.info Sep 23 00:32:59 devstack sudo[105809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:59 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-56fe1863-7215-45c4-9da8-f0789f7b4037 tempest-ProjectReaderTests-1672073403 None] Lock "cinder-quobyte-920d9234-ee87-4dfe-bfdc-8efcbb536cd2" released by "delete_volume" :: held 0.994s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:59 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-56fe1863-7215-45c4-9da8-f0789f7b4037 tempest-ProjectReaderTests-1672073403 None] Created reservations ['9f719b9b-77c1-4da9-ae7d-3f259f1568c7', 'e073d237-d87e-4e42-97c3-2d735224058e', '9e3590f0-982f-44b2-ab59-cbaf9c7e2670', '4d28bb0f-377b-4216-8a38-eb5fa8547d49'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-56fe1863-7215-45c4-9da8-f0789f7b4037 tempest-ProjectReaderTests-1672073403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-56fe1863-7215-45c4-9da8-f0789f7b4037 tempest-ProjectReaderTests-1672073403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-56fe1863-7215-45c4-9da8-f0789f7b4037 tempest-ProjectReaderTests-1672073403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-56fe1863-7215-45c4-9da8-f0789f7b4037 tempest-ProjectReaderTests-1672073403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-56fe1863-7215-45c4-9da8-f0789f7b4037 tempest-ProjectReaderTests-1672073403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-56fe1863-7215-45c4-9da8-f0789f7b4037 tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:59 devstack sudo[105811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:32:59 devstack sudo[105811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:59 devstack sudo[105809]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e44a1689-8585-4612-91cc-e6707c762269 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-de13b674-e15c-4c0a-a2a9-336aa6f8da21.info" returned: 0 in 0.452s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:59 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-e44a1689-8585-4612-91cc-e6707c762269 tempest-ProjectMemberTests-2104250010 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-de13b674-e15c-4c0a-a2a9-336aa6f8da21.info is being set with open permissions: ugo+rw Sep 23 00:32:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e44a1689-8585-4612-91cc-e6707c762269 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-de13b674-e15c-4c0a-a2a9-336aa6f8da21.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:59 devstack sudo[105814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-de13b674-e15c-4c0a-a2a9-336aa6f8da21.info Sep 23 00:32:59 devstack sudo[105814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:59 devstack sudo[105811]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-56fe1863-7215-45c4-9da8-f0789f7b4037 tempest-ProjectReaderTests-1672073403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.351s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:59 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-56fe1863-7215-45c4-9da8-f0789f7b4037 tempest-ProjectReaderTests-1672073403 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:59 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-56fe1863-7215-45c4-9da8-f0789f7b4037 tempest-ProjectReaderTests-1672073403 None] Deleted volume successfully. Sep 23 00:32:59 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-56fe1863-7215-45c4-9da8-f0789f7b4037 tempest-ProjectReaderTests-1672073403 None] Lock "cinder-920d9234-ee87-4dfe-bfdc-8efcbb536cd2-delete_volume" released by "delete_volume" :: held 1.736s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:59 devstack sudo[105814]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e44a1689-8585-4612-91cc-e6707c762269 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-de13b674-e15c-4c0a-a2a9-336aa6f8da21.info" returned: 0 in 0.364s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e44a1689-8585-4612-91cc-e6707c762269 tempest-ProjectMemberTests-2104250010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.023s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:59 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-e44a1689-8585-4612-91cc-e6707c762269 tempest-ProjectMemberTests-2104250010 None] Create snapshot completed successfully Sep 23 00:33:00 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c9fab062-fa73-4e1c-90f3-cef1124df97e tempest-ProjectMemberTests-2104250010 None] Acquiring lock "cinder-a64b3c2f-df9b-472b-b9f0-838753b3268c-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:00 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c9fab062-fa73-4e1c-90f3-cef1124df97e tempest-ProjectMemberTests-2104250010 None] Lock "cinder-a64b3c2f-df9b-472b-b9f0-838753b3268c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:00 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c9fab062-fa73-4e1c-90f3-cef1124df97e tempest-ProjectMemberTests-2104250010 None] Acquiring lock "cinder-quobyte-de13b674-e15c-4c0a-a2a9-336aa6f8da21" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:00 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c9fab062-fa73-4e1c-90f3-cef1124df97e tempest-ProjectMemberTests-2104250010 None] Lock "cinder-quobyte-de13b674-e15c-4c0a-a2a9-336aa6f8da21" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:00 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c9fab062-fa73-4e1c-90f3-cef1124df97e tempest-ProjectMemberTests-2104250010 None] Acquiring lock "cinder-quobyte-a64b3c2f-df9b-472b-b9f0-838753b3268c" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:00 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c9fab062-fa73-4e1c-90f3-cef1124df97e tempest-ProjectMemberTests-2104250010 None] Lock "cinder-quobyte-a64b3c2f-df9b-472b-b9f0-838753b3268c" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:00 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-c9fab062-fa73-4e1c-90f3-cef1124df97e tempest-ProjectMemberTests-2104250010 None] Deleting offline snapshot a64b3c2f-df9b-472b-b9f0-838753b3268c of volume de13b674-e15c-4c0a-a2a9-336aa6f8da21 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:33:00 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-c9fab062-fa73-4e1c-90f3-cef1124df97e tempest-ProjectMemberTests-2104250010 None] snapshot_file for this snap is: volume-de13b674-e15c-4c0a-a2a9-336aa6f8da21.a64b3c2f-df9b-472b-b9f0-838753b3268c {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:33:00 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b30c09d-8f5f-4734-b9b8-6bccae2e5bd8]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c9fab062-fa73-4e1c-90f3-cef1124df97e tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-de13b674-e15c-4c0a-a2a9-336aa6f8da21.a64b3c2f-df9b-472b-b9f0-838753b3268c {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:00 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-de13b674-e15c-4c0a-a2a9-336aa6f8da21.a64b3c2f-df9b-472b-b9f0-838753b3268c Sep 23 00:33:00 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:00 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c9fab062-fa73-4e1c-90f3-cef1124df97e tempest-ProjectMemberTests-2104250010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-de13b674-e15c-4c0a-a2a9-336aa6f8da21.a64b3c2f-df9b-472b-b9f0-838753b3268c" returned: 0 in 0.662s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:00 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-c9fab062-fa73-4e1c-90f3-cef1124df97e tempest-ProjectMemberTests-2104250010 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de13b674-e15c-4c0a-a2a9-336aa6f8da21(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:33:00 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef6b495-4533-43c2-9b1b-327a41b8cbe2]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:00 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c9fab062-fa73-4e1c-90f3-cef1124df97e tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-de13b674-e15c-4c0a-a2a9-336aa6f8da21 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:01 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-18232ebd-de11-46db-b1b5-2f5cde94e0b1 tempest-ProjectReaderTests-1672073403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:33:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-18232ebd-de11-46db-b1b5-2f5cde94e0b1 tempest-ProjectReaderTests-1672073403 None] Flow 'volume_create_manager' (5e395502-6326-47d7-b7bd-1a01b06b4964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:01 devstack sudo[105823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-de13b674-e15c-4c0a-a2a9-336aa6f8da21 Sep 23 00:33:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-18232ebd-de11-46db-b1b5-2f5cde94e0b1 tempest-ProjectReaderTests-1672073403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9302fe51-9c89-4a19-865f-542dbe5c42bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:01 devstack sudo[105823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-18232ebd-de11-46db-b1b5-2f5cde94e0b1 tempest-ProjectReaderTests-1672073403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9302fe51-9c89-4a19-865f-542dbe5c42bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1614000201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db058385-70ef-41d2-93e6-20330cd9bdec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a361786c5d944c5a73653e654c80def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:01Z,use_quota=True,user_id='f01a5c248a78434fb39a1d6e1e81a391',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-18232ebd-de11-46db-b1b5-2f5cde94e0b1 tempest-ProjectReaderTests-1672073403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8b8e17a-95c0-46e6-a607-0d8d943fc6ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-18232ebd-de11-46db-b1b5-2f5cde94e0b1 tempest-ProjectReaderTests-1672073403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8b8e17a-95c0-46e6-a607-0d8d943fc6ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-18232ebd-de11-46db-b1b5-2f5cde94e0b1 tempest-ProjectReaderTests-1672073403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc360b2c-0153-41f8-bc1d-5a7d332b5f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-18232ebd-de11-46db-b1b5-2f5cde94e0b1 tempest-ProjectReaderTests-1672073403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc360b2c-0153-41f8-bc1d-5a7d332b5f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db058385-70ef-41d2-93e6-20330cd9bdec', 'volume_name': 'volume-db058385-70ef-41d2-93e6-20330cd9bdec', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-18232ebd-de11-46db-b1b5-2f5cde94e0b1 tempest-ProjectReaderTests-1672073403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d7112d8-3892-464a-b661-b2dcc9bb2ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-18232ebd-de11-46db-b1b5-2f5cde94e0b1 tempest-ProjectReaderTests-1672073403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d7112d8-3892-464a-b661-b2dcc9bb2ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:01 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-18232ebd-de11-46db-b1b5-2f5cde94e0b1 tempest-ProjectReaderTests-1672073403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (126c9a77-2ba6-4b8f-9051-4f2070d01d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:01 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-18232ebd-de11-46db-b1b5-2f5cde94e0b1 tempest-ProjectReaderTests-1672073403 None] Volume db058385-70ef-41d2-93e6-20330cd9bdec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db058385-70ef-41d2-93e6-20330cd9bdec', 'volume_size': 1} Sep 23 00:33:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-18232ebd-de11-46db-b1b5-2f5cde94e0b1 tempest-ProjectReaderTests-1672073403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-18232ebd-de11-46db-b1b5-2f5cde94e0b1 tempest-ProjectReaderTests-1672073403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-18232ebd-de11-46db-b1b5-2f5cde94e0b1 tempest-ProjectReaderTests-1672073403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1614000201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db058385-70ef-41d2-93e6-20330cd9bdec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a361786c5d944c5a73653e654c80def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:01Z,use_quota=True,user_id='f01a5c248a78434fb39a1d6e1e81a391',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:33:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-18232ebd-de11-46db-b1b5-2f5cde94e0b1 tempest-ProjectReaderTests-1672073403 None] Creating volume db058385-70ef-41d2-93e6-20330cd9bdec {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:33:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-18232ebd-de11-46db-b1b5-2f5cde94e0b1 tempest-ProjectReaderTests-1672073403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-18232ebd-de11-46db-b1b5-2f5cde94e0b1 tempest-ProjectReaderTests-1672073403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-18232ebd-de11-46db-b1b5-2f5cde94e0b1 tempest-ProjectReaderTests-1672073403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-18232ebd-de11-46db-b1b5-2f5cde94e0b1 tempest-ProjectReaderTests-1672073403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-18232ebd-de11-46db-b1b5-2f5cde94e0b1 tempest-ProjectReaderTests-1672073403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-18232ebd-de11-46db-b1b5-2f5cde94e0b1 tempest-ProjectReaderTests-1672073403 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:33:01 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-18232ebd-de11-46db-b1b5-2f5cde94e0b1 tempest-ProjectReaderTests-1672073403 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:33:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-18232ebd-de11-46db-b1b5-2f5cde94e0b1 tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db058385-70ef-41d2-93e6-20330cd9bdec 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:01 devstack sudo[105825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db058385-70ef-41d2-93e6-20330cd9bdec 1073741824 Sep 23 00:33:01 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:01 devstack sudo[105823]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c9fab062-fa73-4e1c-90f3-cef1124df97e tempest-ProjectMemberTests-2104250010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-de13b674-e15c-4c0a-a2a9-336aa6f8da21" returned: 0 in 0.522s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c9fab062-fa73-4e1c-90f3-cef1124df97e tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-de13b674-e15c-4c0a-a2a9-336aa6f8da21.a64b3c2f-df9b-472b-b9f0-838753b3268c {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:01 devstack sudo[105830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-de13b674-e15c-4c0a-a2a9-336aa6f8da21.a64b3c2f-df9b-472b-b9f0-838753b3268c Sep 23 00:33:01 devstack sudo[105830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:02 devstack sudo[105830]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c9fab062-fa73-4e1c-90f3-cef1124df97e tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-de13b674-e15c-4c0a-a2a9-336aa6f8da21.a64b3c2f-df9b-472b-b9f0-838753b3268c" returned: 0 in 0.537s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c9fab062-fa73-4e1c-90f3-cef1124df97e tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-de13b674-e15c-4c0a-a2a9-336aa6f8da21.a64b3c2f-df9b-472b-b9f0-838753b3268c {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:02 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-18232ebd-de11-46db-b1b5-2f5cde94e0b1 tempest-ProjectReaderTests-1672073403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db058385-70ef-41d2-93e6-20330cd9bdec 1073741824" returned: 0 in 0.764s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:02 devstack sudo[105838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-de13b674-e15c-4c0a-a2a9-336aa6f8da21.a64b3c2f-df9b-472b-b9f0-838753b3268c Sep 23 00:33:02 devstack sudo[105838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-18232ebd-de11-46db-b1b5-2f5cde94e0b1 tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db058385-70ef-41d2-93e6-20330cd9bdec {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:02 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db058385-70ef-41d2-93e6-20330cd9bdec Sep 23 00:33:02 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:02 devstack sudo[105838]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c9fab062-fa73-4e1c-90f3-cef1124df97e tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-de13b674-e15c-4c0a-a2a9-336aa6f8da21.a64b3c2f-df9b-472b-b9f0-838753b3268c" returned: 0 in 0.364s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:02 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-18232ebd-de11-46db-b1b5-2f5cde94e0b1 tempest-ProjectReaderTests-1672073403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db058385-70ef-41d2-93e6-20330cd9bdec" returned: 0 in 0.349s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:02 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-18232ebd-de11-46db-b1b5-2f5cde94e0b1 tempest-ProjectReaderTests-1672073403 None] <== create_volume: return (1187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:33:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-18232ebd-de11-46db-b1b5-2f5cde94e0b1 tempest-ProjectReaderTests-1672073403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.190s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:02 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c9fab062-fa73-4e1c-90f3-cef1124df97e tempest-ProjectMemberTests-2104250010 None] Lock "cinder-quobyte-a64b3c2f-df9b-472b-b9f0-838753b3268c" released by "_delete_snapshot" :: held 2.295s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:02 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-18232ebd-de11-46db-b1b5-2f5cde94e0b1 tempest-ProjectReaderTests-1672073403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (126c9a77-2ba6-4b8f-9051-4f2070d01d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db058385-70ef-41d2-93e6-20330cd9bdec', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:02 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-18232ebd-de11-46db-b1b5-2f5cde94e0b1 tempest-ProjectReaderTests-1672073403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (363f35fd-f891-4ce3-a85e-68fbdcb330b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:02 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c9fab062-fa73-4e1c-90f3-cef1124df97e tempest-ProjectMemberTests-2104250010 None] Lock "cinder-quobyte-de13b674-e15c-4c0a-a2a9-336aa6f8da21" released by "delete_snapshot" :: held 2.342s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:02 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-18232ebd-de11-46db-b1b5-2f5cde94e0b1 tempest-ProjectReaderTests-1672073403 None] Volume volume-db058385-70ef-41d2-93e6-20330cd9bdec (db058385-70ef-41d2-93e6-20330cd9bdec): created successfully Sep 23 00:33:02 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-18232ebd-de11-46db-b1b5-2f5cde94e0b1 tempest-ProjectReaderTests-1672073403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (363f35fd-f891-4ce3-a85e-68fbdcb330b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:02 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-18232ebd-de11-46db-b1b5-2f5cde94e0b1 tempest-ProjectReaderTests-1672073403 None] Flow 'volume_create_manager' (5e395502-6326-47d7-b7bd-1a01b06b4964) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:02 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-18232ebd-de11-46db-b1b5-2f5cde94e0b1 tempest-ProjectReaderTests-1672073403 None] Created volume successfully. Sep 23 00:33:02 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-c9fab062-fa73-4e1c-90f3-cef1124df97e tempest-ProjectMemberTests-2104250010 None] Created reservations ['fb338549-bdae-4881-b18a-ddaa643aa071', '950fae1e-3ea5-4804-8d36-f1a827db9047', '6fc699e8-b619-4c7d-8d54-d3a682dfed5c', 'e9f87457-ca6e-4527-960f-a0e834f74dca'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:33:02 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-c9fab062-fa73-4e1c-90f3-cef1124df97e tempest-ProjectMemberTests-2104250010 None] Delete snapshot completed successfully. Sep 23 00:33:02 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c9fab062-fa73-4e1c-90f3-cef1124df97e tempest-ProjectMemberTests-2104250010 None] Lock "cinder-a64b3c2f-df9b-472b-b9f0-838753b3268c-delete_snapshot" released by "delete_snapshot" :: held 2.589s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6c2fc674-e8e9-4227-b5f0-961f0c7a9763 tempest-ProjectReaderTests-1672073403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6c2fc674-e8e9-4227-b5f0-961f0c7a9763 tempest-ProjectReaderTests-1672073403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:03 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-6c2fc674-e8e9-4227-b5f0-961f0c7a9763 tempest-ProjectReaderTests-1672073403 None] Creating offline snapshot 417bba9b-62ff-4315-b3c8-33cde1b5174b of volume db058385-70ef-41d2-93e6-20330cd9bdec {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:33:03 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[46032418-e387-4aa5-86ed-93ddf0b5c9be]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6c2fc674-e8e9-4227-b5f0-961f0c7a9763 tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db058385-70ef-41d2-93e6-20330cd9bdec {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:03 devstack sudo[105844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db058385-70ef-41d2-93e6-20330cd9bdec Sep 23 00:33:03 devstack sudo[105844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:03 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5519f7cc-9152-4d7f-ac62-03c59d8742e3 tempest-ProjectMemberTests-2104250010 None] Acquiring lock "cinder-de13b674-e15c-4c0a-a2a9-336aa6f8da21-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:03 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5519f7cc-9152-4d7f-ac62-03c59d8742e3 tempest-ProjectMemberTests-2104250010 None] Lock "cinder-de13b674-e15c-4c0a-a2a9-336aa6f8da21-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:03 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5519f7cc-9152-4d7f-ac62-03c59d8742e3 tempest-ProjectMemberTests-2104250010 None] Acquiring lock "cinder-quobyte-de13b674-e15c-4c0a-a2a9-336aa6f8da21" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:03 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5519f7cc-9152-4d7f-ac62-03c59d8742e3 tempest-ProjectMemberTests-2104250010 None] Lock "cinder-quobyte-de13b674-e15c-4c0a-a2a9-336aa6f8da21" acquired by "delete_volume" :: waited 0.030s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:03 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e002c73-6d10-45f9-857a-a57fdc8699de]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5519f7cc-9152-4d7f-ac62-03c59d8742e3 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-de13b674-e15c-4c0a-a2a9-336aa6f8da21 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:04 devstack sudo[105846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-de13b674-e15c-4c0a-a2a9-336aa6f8da21 Sep 23 00:33:04 devstack sudo[105846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:04 devstack sudo[105844]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6c2fc674-e8e9-4227-b5f0-961f0c7a9763 tempest-ProjectReaderTests-1672073403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db058385-70ef-41d2-93e6-20330cd9bdec" returned: 0 in 0.745s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6c2fc674-e8e9-4227-b5f0-961f0c7a9763 tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db058385-70ef-41d2-93e6-20330cd9bdec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db058385-70ef-41d2-93e6-20330cd9bdec.417bba9b-62ff-4315-b3c8-33cde1b5174b 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:04 devstack sudo[105851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db058385-70ef-41d2-93e6-20330cd9bdec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db058385-70ef-41d2-93e6-20330cd9bdec.417bba9b-62ff-4315-b3c8-33cde1b5174b 1G Sep 23 00:33:04 devstack sudo[105851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:04 devstack sudo[105846]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5519f7cc-9152-4d7f-ac62-03c59d8742e3 tempest-ProjectMemberTests-2104250010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-de13b674-e15c-4c0a-a2a9-336aa6f8da21" returned: 0 in 0.693s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5519f7cc-9152-4d7f-ac62-03c59d8742e3 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-de13b674-e15c-4c0a-a2a9-336aa6f8da21 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:04 devstack sudo[105860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-de13b674-e15c-4c0a-a2a9-336aa6f8da21 Sep 23 00:33:04 devstack sudo[105860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:04 devstack sudo[105851]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6c2fc674-e8e9-4227-b5f0-961f0c7a9763 tempest-ProjectReaderTests-1672073403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db058385-70ef-41d2-93e6-20330cd9bdec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db058385-70ef-41d2-93e6-20330cd9bdec.417bba9b-62ff-4315-b3c8-33cde1b5174b 1G" returned: 0 in 0.700s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6c2fc674-e8e9-4227-b5f0-961f0c7a9763 tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db058385-70ef-41d2-93e6-20330cd9bdec -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db058385-70ef-41d2-93e6-20330cd9bdec.417bba9b-62ff-4315-b3c8-33cde1b5174b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:04 devstack sudo[105863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db058385-70ef-41d2-93e6-20330cd9bdec -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db058385-70ef-41d2-93e6-20330cd9bdec.417bba9b-62ff-4315-b3c8-33cde1b5174b Sep 23 00:33:04 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:05 devstack sudo[105860]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5519f7cc-9152-4d7f-ac62-03c59d8742e3 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-de13b674-e15c-4c0a-a2a9-336aa6f8da21" returned: 0 in 0.492s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:05 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5519f7cc-9152-4d7f-ac62-03c59d8742e3 tempest-ProjectMemberTests-2104250010 None] Lock "cinder-quobyte-de13b674-e15c-4c0a-a2a9-336aa6f8da21" released by "delete_volume" :: held 1.332s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:05 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-0000d1ac-60a6-4d84-93cf-8b8bf2eddae5 tempest-ProjectReaderTests-220319515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:33:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0000d1ac-60a6-4d84-93cf-8b8bf2eddae5 tempest-ProjectReaderTests-220319515 None] Flow 'volume_create_manager' (47a5c6fd-1a8f-46cf-b268-adfffcef3e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0000d1ac-60a6-4d84-93cf-8b8bf2eddae5 tempest-ProjectReaderTests-220319515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4199c69-af1e-4ef9-b58b-240cf6564363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:05 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-5519f7cc-9152-4d7f-ac62-03c59d8742e3 tempest-ProjectMemberTests-2104250010 None] Created reservations ['231b465f-cf50-4c2b-be89-7d56da2aaa01', '4bb0afa0-d9ee-4e19-8165-4c5237fa17d6', '2de91b7d-11f1-4f24-ac16-91d2a29b995a', 'bb8a7c3a-44e1-4f16-b99e-12a73cfda15f'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:33:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0000d1ac-60a6-4d84-93cf-8b8bf2eddae5 tempest-ProjectReaderTests-220319515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4199c69-af1e-4ef9-b58b-240cf6564363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-966807322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92b5606d-79a6-4133-9304-362ca5a77f07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='954070cdbc4249dd9b82987f4da6bc38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:05Z,use_quota=True,user_id='e10212d2d22b40a295a593e08b87fc92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0000d1ac-60a6-4d84-93cf-8b8bf2eddae5 tempest-ProjectReaderTests-220319515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (887188db-fba3-4f4a-9b25-46eaa6c70765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0000d1ac-60a6-4d84-93cf-8b8bf2eddae5 tempest-ProjectReaderTests-220319515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (887188db-fba3-4f4a-9b25-46eaa6c70765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0000d1ac-60a6-4d84-93cf-8b8bf2eddae5 tempest-ProjectReaderTests-220319515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0d01f8a-3cf0-4034-8641-70a6aaa5a60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0000d1ac-60a6-4d84-93cf-8b8bf2eddae5 tempest-ProjectReaderTests-220319515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0d01f8a-3cf0-4034-8641-70a6aaa5a60d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92b5606d-79a6-4133-9304-362ca5a77f07', 'volume_name': 'volume-92b5606d-79a6-4133-9304-362ca5a77f07', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0000d1ac-60a6-4d84-93cf-8b8bf2eddae5 tempest-ProjectReaderTests-220319515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (292b0dda-63be-4a48-afaa-9432717921d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0000d1ac-60a6-4d84-93cf-8b8bf2eddae5 tempest-ProjectReaderTests-220319515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (292b0dda-63be-4a48-afaa-9432717921d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:05 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0000d1ac-60a6-4d84-93cf-8b8bf2eddae5 tempest-ProjectReaderTests-220319515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24a199c3-b43c-4b1f-94c6-7a7d22d8b458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:05 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-0000d1ac-60a6-4d84-93cf-8b8bf2eddae5 tempest-ProjectReaderTests-220319515 None] Volume 92b5606d-79a6-4133-9304-362ca5a77f07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92b5606d-79a6-4133-9304-362ca5a77f07', 'volume_size': 1} Sep 23 00:33:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0000d1ac-60a6-4d84-93cf-8b8bf2eddae5 tempest-ProjectReaderTests-220319515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:05 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6c2fc674-e8e9-4227-b5f0-961f0c7a9763 tempest-ProjectReaderTests-1672073403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db058385-70ef-41d2-93e6-20330cd9bdec -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db058385-70ef-41d2-93e6-20330cd9bdec.417bba9b-62ff-4315-b3c8-33cde1b5174b" returned: 0 in 0.539s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:05 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-6c2fc674-e8e9-4227-b5f0-961f0c7a9763 tempest-ProjectReaderTests-1672073403 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db058385-70ef-41d2-93e6-20330cd9bdec.417bba9b-62ff-4315-b3c8-33cde1b5174b is being set with open permissions: ugo+rw Sep 23 00:33:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6c2fc674-e8e9-4227-b5f0-961f0c7a9763 tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db058385-70ef-41d2-93e6-20330cd9bdec.417bba9b-62ff-4315-b3c8-33cde1b5174b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:05 devstack sudo[105869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db058385-70ef-41d2-93e6-20330cd9bdec.417bba9b-62ff-4315-b3c8-33cde1b5174b Sep 23 00:33:05 devstack sudo[105869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5519f7cc-9152-4d7f-ac62-03c59d8742e3 tempest-ProjectMemberTests-2104250010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5519f7cc-9152-4d7f-ac62-03c59d8742e3 tempest-ProjectMemberTests-2104250010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:05 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5519f7cc-9152-4d7f-ac62-03c59d8742e3 tempest-ProjectMemberTests-2104250010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:05 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-5519f7cc-9152-4d7f-ac62-03c59d8742e3 tempest-ProjectMemberTests-2104250010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-5519f7cc-9152-4d7f-ac62-03c59d8742e3 tempest-ProjectMemberTests-2104250010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5519f7cc-9152-4d7f-ac62-03c59d8742e3 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:05 devstack sudo[105871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:33:05 devstack sudo[105871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:05 devstack sudo[105871]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5519f7cc-9152-4d7f-ac62-03c59d8742e3 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.296s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:05 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-5519f7cc-9152-4d7f-ac62-03c59d8742e3 tempest-ProjectMemberTests-2104250010 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:33:05 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-5519f7cc-9152-4d7f-ac62-03c59d8742e3 tempest-ProjectMemberTests-2104250010 None] Deleted volume successfully. Sep 23 00:33:05 devstack sudo[105869]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6c2fc674-e8e9-4227-b5f0-961f0c7a9763 tempest-ProjectReaderTests-1672073403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db058385-70ef-41d2-93e6-20330cd9bdec.417bba9b-62ff-4315-b3c8-33cde1b5174b" returned: 0 in 0.422s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:05 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5519f7cc-9152-4d7f-ac62-03c59d8742e3 tempest-ProjectMemberTests-2104250010 None] Lock "cinder-de13b674-e15c-4c0a-a2a9-336aa6f8da21-delete_volume" released by "delete_volume" :: held 2.197s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6c2fc674-e8e9-4227-b5f0-961f0c7a9763 tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db058385-70ef-41d2-93e6-20330cd9bdec.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:05 devstack sudo[105875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db058385-70ef-41d2-93e6-20330cd9bdec.info Sep 23 00:33:05 devstack sudo[105875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:06 devstack sudo[105875]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6c2fc674-e8e9-4227-b5f0-961f0c7a9763 tempest-ProjectReaderTests-1672073403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db058385-70ef-41d2-93e6-20330cd9bdec.info" returned: 0 in 0.325s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:06 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-6c2fc674-e8e9-4227-b5f0-961f0c7a9763 tempest-ProjectReaderTests-1672073403 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db058385-70ef-41d2-93e6-20330cd9bdec.info is being set with open permissions: ugo+rw Sep 23 00:33:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6c2fc674-e8e9-4227-b5f0-961f0c7a9763 tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db058385-70ef-41d2-93e6-20330cd9bdec.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:06 devstack sudo[105878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db058385-70ef-41d2-93e6-20330cd9bdec.info Sep 23 00:33:06 devstack sudo[105878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:06 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-29d972a3-7431-4373-8f56-a01c628cc5cf tempest-SnapshotDependencyTests-1390060396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:33:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-29d972a3-7431-4373-8f56-a01c628cc5cf tempest-SnapshotDependencyTests-1390060396 None] Flow 'volume_create_manager' (253f6678-0044-4f84-9e24-0f8a6f22436f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-29d972a3-7431-4373-8f56-a01c628cc5cf tempest-SnapshotDependencyTests-1390060396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67da1aea-a182-4f82-8625-d5d6ff90cfec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-29d972a3-7431-4373-8f56-a01c628cc5cf tempest-SnapshotDependencyTests-1390060396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67da1aea-a182-4f82-8625-d5d6ff90cfec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1484652260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06d7ad66-fb05-4190-9735-cf197f846a9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbd9312d53b74e20b489247f9b58e4d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:06Z,use_quota=True,user_id='fbec4c6d1f504dc4a925822df8fc2876',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-29d972a3-7431-4373-8f56-a01c628cc5cf tempest-SnapshotDependencyTests-1390060396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15d64129-2d0f-4f6e-8069-5296d05c3155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-29d972a3-7431-4373-8f56-a01c628cc5cf tempest-SnapshotDependencyTests-1390060396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15d64129-2d0f-4f6e-8069-5296d05c3155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-29d972a3-7431-4373-8f56-a01c628cc5cf tempest-SnapshotDependencyTests-1390060396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d3cf183-d7d9-450d-8d6e-a6c22f10b9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-29d972a3-7431-4373-8f56-a01c628cc5cf tempest-SnapshotDependencyTests-1390060396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d3cf183-d7d9-450d-8d6e-a6c22f10b9a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06d7ad66-fb05-4190-9735-cf197f846a9a', 'volume_name': 'volume-06d7ad66-fb05-4190-9735-cf197f846a9a', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-29d972a3-7431-4373-8f56-a01c628cc5cf tempest-SnapshotDependencyTests-1390060396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8b39482-3ff1-417e-8848-21dfd40f5fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-29d972a3-7431-4373-8f56-a01c628cc5cf tempest-SnapshotDependencyTests-1390060396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8b39482-3ff1-417e-8848-21dfd40f5fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-29d972a3-7431-4373-8f56-a01c628cc5cf tempest-SnapshotDependencyTests-1390060396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca323237-0ae2-4360-92ce-5dfc67b3c118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:06 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-29d972a3-7431-4373-8f56-a01c628cc5cf tempest-SnapshotDependencyTests-1390060396 None] Volume 06d7ad66-fb05-4190-9735-cf197f846a9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06d7ad66-fb05-4190-9735-cf197f846a9a', 'volume_size': 1} Sep 23 00:33:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-29d972a3-7431-4373-8f56-a01c628cc5cf tempest-SnapshotDependencyTests-1390060396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:06 devstack sudo[105878]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-6c2fc674-e8e9-4227-b5f0-961f0c7a9763 tempest-ProjectReaderTests-1672073403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db058385-70ef-41d2-93e6-20330cd9bdec.info" returned: 0 in 0.290s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-6c2fc674-e8e9-4227-b5f0-961f0c7a9763 tempest-ProjectReaderTests-1672073403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.176s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0000d1ac-60a6-4d84-93cf-8b8bf2eddae5 tempest-ProjectReaderTests-220319515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.151s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0000d1ac-60a6-4d84-93cf-8b8bf2eddae5 tempest-ProjectReaderTests-220319515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-966807322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92b5606d-79a6-4133-9304-362ca5a77f07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='954070cdbc4249dd9b82987f4da6bc38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:05Z,use_quota=True,user_id='e10212d2d22b40a295a593e08b87fc92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:33:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-0000d1ac-60a6-4d84-93cf-8b8bf2eddae5 tempest-ProjectReaderTests-220319515 None] Creating volume 92b5606d-79a6-4133-9304-362ca5a77f07 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:33:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0000d1ac-60a6-4d84-93cf-8b8bf2eddae5 tempest-ProjectReaderTests-220319515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0000d1ac-60a6-4d84-93cf-8b8bf2eddae5 tempest-ProjectReaderTests-220319515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0000d1ac-60a6-4d84-93cf-8b8bf2eddae5 tempest-ProjectReaderTests-220319515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0000d1ac-60a6-4d84-93cf-8b8bf2eddae5 tempest-ProjectReaderTests-220319515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0000d1ac-60a6-4d84-93cf-8b8bf2eddae5 tempest-ProjectReaderTests-220319515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0000d1ac-60a6-4d84-93cf-8b8bf2eddae5 tempest-ProjectReaderTests-220319515 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:33:06 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-0000d1ac-60a6-4d84-93cf-8b8bf2eddae5 tempest-ProjectReaderTests-220319515 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:33:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0000d1ac-60a6-4d84-93cf-8b8bf2eddae5 tempest-ProjectReaderTests-220319515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-92b5606d-79a6-4133-9304-362ca5a77f07 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:06 devstack sudo[105881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-92b5606d-79a6-4133-9304-362ca5a77f07 1073741824 Sep 23 00:33:06 devstack sudo[105881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:06 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-8291e1dd-ae75-4338-82ef-79ad33ded973 tempest-ProjectMemberTests-2104250010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:33:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8291e1dd-ae75-4338-82ef-79ad33ded973 tempest-ProjectMemberTests-2104250010 None] Flow 'volume_create_manager' (8d76a698-348b-45b3-a4d7-d637bca224e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8291e1dd-ae75-4338-82ef-79ad33ded973 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0458d13c-e4f6-4768-9bef-893a55d0a8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:06 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-6c2fc674-e8e9-4227-b5f0-961f0c7a9763 tempest-ProjectReaderTests-1672073403 None] Create snapshot completed successfully Sep 23 00:33:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8291e1dd-ae75-4338-82ef-79ad33ded973 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0458d13c-e4f6-4768-9bef-893a55d0a8b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1887548803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7ec8cc8-d1aa-4baa-8eac-3224b3661300,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='105e2fcb253445d18a9a36e4adbf6662',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:06Z,use_quota=True,user_id='6f62c0bf87c2488e987066aaecad1a03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8291e1dd-ae75-4338-82ef-79ad33ded973 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a3cc165-6a8b-4c29-8444-7a0cfef58692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8291e1dd-ae75-4338-82ef-79ad33ded973 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a3cc165-6a8b-4c29-8444-7a0cfef58692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8291e1dd-ae75-4338-82ef-79ad33ded973 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8a827ab-23e3-4c88-ac48-cb2912062570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8291e1dd-ae75-4338-82ef-79ad33ded973 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8a827ab-23e3-4c88-ac48-cb2912062570) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7ec8cc8-d1aa-4baa-8eac-3224b3661300', 'volume_name': 'volume-d7ec8cc8-d1aa-4baa-8eac-3224b3661300', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8291e1dd-ae75-4338-82ef-79ad33ded973 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1129ebb6-1cbe-4b1a-93a5-972cc9d23f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8291e1dd-ae75-4338-82ef-79ad33ded973 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1129ebb6-1cbe-4b1a-93a5-972cc9d23f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:06 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8291e1dd-ae75-4338-82ef-79ad33ded973 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (849f1a18-8960-461c-942a-5ec45b93139b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:06 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-8291e1dd-ae75-4338-82ef-79ad33ded973 tempest-ProjectMemberTests-2104250010 None] Volume d7ec8cc8-d1aa-4baa-8eac-3224b3661300: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7ec8cc8-d1aa-4baa-8eac-3224b3661300', 'volume_size': 1} Sep 23 00:33:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8291e1dd-ae75-4338-82ef-79ad33ded973 tempest-ProjectMemberTests-2104250010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:06 devstack sudo[105881]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0000d1ac-60a6-4d84-93cf-8b8bf2eddae5 tempest-ProjectReaderTests-220319515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-92b5606d-79a6-4133-9304-362ca5a77f07 1073741824" returned: 0 in 0.448s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0000d1ac-60a6-4d84-93cf-8b8bf2eddae5 tempest-ProjectReaderTests-220319515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-92b5606d-79a6-4133-9304-362ca5a77f07 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:07 devstack sudo[105887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-92b5606d-79a6-4133-9304-362ca5a77f07 Sep 23 00:33:07 devstack sudo[105887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:07 devstack sudo[105887]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0000d1ac-60a6-4d84-93cf-8b8bf2eddae5 tempest-ProjectReaderTests-220319515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-92b5606d-79a6-4133-9304-362ca5a77f07" returned: 0 in 0.297s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:07 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0000d1ac-60a6-4d84-93cf-8b8bf2eddae5 tempest-ProjectReaderTests-220319515 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:33:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0000d1ac-60a6-4d84-93cf-8b8bf2eddae5 tempest-ProjectReaderTests-220319515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-29d972a3-7431-4373-8f56-a01c628cc5cf tempest-SnapshotDependencyTests-1390060396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.946s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:07 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-29d972a3-7431-4373-8f56-a01c628cc5cf tempest-SnapshotDependencyTests-1390060396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1484652260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06d7ad66-fb05-4190-9735-cf197f846a9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbd9312d53b74e20b489247f9b58e4d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:06Z,use_quota=True,user_id='fbec4c6d1f504dc4a925822df8fc2876',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:33:07 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-29d972a3-7431-4373-8f56-a01c628cc5cf tempest-SnapshotDependencyTests-1390060396 None] Creating volume 06d7ad66-fb05-4190-9735-cf197f846a9a {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:33:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-29d972a3-7431-4373-8f56-a01c628cc5cf tempest-SnapshotDependencyTests-1390060396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-29d972a3-7431-4373-8f56-a01c628cc5cf tempest-SnapshotDependencyTests-1390060396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:07 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-29d972a3-7431-4373-8f56-a01c628cc5cf tempest-SnapshotDependencyTests-1390060396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:07 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-29d972a3-7431-4373-8f56-a01c628cc5cf tempest-SnapshotDependencyTests-1390060396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-29d972a3-7431-4373-8f56-a01c628cc5cf tempest-SnapshotDependencyTests-1390060396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:07 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-29d972a3-7431-4373-8f56-a01c628cc5cf tempest-SnapshotDependencyTests-1390060396 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:33:07 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-29d972a3-7431-4373-8f56-a01c628cc5cf tempest-SnapshotDependencyTests-1390060396 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:33:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-29d972a3-7431-4373-8f56-a01c628cc5cf tempest-SnapshotDependencyTests-1390060396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-06d7ad66-fb05-4190-9735-cf197f846a9a 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0000d1ac-60a6-4d84-93cf-8b8bf2eddae5 tempest-ProjectReaderTests-220319515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24a199c3-b43c-4b1f-94c6-7a7d22d8b458) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92b5606d-79a6-4133-9304-362ca5a77f07', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:07 devstack sudo[105890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-06d7ad66-fb05-4190-9735-cf197f846a9a 1073741824 Sep 23 00:33:07 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0000d1ac-60a6-4d84-93cf-8b8bf2eddae5 tempest-ProjectReaderTests-220319515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b6d7b04-2fdb-44c1-8942-d9f9dc68396c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:07 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-0000d1ac-60a6-4d84-93cf-8b8bf2eddae5 tempest-ProjectReaderTests-220319515 None] Volume volume-92b5606d-79a6-4133-9304-362ca5a77f07 (92b5606d-79a6-4133-9304-362ca5a77f07): created successfully Sep 23 00:33:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0000d1ac-60a6-4d84-93cf-8b8bf2eddae5 tempest-ProjectReaderTests-220319515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b6d7b04-2fdb-44c1-8942-d9f9dc68396c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:07 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0000d1ac-60a6-4d84-93cf-8b8bf2eddae5 tempest-ProjectReaderTests-220319515 None] Flow 'volume_create_manager' (47a5c6fd-1a8f-46cf-b268-adfffcef3e2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:07 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-0000d1ac-60a6-4d84-93cf-8b8bf2eddae5 tempest-ProjectReaderTests-220319515 None] Created volume successfully. Sep 23 00:33:07 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-1b0a0b52-ca42-4a96-98b1-a394e8bfb86d tempest-ProjectReaderTests-1672073403 None] Acquiring lock "cinder-417bba9b-62ff-4315-b3c8-33cde1b5174b-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:07 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-1b0a0b52-ca42-4a96-98b1-a394e8bfb86d tempest-ProjectReaderTests-1672073403 None] Lock "cinder-417bba9b-62ff-4315-b3c8-33cde1b5174b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:07 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-1b0a0b52-ca42-4a96-98b1-a394e8bfb86d tempest-ProjectReaderTests-1672073403 None] Acquiring lock "cinder-quobyte-db058385-70ef-41d2-93e6-20330cd9bdec" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:07 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-1b0a0b52-ca42-4a96-98b1-a394e8bfb86d tempest-ProjectReaderTests-1672073403 None] Lock "cinder-quobyte-db058385-70ef-41d2-93e6-20330cd9bdec" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:07 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-1b0a0b52-ca42-4a96-98b1-a394e8bfb86d tempest-ProjectReaderTests-1672073403 None] Acquiring lock "cinder-quobyte-417bba9b-62ff-4315-b3c8-33cde1b5174b" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:07 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-1b0a0b52-ca42-4a96-98b1-a394e8bfb86d tempest-ProjectReaderTests-1672073403 None] Lock "cinder-quobyte-417bba9b-62ff-4315-b3c8-33cde1b5174b" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:07 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-1b0a0b52-ca42-4a96-98b1-a394e8bfb86d tempest-ProjectReaderTests-1672073403 None] Deleting offline snapshot 417bba9b-62ff-4315-b3c8-33cde1b5174b of volume db058385-70ef-41d2-93e6-20330cd9bdec {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:33:07 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-1b0a0b52-ca42-4a96-98b1-a394e8bfb86d tempest-ProjectReaderTests-1672073403 None] snapshot_file for this snap is: volume-db058385-70ef-41d2-93e6-20330cd9bdec.417bba9b-62ff-4315-b3c8-33cde1b5174b {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:33:07 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f08d3c5-9a9e-4913-8c0a-a401a08b9c94]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1b0a0b52-ca42-4a96-98b1-a394e8bfb86d tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db058385-70ef-41d2-93e6-20330cd9bdec.417bba9b-62ff-4315-b3c8-33cde1b5174b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:07 devstack sudo[105896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db058385-70ef-41d2-93e6-20330cd9bdec.417bba9b-62ff-4315-b3c8-33cde1b5174b Sep 23 00:33:07 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:07 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-29d972a3-7431-4373-8f56-a01c628cc5cf tempest-SnapshotDependencyTests-1390060396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-06d7ad66-fb05-4190-9735-cf197f846a9a 1073741824" returned: 0 in 0.547s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-29d972a3-7431-4373-8f56-a01c628cc5cf tempest-SnapshotDependencyTests-1390060396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-06d7ad66-fb05-4190-9735-cf197f846a9a {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:07 devstack sudo[105899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-06d7ad66-fb05-4190-9735-cf197f846a9a Sep 23 00:33:07 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:08 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1b0a0b52-ca42-4a96-98b1-a394e8bfb86d tempest-ProjectReaderTests-1672073403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db058385-70ef-41d2-93e6-20330cd9bdec.417bba9b-62ff-4315-b3c8-33cde1b5174b" returned: 0 in 0.449s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:08 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-1b0a0b52-ca42-4a96-98b1-a394e8bfb86d tempest-ProjectReaderTests-1672073403 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db058385-70ef-41d2-93e6-20330cd9bdec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:33:08 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b1ef88-b3ee-4af5-bd13-ac60f5e20f04]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1b0a0b52-ca42-4a96-98b1-a394e8bfb86d tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db058385-70ef-41d2-93e6-20330cd9bdec {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:08 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-29d972a3-7431-4373-8f56-a01c628cc5cf tempest-SnapshotDependencyTests-1390060396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-06d7ad66-fb05-4190-9735-cf197f846a9a" returned: 0 in 0.297s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:08 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-29d972a3-7431-4373-8f56-a01c628cc5cf tempest-SnapshotDependencyTests-1390060396 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:33:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-29d972a3-7431-4373-8f56-a01c628cc5cf tempest-SnapshotDependencyTests-1390060396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8291e1dd-ae75-4338-82ef-79ad33ded973 tempest-ProjectMemberTests-2104250010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.533s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:08 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-8291e1dd-ae75-4338-82ef-79ad33ded973 tempest-ProjectMemberTests-2104250010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1887548803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7ec8cc8-d1aa-4baa-8eac-3224b3661300,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='105e2fcb253445d18a9a36e4adbf6662',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:06Z,use_quota=True,user_id='6f62c0bf87c2488e987066aaecad1a03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:33:08 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-8291e1dd-ae75-4338-82ef-79ad33ded973 tempest-ProjectMemberTests-2104250010 None] Creating volume d7ec8cc8-d1aa-4baa-8eac-3224b3661300 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:33:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8291e1dd-ae75-4338-82ef-79ad33ded973 tempest-ProjectMemberTests-2104250010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8291e1dd-ae75-4338-82ef-79ad33ded973 tempest-ProjectMemberTests-2104250010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:08 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-8291e1dd-ae75-4338-82ef-79ad33ded973 tempest-ProjectMemberTests-2104250010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:08 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-8291e1dd-ae75-4338-82ef-79ad33ded973 tempest-ProjectMemberTests-2104250010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8291e1dd-ae75-4338-82ef-79ad33ded973 tempest-ProjectMemberTests-2104250010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:08 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-8291e1dd-ae75-4338-82ef-79ad33ded973 tempest-ProjectMemberTests-2104250010 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:33:08 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-8291e1dd-ae75-4338-82ef-79ad33ded973 tempest-ProjectMemberTests-2104250010 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:33:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8291e1dd-ae75-4338-82ef-79ad33ded973 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d7ec8cc8-d1aa-4baa-8eac-3224b3661300 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:08 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-29d972a3-7431-4373-8f56-a01c628cc5cf tempest-SnapshotDependencyTests-1390060396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca323237-0ae2-4360-92ce-5dfc67b3c118) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06d7ad66-fb05-4190-9735-cf197f846a9a', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:08 devstack sudo[105906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d7ec8cc8-d1aa-4baa-8eac-3224b3661300 1073741824 Sep 23 00:33:08 devstack sudo[105906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:08 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-29d972a3-7431-4373-8f56-a01c628cc5cf tempest-SnapshotDependencyTests-1390060396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1e2dc9b-50b4-4c38-a74e-cfb0ae46f56f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:08 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-29d972a3-7431-4373-8f56-a01c628cc5cf tempest-SnapshotDependencyTests-1390060396 None] Volume volume-06d7ad66-fb05-4190-9735-cf197f846a9a (06d7ad66-fb05-4190-9735-cf197f846a9a): created successfully Sep 23 00:33:08 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-29d972a3-7431-4373-8f56-a01c628cc5cf tempest-SnapshotDependencyTests-1390060396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1e2dc9b-50b4-4c38-a74e-cfb0ae46f56f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:08 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-29d972a3-7431-4373-8f56-a01c628cc5cf tempest-SnapshotDependencyTests-1390060396 None] Flow 'volume_create_manager' (253f6678-0044-4f84-9e24-0f8a6f22436f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:08 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-29d972a3-7431-4373-8f56-a01c628cc5cf tempest-SnapshotDependencyTests-1390060396 None] Created volume successfully. Sep 23 00:33:08 devstack sudo[105905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db058385-70ef-41d2-93e6-20330cd9bdec Sep 23 00:33:08 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:08 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-3805e5a9-938d-46d0-b992-6a827f159e14 tempest-ProjectReaderTests-220319515 None] Acquiring lock "cinder-92b5606d-79a6-4133-9304-362ca5a77f07-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:08 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-3805e5a9-938d-46d0-b992-6a827f159e14 tempest-ProjectReaderTests-220319515 None] Lock "cinder-92b5606d-79a6-4133-9304-362ca5a77f07-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:08 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:08 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-3805e5a9-938d-46d0-b992-6a827f159e14 tempest-ProjectReaderTests-220319515 None] Acquiring lock "cinder-quobyte-92b5606d-79a6-4133-9304-362ca5a77f07" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1b0a0b52-ca42-4a96-98b1-a394e8bfb86d tempest-ProjectReaderTests-1672073403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db058385-70ef-41d2-93e6-20330cd9bdec" returned: 0 in 0.516s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1b0a0b52-ca42-4a96-98b1-a394e8bfb86d tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db058385-70ef-41d2-93e6-20330cd9bdec.417bba9b-62ff-4315-b3c8-33cde1b5174b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:08 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-3805e5a9-938d-46d0-b992-6a827f159e14 tempest-ProjectReaderTests-220319515 None] Lock "cinder-quobyte-92b5606d-79a6-4133-9304-362ca5a77f07" acquired by "delete_volume" :: waited 0.033s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:08 devstack sudo[105916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db058385-70ef-41d2-93e6-20330cd9bdec.417bba9b-62ff-4315-b3c8-33cde1b5174b Sep 23 00:33:08 devstack sudo[105916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:08 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef7ce1b-71d0-490e-8f3c-74226b960ceb]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3805e5a9-938d-46d0-b992-6a827f159e14 tempest-ProjectReaderTests-220319515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-92b5606d-79a6-4133-9304-362ca5a77f07 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:08 devstack sudo[105906]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8291e1dd-ae75-4338-82ef-79ad33ded973 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d7ec8cc8-d1aa-4baa-8eac-3224b3661300 1073741824" returned: 0 in 0.610s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8291e1dd-ae75-4338-82ef-79ad33ded973 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d7ec8cc8-d1aa-4baa-8eac-3224b3661300 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:08 devstack sudo[105918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-92b5606d-79a6-4133-9304-362ca5a77f07 Sep 23 00:33:08 devstack sudo[105918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:08 devstack sudo[105920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d7ec8cc8-d1aa-4baa-8eac-3224b3661300 Sep 23 00:33:08 devstack sudo[105920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:09 devstack sudo[105916]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1b0a0b52-ca42-4a96-98b1-a394e8bfb86d tempest-ProjectReaderTests-1672073403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db058385-70ef-41d2-93e6-20330cd9bdec.417bba9b-62ff-4315-b3c8-33cde1b5174b" returned: 0 in 0.410s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1b0a0b52-ca42-4a96-98b1-a394e8bfb86d tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db058385-70ef-41d2-93e6-20330cd9bdec.417bba9b-62ff-4315-b3c8-33cde1b5174b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:09 devstack sudo[105928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db058385-70ef-41d2-93e6-20330cd9bdec.417bba9b-62ff-4315-b3c8-33cde1b5174b Sep 23 00:33:09 devstack sudo[105928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:09 devstack sudo[105918]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3805e5a9-938d-46d0-b992-6a827f159e14 tempest-ProjectReaderTests-220319515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-92b5606d-79a6-4133-9304-362ca5a77f07" returned: 0 in 0.427s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3805e5a9-938d-46d0-b992-6a827f159e14 tempest-ProjectReaderTests-220319515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-92b5606d-79a6-4133-9304-362ca5a77f07 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:09 devstack sudo[105920]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-8291e1dd-ae75-4338-82ef-79ad33ded973 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d7ec8cc8-d1aa-4baa-8eac-3224b3661300" returned: 0 in 0.323s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:09 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-8291e1dd-ae75-4338-82ef-79ad33ded973 tempest-ProjectMemberTests-2104250010 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:33:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-8291e1dd-ae75-4338-82ef-79ad33ded973 tempest-ProjectMemberTests-2104250010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:09 devstack sudo[105932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-92b5606d-79a6-4133-9304-362ca5a77f07 Sep 23 00:33:09 devstack sudo[105932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8291e1dd-ae75-4338-82ef-79ad33ded973 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (849f1a18-8960-461c-942a-5ec45b93139b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7ec8cc8-d1aa-4baa-8eac-3224b3661300', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8291e1dd-ae75-4338-82ef-79ad33ded973 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c89b8628-af9c-4d66-b861-c5a6ce4123eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:09 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-8291e1dd-ae75-4338-82ef-79ad33ded973 tempest-ProjectMemberTests-2104250010 None] Volume volume-d7ec8cc8-d1aa-4baa-8eac-3224b3661300 (d7ec8cc8-d1aa-4baa-8eac-3224b3661300): created successfully Sep 23 00:33:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8291e1dd-ae75-4338-82ef-79ad33ded973 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c89b8628-af9c-4d66-b861-c5a6ce4123eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-8291e1dd-ae75-4338-82ef-79ad33ded973 tempest-ProjectMemberTests-2104250010 None] Flow 'volume_create_manager' (8d76a698-348b-45b3-a4d7-d637bca224e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:09 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-8291e1dd-ae75-4338-82ef-79ad33ded973 tempest-ProjectMemberTests-2104250010 None] Created volume successfully. Sep 23 00:33:09 devstack sudo[105928]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1b0a0b52-ca42-4a96-98b1-a394e8bfb86d tempest-ProjectReaderTests-1672073403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db058385-70ef-41d2-93e6-20330cd9bdec.417bba9b-62ff-4315-b3c8-33cde1b5174b" returned: 0 in 0.324s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:09 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-1b0a0b52-ca42-4a96-98b1-a394e8bfb86d tempest-ProjectReaderTests-1672073403 None] Lock "cinder-quobyte-417bba9b-62ff-4315-b3c8-33cde1b5174b" released by "_delete_snapshot" :: held 1.824s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:09 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-1b0a0b52-ca42-4a96-98b1-a394e8bfb86d tempest-ProjectReaderTests-1672073403 None] Lock "cinder-quobyte-db058385-70ef-41d2-93e6-20330cd9bdec" released by "delete_snapshot" :: held 1.855s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:09 devstack sudo[105932]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3805e5a9-938d-46d0-b992-6a827f159e14 tempest-ProjectReaderTests-220319515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-92b5606d-79a6-4133-9304-362ca5a77f07" returned: 0 in 0.323s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:09 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-3805e5a9-938d-46d0-b992-6a827f159e14 tempest-ProjectReaderTests-220319515 None] Lock "cinder-quobyte-92b5606d-79a6-4133-9304-362ca5a77f07" released by "delete_volume" :: held 0.806s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:09 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-1b0a0b52-ca42-4a96-98b1-a394e8bfb86d tempest-ProjectReaderTests-1672073403 None] Created reservations ['167529b7-e26e-4774-9d3c-cb9aaeed514b', 'f9dab025-c12e-4d9c-b12d-5042cb0ae3df', '8eb93af1-ac6b-4431-be08-a4c6ff9b0785', '778d225a-6dc8-4fee-a782-17e6e628690e'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:33:09 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-3805e5a9-938d-46d0-b992-6a827f159e14 tempest-ProjectReaderTests-220319515 None] Created reservations ['e30b50f9-7db4-4890-85f3-57a40a058eec', '7f82f768-65ef-4a14-b675-9cf03613eddc', '7600a1c4-9be4-4a0c-b90c-080e03922bd1', 'e2ffcdcc-58c9-4333-bd5b-5f3efe269402'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:33:09 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-1b0a0b52-ca42-4a96-98b1-a394e8bfb86d tempest-ProjectReaderTests-1672073403 None] Delete snapshot completed successfully. Sep 23 00:33:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-3805e5a9-938d-46d0-b992-6a827f159e14 tempest-ProjectReaderTests-220319515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-3805e5a9-938d-46d0-b992-6a827f159e14 tempest-ProjectReaderTests-220319515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:09 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-3805e5a9-938d-46d0-b992-6a827f159e14 tempest-ProjectReaderTests-220319515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:09 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-3805e5a9-938d-46d0-b992-6a827f159e14 tempest-ProjectReaderTests-220319515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-3805e5a9-938d-46d0-b992-6a827f159e14 tempest-ProjectReaderTests-220319515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3805e5a9-938d-46d0-b992-6a827f159e14 tempest-ProjectReaderTests-220319515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:09 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-1b0a0b52-ca42-4a96-98b1-a394e8bfb86d tempest-ProjectReaderTests-1672073403 None] Lock "cinder-417bba9b-62ff-4315-b3c8-33cde1b5174b-delete_snapshot" released by "delete_snapshot" :: held 2.201s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b765cfb5-0269-455b-bf9a-6446a5acab57 tempest-SnapshotDependencyTests-1390060396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b765cfb5-0269-455b-bf9a-6446a5acab57 tempest-SnapshotDependencyTests-1390060396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:09 devstack sudo[105936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:33:09 devstack sudo[105936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:09 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-b765cfb5-0269-455b-bf9a-6446a5acab57 tempest-SnapshotDependencyTests-1390060396 None] Creating offline snapshot f18fdda5-ecfe-463f-94c9-87737dc761bd of volume 06d7ad66-fb05-4190-9735-cf197f846a9a {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:33:09 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[86570944-25a3-4346-8df7-92d1ccd07619]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b765cfb5-0269-455b-bf9a-6446a5acab57 tempest-SnapshotDependencyTests-1390060396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-06d7ad66-fb05-4190-9735-cf197f846a9a {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:10 devstack sudo[105938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-06d7ad66-fb05-4190-9735-cf197f846a9a Sep 23 00:33:10 devstack sudo[105938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:10 devstack sudo[105936]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3805e5a9-938d-46d0-b992-6a827f159e14 tempest-ProjectReaderTests-220319515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.381s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:10 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-3805e5a9-938d-46d0-b992-6a827f159e14 tempest-ProjectReaderTests-220319515 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:33:10 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-3805e5a9-938d-46d0-b992-6a827f159e14 tempest-ProjectReaderTests-220319515 None] Deleted volume successfully. Sep 23 00:33:10 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-3805e5a9-938d-46d0-b992-6a827f159e14 tempest-ProjectReaderTests-220319515 None] Lock "cinder-92b5606d-79a6-4133-9304-362ca5a77f07-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:10 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-add9e0bf-e86b-4df8-857c-13b5fa1e3552 tempest-ProjectReaderTests-1672073403 None] Acquiring lock "cinder-db058385-70ef-41d2-93e6-20330cd9bdec-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b88d47a3-54ff-44ee-bfe0-2db41dd73823 tempest-ProjectMemberTests-2104250010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:10 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-add9e0bf-e86b-4df8-857c-13b5fa1e3552 tempest-ProjectReaderTests-1672073403 None] Lock "cinder-db058385-70ef-41d2-93e6-20330cd9bdec-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:10 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-add9e0bf-e86b-4df8-857c-13b5fa1e3552 tempest-ProjectReaderTests-1672073403 None] Acquiring lock "cinder-quobyte-db058385-70ef-41d2-93e6-20330cd9bdec" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:10 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-add9e0bf-e86b-4df8-857c-13b5fa1e3552 tempest-ProjectReaderTests-1672073403 None] Lock "cinder-quobyte-db058385-70ef-41d2-93e6-20330cd9bdec" acquired by "delete_volume" :: waited 0.019s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:10 devstack sudo[105938]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:10 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[66db02b0-5fac-482f-9d1c-a842bddf9d57]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-add9e0bf-e86b-4df8-857c-13b5fa1e3552 tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db058385-70ef-41d2-93e6-20330cd9bdec {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b765cfb5-0269-455b-bf9a-6446a5acab57 tempest-SnapshotDependencyTests-1390060396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-06d7ad66-fb05-4190-9735-cf197f846a9a" returned: 0 in 0.571s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b765cfb5-0269-455b-bf9a-6446a5acab57 tempest-SnapshotDependencyTests-1390060396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-06d7ad66-fb05-4190-9735-cf197f846a9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-06d7ad66-fb05-4190-9735-cf197f846a9a.f18fdda5-ecfe-463f-94c9-87737dc761bd 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:10 devstack sudo[105946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-06d7ad66-fb05-4190-9735-cf197f846a9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-06d7ad66-fb05-4190-9735-cf197f846a9a.f18fdda5-ecfe-463f-94c9-87737dc761bd 1G Sep 23 00:33:10 devstack sudo[105946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:10 devstack sudo[105945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db058385-70ef-41d2-93e6-20330cd9bdec Sep 23 00:33:10 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:10 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b45dc29-a561-4505-a2c0-42944a02984e tempest-ProjectReaderTests-220319515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:33:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4b45dc29-a561-4505-a2c0-42944a02984e tempest-ProjectReaderTests-220319515 None] Flow 'volume_create_manager' (fadb282f-0a4c-494a-b616-4455ce55ca29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4b45dc29-a561-4505-a2c0-42944a02984e tempest-ProjectReaderTests-220319515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b9c2e5d-f033-4f19-b970-4bfc0978d139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4b45dc29-a561-4505-a2c0-42944a02984e tempest-ProjectReaderTests-220319515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b9c2e5d-f033-4f19-b970-4bfc0978d139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-688206722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6433ab3-0b56-45e5-b70b-0618fb299a6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='954070cdbc4249dd9b82987f4da6bc38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:11Z,use_quota=True,user_id='e10212d2d22b40a295a593e08b87fc92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4b45dc29-a561-4505-a2c0-42944a02984e tempest-ProjectReaderTests-220319515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0003307d-c246-41d1-9749-7302165c190b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4b45dc29-a561-4505-a2c0-42944a02984e tempest-ProjectReaderTests-220319515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0003307d-c246-41d1-9749-7302165c190b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4b45dc29-a561-4505-a2c0-42944a02984e tempest-ProjectReaderTests-220319515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7a4334a-9ee9-4978-a5de-d7beac11a8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4b45dc29-a561-4505-a2c0-42944a02984e tempest-ProjectReaderTests-220319515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7a4334a-9ee9-4978-a5de-d7beac11a8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6433ab3-0b56-45e5-b70b-0618fb299a6e', 'volume_name': 'volume-c6433ab3-0b56-45e5-b70b-0618fb299a6e', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4b45dc29-a561-4505-a2c0-42944a02984e tempest-ProjectReaderTests-220319515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ad8735f-65f0-4c66-a53f-dc35a597061c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4b45dc29-a561-4505-a2c0-42944a02984e tempest-ProjectReaderTests-220319515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ad8735f-65f0-4c66-a53f-dc35a597061c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4b45dc29-a561-4505-a2c0-42944a02984e tempest-ProjectReaderTests-220319515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3211e628-8819-46bc-8f14-c8cb6e35b4be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:10 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-4b45dc29-a561-4505-a2c0-42944a02984e tempest-ProjectReaderTests-220319515 None] Volume c6433ab3-0b56-45e5-b70b-0618fb299a6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6433ab3-0b56-45e5-b70b-0618fb299a6e', 'volume_size': 1} Sep 23 00:33:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4b45dc29-a561-4505-a2c0-42944a02984e tempest-ProjectReaderTests-220319515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:10 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-add9e0bf-e86b-4df8-857c-13b5fa1e3552 tempest-ProjectReaderTests-1672073403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db058385-70ef-41d2-93e6-20330cd9bdec" returned: 0 in 0.407s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-add9e0bf-e86b-4df8-857c-13b5fa1e3552 tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db058385-70ef-41d2-93e6-20330cd9bdec {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:10 devstack sudo[105955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db058385-70ef-41d2-93e6-20330cd9bdec Sep 23 00:33:10 devstack sudo[105955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:10 devstack sudo[105946]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b765cfb5-0269-455b-bf9a-6446a5acab57 tempest-SnapshotDependencyTests-1390060396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-06d7ad66-fb05-4190-9735-cf197f846a9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-06d7ad66-fb05-4190-9735-cf197f846a9a.f18fdda5-ecfe-463f-94c9-87737dc761bd 1G" returned: 0 in 0.476s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b765cfb5-0269-455b-bf9a-6446a5acab57 tempest-SnapshotDependencyTests-1390060396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06d7ad66-fb05-4190-9735-cf197f846a9a -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-06d7ad66-fb05-4190-9735-cf197f846a9a.f18fdda5-ecfe-463f-94c9-87737dc761bd {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:11 devstack sudo[105958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06d7ad66-fb05-4190-9735-cf197f846a9a -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-06d7ad66-fb05-4190-9735-cf197f846a9a.f18fdda5-ecfe-463f-94c9-87737dc761bd Sep 23 00:33:11 devstack sudo[105958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:11 devstack sudo[105958]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:11 devstack sudo[105955]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b765cfb5-0269-455b-bf9a-6446a5acab57 tempest-SnapshotDependencyTests-1390060396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06d7ad66-fb05-4190-9735-cf197f846a9a -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-06d7ad66-fb05-4190-9735-cf197f846a9a.f18fdda5-ecfe-463f-94c9-87737dc761bd" returned: 0 in 0.306s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:11 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-b765cfb5-0269-455b-bf9a-6446a5acab57 tempest-SnapshotDependencyTests-1390060396 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-06d7ad66-fb05-4190-9735-cf197f846a9a.f18fdda5-ecfe-463f-94c9-87737dc761bd is being set with open permissions: ugo+rw Sep 23 00:33:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b765cfb5-0269-455b-bf9a-6446a5acab57 tempest-SnapshotDependencyTests-1390060396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-06d7ad66-fb05-4190-9735-cf197f846a9a.f18fdda5-ecfe-463f-94c9-87737dc761bd {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-add9e0bf-e86b-4df8-857c-13b5fa1e3552 tempest-ProjectReaderTests-1672073403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-db058385-70ef-41d2-93e6-20330cd9bdec" returned: 0 in 0.405s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:11 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-add9e0bf-e86b-4df8-857c-13b5fa1e3552 tempest-ProjectReaderTests-1672073403 None] Lock "cinder-quobyte-db058385-70ef-41d2-93e6-20330cd9bdec" released by "delete_volume" :: held 0.906s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:11 devstack sudo[105970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-06d7ad66-fb05-4190-9735-cf197f846a9a.f18fdda5-ecfe-463f-94c9-87737dc761bd Sep 23 00:33:11 devstack sudo[105970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:11 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-add9e0bf-e86b-4df8-857c-13b5fa1e3552 tempest-ProjectReaderTests-1672073403 None] Created reservations ['84720f23-8544-4595-a054-6d8ced2d34d4', '32ee2be2-fa4e-4965-abb5-7c6f411ddb4f', 'f15f8ca8-a2d4-4cd0-b32a-7d595c0c64ab', 'be495ea2-5802-4816-b668-04c36f1006f0'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:33:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-add9e0bf-e86b-4df8-857c-13b5fa1e3552 tempest-ProjectReaderTests-1672073403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-add9e0bf-e86b-4df8-857c-13b5fa1e3552 tempest-ProjectReaderTests-1672073403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:11 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-add9e0bf-e86b-4df8-857c-13b5fa1e3552 tempest-ProjectReaderTests-1672073403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:11 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-add9e0bf-e86b-4df8-857c-13b5fa1e3552 tempest-ProjectReaderTests-1672073403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-add9e0bf-e86b-4df8-857c-13b5fa1e3552 tempest-ProjectReaderTests-1672073403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-add9e0bf-e86b-4df8-857c-13b5fa1e3552 tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:11 devstack sudo[105972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:33:11 devstack sudo[105972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:11 devstack sudo[105970]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b765cfb5-0269-455b-bf9a-6446a5acab57 tempest-SnapshotDependencyTests-1390060396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-06d7ad66-fb05-4190-9735-cf197f846a9a.f18fdda5-ecfe-463f-94c9-87737dc761bd" returned: 0 in 0.311s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b765cfb5-0269-455b-bf9a-6446a5acab57 tempest-SnapshotDependencyTests-1390060396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-06d7ad66-fb05-4190-9735-cf197f846a9a.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:11 devstack sudo[105975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-06d7ad66-fb05-4190-9735-cf197f846a9a.info Sep 23 00:33:11 devstack sudo[105975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:11 devstack sudo[105972]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-add9e0bf-e86b-4df8-857c-13b5fa1e3552 tempest-ProjectReaderTests-1672073403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.370s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:11 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-add9e0bf-e86b-4df8-857c-13b5fa1e3552 tempest-ProjectReaderTests-1672073403 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:33:11 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-add9e0bf-e86b-4df8-857c-13b5fa1e3552 tempest-ProjectReaderTests-1672073403 None] Deleted volume successfully. Sep 23 00:33:11 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-add9e0bf-e86b-4df8-857c-13b5fa1e3552 tempest-ProjectReaderTests-1672073403 None] Lock "cinder-db058385-70ef-41d2-93e6-20330cd9bdec-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:11 devstack sudo[105975]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b765cfb5-0269-455b-bf9a-6446a5acab57 tempest-SnapshotDependencyTests-1390060396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-06d7ad66-fb05-4190-9735-cf197f846a9a.info" returned: 0 in 0.320s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:11 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-b765cfb5-0269-455b-bf9a-6446a5acab57 tempest-SnapshotDependencyTests-1390060396 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-06d7ad66-fb05-4190-9735-cf197f846a9a.info is being set with open permissions: ugo+rw Sep 23 00:33:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b765cfb5-0269-455b-bf9a-6446a5acab57 tempest-SnapshotDependencyTests-1390060396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-06d7ad66-fb05-4190-9735-cf197f846a9a.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:11 devstack sudo[105979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-06d7ad66-fb05-4190-9735-cf197f846a9a.info Sep 23 00:33:11 devstack sudo[105979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:12 devstack sudo[105979]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b765cfb5-0269-455b-bf9a-6446a5acab57 tempest-SnapshotDependencyTests-1390060396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-06d7ad66-fb05-4190-9735-cf197f846a9a.info" returned: 0 in 0.289s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b765cfb5-0269-455b-bf9a-6446a5acab57 tempest-SnapshotDependencyTests-1390060396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.427s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b88d47a3-54ff-44ee-bfe0-2db41dd73823 tempest-ProjectMemberTests-2104250010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.983s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:12 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-b88d47a3-54ff-44ee-bfe0-2db41dd73823 tempest-ProjectMemberTests-2104250010 None] Creating offline snapshot 7bc4351f-6ad2-48d7-92c6-5636cfd134d2 of volume d7ec8cc8-d1aa-4baa-8eac-3224b3661300 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:33:12 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[87644e2e-b50f-4a95-aea3-fff51d0bfd80]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b88d47a3-54ff-44ee-bfe0-2db41dd73823 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d7ec8cc8-d1aa-4baa-8eac-3224b3661300 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:12 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-b765cfb5-0269-455b-bf9a-6446a5acab57 tempest-SnapshotDependencyTests-1390060396 None] Create snapshot completed successfully Sep 23 00:33:12 devstack sudo[105982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d7ec8cc8-d1aa-4baa-8eac-3224b3661300 Sep 23 00:33:12 devstack sudo[105982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:12 devstack sudo[105982]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b88d47a3-54ff-44ee-bfe0-2db41dd73823 tempest-ProjectMemberTests-2104250010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d7ec8cc8-d1aa-4baa-8eac-3224b3661300" returned: 0 in 0.566s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b88d47a3-54ff-44ee-bfe0-2db41dd73823 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d7ec8cc8-d1aa-4baa-8eac-3224b3661300,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d7ec8cc8-d1aa-4baa-8eac-3224b3661300.7bc4351f-6ad2-48d7-92c6-5636cfd134d2 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:12 devstack sudo[105987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d7ec8cc8-d1aa-4baa-8eac-3224b3661300,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d7ec8cc8-d1aa-4baa-8eac-3224b3661300.7bc4351f-6ad2-48d7-92c6-5636cfd134d2 1G Sep 23 00:33:12 devstack sudo[105987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:13 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-57aa2729-9984-4323-86e9-11c9a85438b0 tempest-ProjectReaderTests-1672073403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:33:13 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-57aa2729-9984-4323-86e9-11c9a85438b0 tempest-ProjectReaderTests-1672073403 None] Flow 'volume_create_manager' (53b9a13d-303a-40be-97da-239d80450ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:13 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-57aa2729-9984-4323-86e9-11c9a85438b0 tempest-ProjectReaderTests-1672073403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3811268f-6c76-40e4-a6e6-7903fc208e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:13 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-57aa2729-9984-4323-86e9-11c9a85438b0 tempest-ProjectReaderTests-1672073403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3811268f-6c76-40e4-a6e6-7903fc208e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1008110111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=510c7381-8340-48f9-a8f3-cd424a30d71a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a361786c5d944c5a73653e654c80def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:13Z,use_quota=True,user_id='f01a5c248a78434fb39a1d6e1e81a391',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:13 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-57aa2729-9984-4323-86e9-11c9a85438b0 tempest-ProjectReaderTests-1672073403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aca29c6a-921e-428e-b290-27d7da3f9aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:13 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-57aa2729-9984-4323-86e9-11c9a85438b0 tempest-ProjectReaderTests-1672073403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aca29c6a-921e-428e-b290-27d7da3f9aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:13 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-57aa2729-9984-4323-86e9-11c9a85438b0 tempest-ProjectReaderTests-1672073403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1d4e859-bb99-42b9-b495-3e075e57fbd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:13 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-57aa2729-9984-4323-86e9-11c9a85438b0 tempest-ProjectReaderTests-1672073403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1d4e859-bb99-42b9-b495-3e075e57fbd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '510c7381-8340-48f9-a8f3-cd424a30d71a', 'volume_name': 'volume-510c7381-8340-48f9-a8f3-cd424a30d71a', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:13 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-57aa2729-9984-4323-86e9-11c9a85438b0 tempest-ProjectReaderTests-1672073403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd103155-9fea-40f6-a8ce-7e2569c4691f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:13 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-57aa2729-9984-4323-86e9-11c9a85438b0 tempest-ProjectReaderTests-1672073403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd103155-9fea-40f6-a8ce-7e2569c4691f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:13 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-57aa2729-9984-4323-86e9-11c9a85438b0 tempest-ProjectReaderTests-1672073403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (701abcc1-e78e-4073-9bb6-fc1404e8b1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:13 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-57aa2729-9984-4323-86e9-11c9a85438b0 tempest-ProjectReaderTests-1672073403 None] Volume 510c7381-8340-48f9-a8f3-cd424a30d71a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-510c7381-8340-48f9-a8f3-cd424a30d71a', 'volume_size': 1} Sep 23 00:33:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-57aa2729-9984-4323-86e9-11c9a85438b0 tempest-ProjectReaderTests-1672073403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:13 devstack sudo[105987]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b88d47a3-54ff-44ee-bfe0-2db41dd73823 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d7ec8cc8-d1aa-4baa-8eac-3224b3661300,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d7ec8cc8-d1aa-4baa-8eac-3224b3661300.7bc4351f-6ad2-48d7-92c6-5636cfd134d2 1G" returned: 0 in 0.564s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b88d47a3-54ff-44ee-bfe0-2db41dd73823 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7ec8cc8-d1aa-4baa-8eac-3224b3661300 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d7ec8cc8-d1aa-4baa-8eac-3224b3661300.7bc4351f-6ad2-48d7-92c6-5636cfd134d2 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:13 devstack sudo[105993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7ec8cc8-d1aa-4baa-8eac-3224b3661300 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d7ec8cc8-d1aa-4baa-8eac-3224b3661300.7bc4351f-6ad2-48d7-92c6-5636cfd134d2 Sep 23 00:33:13 devstack sudo[105993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:13 devstack sudo[105993]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b88d47a3-54ff-44ee-bfe0-2db41dd73823 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7ec8cc8-d1aa-4baa-8eac-3224b3661300 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d7ec8cc8-d1aa-4baa-8eac-3224b3661300.7bc4351f-6ad2-48d7-92c6-5636cfd134d2" returned: 0 in 0.422s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:13 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-b88d47a3-54ff-44ee-bfe0-2db41dd73823 tempest-ProjectMemberTests-2104250010 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d7ec8cc8-d1aa-4baa-8eac-3224b3661300.7bc4351f-6ad2-48d7-92c6-5636cfd134d2 is being set with open permissions: ugo+rw Sep 23 00:33:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b88d47a3-54ff-44ee-bfe0-2db41dd73823 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d7ec8cc8-d1aa-4baa-8eac-3224b3661300.7bc4351f-6ad2-48d7-92c6-5636cfd134d2 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:13 devstack sudo[105999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d7ec8cc8-d1aa-4baa-8eac-3224b3661300.7bc4351f-6ad2-48d7-92c6-5636cfd134d2 Sep 23 00:33:13 devstack sudo[105999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:14 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-00e7dda9-ad03-4279-b509-2c118008d47d tempest-SnapshotDependencyTests-1390060396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:33:14 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-00e7dda9-ad03-4279-b509-2c118008d47d tempest-SnapshotDependencyTests-1390060396 None] Flow 'volume_create_manager' (6c3eee0c-0fca-4917-a147-e9a318b9f4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:14 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-00e7dda9-ad03-4279-b509-2c118008d47d tempest-SnapshotDependencyTests-1390060396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4b2495b-d22d-43b9-92b7-9a505c50f3a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:14 devstack sudo[105999]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b88d47a3-54ff-44ee-bfe0-2db41dd73823 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d7ec8cc8-d1aa-4baa-8eac-3224b3661300.7bc4351f-6ad2-48d7-92c6-5636cfd134d2" returned: 0 in 0.343s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:14 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-00e7dda9-ad03-4279-b509-2c118008d47d tempest-SnapshotDependencyTests-1390060396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4b2495b-d22d-43b9-92b7-9a505c50f3a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:14Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee40e70e-3594-4b67-a14e-f667f331a3bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbd9312d53b74e20b489247f9b58e4d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f18fdda5-ecfe-463f-94c9-87737dc761bd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:14Z,use_quota=True,user_id='fbec4c6d1f504dc4a925822df8fc2876',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:14 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-00e7dda9-ad03-4279-b509-2c118008d47d tempest-SnapshotDependencyTests-1390060396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9304c7ae-c48b-4156-a7f5-ba9a44b219fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:14 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-00e7dda9-ad03-4279-b509-2c118008d47d tempest-SnapshotDependencyTests-1390060396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9304c7ae-c48b-4156-a7f5-ba9a44b219fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:14 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-00e7dda9-ad03-4279-b509-2c118008d47d tempest-SnapshotDependencyTests-1390060396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52965aea-f628-420b-9bf3-b2e68b7f7ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:14 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-00e7dda9-ad03-4279-b509-2c118008d47d tempest-SnapshotDependencyTests-1390060396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52965aea-f628-420b-9bf3-b2e68b7f7ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ee40e70e-3594-4b67-a14e-f667f331a3bc', 'volume_name': 'volume-ee40e70e-3594-4b67-a14e-f667f331a3bc', 'volume_size': 1, 'snapshot_id': 'f18fdda5-ecfe-463f-94c9-87737dc761bd'}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:14 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-00e7dda9-ad03-4279-b509-2c118008d47d tempest-SnapshotDependencyTests-1390060396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e515bf23-1cab-4750-a662-5d479232bbfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:14 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-00e7dda9-ad03-4279-b509-2c118008d47d tempest-SnapshotDependencyTests-1390060396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e515bf23-1cab-4750-a662-5d479232bbfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:14 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-00e7dda9-ad03-4279-b509-2c118008d47d tempest-SnapshotDependencyTests-1390060396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbb04ebe-387e-439e-bd05-64251a26f752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:14 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-00e7dda9-ad03-4279-b509-2c118008d47d tempest-SnapshotDependencyTests-1390060396 None] Volume ee40e70e-3594-4b67-a14e-f667f331a3bc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ee40e70e-3594-4b67-a14e-f667f331a3bc', 'volume_size': 1, 'snapshot_id': 'f18fdda5-ecfe-463f-94c9-87737dc761bd'} Sep 23 00:33:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-00e7dda9-ad03-4279-b509-2c118008d47d tempest-SnapshotDependencyTests-1390060396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b88d47a3-54ff-44ee-bfe0-2db41dd73823 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d7ec8cc8-d1aa-4baa-8eac-3224b3661300.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:14 devstack sudo[106002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d7ec8cc8-d1aa-4baa-8eac-3224b3661300.info Sep 23 00:33:14 devstack sudo[106002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:14 devstack sudo[106002]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b88d47a3-54ff-44ee-bfe0-2db41dd73823 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d7ec8cc8-d1aa-4baa-8eac-3224b3661300.info" returned: 0 in 0.325s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:14 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-b88d47a3-54ff-44ee-bfe0-2db41dd73823 tempest-ProjectMemberTests-2104250010 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d7ec8cc8-d1aa-4baa-8eac-3224b3661300.info is being set with open permissions: ugo+rw Sep 23 00:33:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b88d47a3-54ff-44ee-bfe0-2db41dd73823 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d7ec8cc8-d1aa-4baa-8eac-3224b3661300.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:14 devstack sudo[106005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d7ec8cc8-d1aa-4baa-8eac-3224b3661300.info Sep 23 00:33:14 devstack sudo[106005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:14 devstack sudo[106005]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b88d47a3-54ff-44ee-bfe0-2db41dd73823 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d7ec8cc8-d1aa-4baa-8eac-3224b3661300.info" returned: 0 in 0.268s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b88d47a3-54ff-44ee-bfe0-2db41dd73823 tempest-ProjectMemberTests-2104250010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.642s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4b45dc29-a561-4505-a2c0-42944a02984e tempest-ProjectReaderTests-220319515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.111s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:14 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4b45dc29-a561-4505-a2c0-42944a02984e tempest-ProjectReaderTests-220319515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-688206722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6433ab3-0b56-45e5-b70b-0618fb299a6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='954070cdbc4249dd9b82987f4da6bc38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:11Z,use_quota=True,user_id='e10212d2d22b40a295a593e08b87fc92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:33:14 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-4b45dc29-a561-4505-a2c0-42944a02984e tempest-ProjectReaderTests-220319515 None] Creating volume c6433ab3-0b56-45e5-b70b-0618fb299a6e {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:33:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4b45dc29-a561-4505-a2c0-42944a02984e tempest-ProjectReaderTests-220319515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4b45dc29-a561-4505-a2c0-42944a02984e tempest-ProjectReaderTests-220319515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:14 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4b45dc29-a561-4505-a2c0-42944a02984e tempest-ProjectReaderTests-220319515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:14 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4b45dc29-a561-4505-a2c0-42944a02984e tempest-ProjectReaderTests-220319515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4b45dc29-a561-4505-a2c0-42944a02984e tempest-ProjectReaderTests-220319515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:14 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4b45dc29-a561-4505-a2c0-42944a02984e tempest-ProjectReaderTests-220319515 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:33:14 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-4b45dc29-a561-4505-a2c0-42944a02984e tempest-ProjectReaderTests-220319515 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:33:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4b45dc29-a561-4505-a2c0-42944a02984e tempest-ProjectReaderTests-220319515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c6433ab3-0b56-45e5-b70b-0618fb299a6e 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:14 devstack sudo[106008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c6433ab3-0b56-45e5-b70b-0618fb299a6e 1073741824 Sep 23 00:33:14 devstack sudo[106008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:14 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-b88d47a3-54ff-44ee-bfe0-2db41dd73823 tempest-ProjectMemberTests-2104250010 None] Create snapshot completed successfully Sep 23 00:33:15 devstack sudo[106008]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4b45dc29-a561-4505-a2c0-42944a02984e tempest-ProjectReaderTests-220319515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c6433ab3-0b56-45e5-b70b-0618fb299a6e 1073741824" returned: 0 in 0.473s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4b45dc29-a561-4505-a2c0-42944a02984e tempest-ProjectReaderTests-220319515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c6433ab3-0b56-45e5-b70b-0618fb299a6e {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:15 devstack sudo[106014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c6433ab3-0b56-45e5-b70b-0618fb299a6e Sep 23 00:33:15 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-522bc3e4-39ad-4eb8-be7f-250da4fe32fc tempest-ProjectMemberTests-2104250010 None] Acquiring lock "cinder-7bc4351f-6ad2-48d7-92c6-5636cfd134d2-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-522bc3e4-39ad-4eb8-be7f-250da4fe32fc tempest-ProjectMemberTests-2104250010 None] Lock "cinder-7bc4351f-6ad2-48d7-92c6-5636cfd134d2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-522bc3e4-39ad-4eb8-be7f-250da4fe32fc tempest-ProjectMemberTests-2104250010 None] Acquiring lock "cinder-quobyte-d7ec8cc8-d1aa-4baa-8eac-3224b3661300" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-522bc3e4-39ad-4eb8-be7f-250da4fe32fc tempest-ProjectMemberTests-2104250010 None] Lock "cinder-quobyte-d7ec8cc8-d1aa-4baa-8eac-3224b3661300" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-522bc3e4-39ad-4eb8-be7f-250da4fe32fc tempest-ProjectMemberTests-2104250010 None] Acquiring lock "cinder-quobyte-7bc4351f-6ad2-48d7-92c6-5636cfd134d2" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-522bc3e4-39ad-4eb8-be7f-250da4fe32fc tempest-ProjectMemberTests-2104250010 None] Lock "cinder-quobyte-7bc4351f-6ad2-48d7-92c6-5636cfd134d2" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:15 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-522bc3e4-39ad-4eb8-be7f-250da4fe32fc tempest-ProjectMemberTests-2104250010 None] Deleting offline snapshot 7bc4351f-6ad2-48d7-92c6-5636cfd134d2 of volume d7ec8cc8-d1aa-4baa-8eac-3224b3661300 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:33:15 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-522bc3e4-39ad-4eb8-be7f-250da4fe32fc tempest-ProjectMemberTests-2104250010 None] snapshot_file for this snap is: volume-d7ec8cc8-d1aa-4baa-8eac-3224b3661300.7bc4351f-6ad2-48d7-92c6-5636cfd134d2 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:33:15 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[674f2a89-ad68-42f4-8aa5-dac69910ce8a]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-522bc3e4-39ad-4eb8-be7f-250da4fe32fc tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d7ec8cc8-d1aa-4baa-8eac-3224b3661300.7bc4351f-6ad2-48d7-92c6-5636cfd134d2 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:15 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4b45dc29-a561-4505-a2c0-42944a02984e tempest-ProjectReaderTests-220319515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c6433ab3-0b56-45e5-b70b-0618fb299a6e" returned: 0 in 0.349s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:15 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4b45dc29-a561-4505-a2c0-42944a02984e tempest-ProjectReaderTests-220319515 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:33:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4b45dc29-a561-4505-a2c0-42944a02984e tempest-ProjectReaderTests-220319515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-57aa2729-9984-4323-86e9-11c9a85438b0 tempest-ProjectReaderTests-1672073403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.498s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:15 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-57aa2729-9984-4323-86e9-11c9a85438b0 tempest-ProjectReaderTests-1672073403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1008110111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=510c7381-8340-48f9-a8f3-cd424a30d71a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a361786c5d944c5a73653e654c80def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:13Z,use_quota=True,user_id='f01a5c248a78434fb39a1d6e1e81a391',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:33:15 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-57aa2729-9984-4323-86e9-11c9a85438b0 tempest-ProjectReaderTests-1672073403 None] Creating volume 510c7381-8340-48f9-a8f3-cd424a30d71a {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:33:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-57aa2729-9984-4323-86e9-11c9a85438b0 tempest-ProjectReaderTests-1672073403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-57aa2729-9984-4323-86e9-11c9a85438b0 tempest-ProjectReaderTests-1672073403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:15 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-57aa2729-9984-4323-86e9-11c9a85438b0 tempest-ProjectReaderTests-1672073403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:15 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-57aa2729-9984-4323-86e9-11c9a85438b0 tempest-ProjectReaderTests-1672073403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-57aa2729-9984-4323-86e9-11c9a85438b0 tempest-ProjectReaderTests-1672073403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:15 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-57aa2729-9984-4323-86e9-11c9a85438b0 tempest-ProjectReaderTests-1672073403 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:33:15 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-57aa2729-9984-4323-86e9-11c9a85438b0 tempest-ProjectReaderTests-1672073403 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:33:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-57aa2729-9984-4323-86e9-11c9a85438b0 tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-510c7381-8340-48f9-a8f3-cd424a30d71a 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:15 devstack sudo[106018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-510c7381-8340-48f9-a8f3-cd424a30d71a 1073741824 Sep 23 00:33:15 devstack sudo[106018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:15 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4b45dc29-a561-4505-a2c0-42944a02984e tempest-ProjectReaderTests-220319515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3211e628-8819-46bc-8f14-c8cb6e35b4be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6433ab3-0b56-45e5-b70b-0618fb299a6e', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:15 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4b45dc29-a561-4505-a2c0-42944a02984e tempest-ProjectReaderTests-220319515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b010605-3af1-4566-85e8-40718ac4c98e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:15 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-4b45dc29-a561-4505-a2c0-42944a02984e tempest-ProjectReaderTests-220319515 None] Volume volume-c6433ab3-0b56-45e5-b70b-0618fb299a6e (c6433ab3-0b56-45e5-b70b-0618fb299a6e): created successfully Sep 23 00:33:15 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4b45dc29-a561-4505-a2c0-42944a02984e tempest-ProjectReaderTests-220319515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b010605-3af1-4566-85e8-40718ac4c98e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:15 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d7ec8cc8-d1aa-4baa-8eac-3224b3661300.7bc4351f-6ad2-48d7-92c6-5636cfd134d2 Sep 23 00:33:15 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:15 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-4b45dc29-a561-4505-a2c0-42944a02984e tempest-ProjectReaderTests-220319515 None] Flow 'volume_create_manager' (fadb282f-0a4c-494a-b616-4455ce55ca29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:15 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-4b45dc29-a561-4505-a2c0-42944a02984e tempest-ProjectReaderTests-220319515 None] Created volume successfully. Sep 23 00:33:16 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-70570334-cec1-4003-8e97-53d90c1060ba tempest-ProjectReaderTests-220319515 None] Acquiring lock "cinder-c6433ab3-0b56-45e5-b70b-0618fb299a6e-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:16 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-70570334-cec1-4003-8e97-53d90c1060ba tempest-ProjectReaderTests-220319515 None] Lock "cinder-c6433ab3-0b56-45e5-b70b-0618fb299a6e-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:16 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-70570334-cec1-4003-8e97-53d90c1060ba tempest-ProjectReaderTests-220319515 None] Acquiring lock "cinder-quobyte-c6433ab3-0b56-45e5-b70b-0618fb299a6e" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:16 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-70570334-cec1-4003-8e97-53d90c1060ba tempest-ProjectReaderTests-220319515 None] Lock "cinder-quobyte-c6433ab3-0b56-45e5-b70b-0618fb299a6e" acquired by "delete_volume" :: waited 0.023s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:16 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[504d579f-fea9-4083-99ca-44f1d3f5898b]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-70570334-cec1-4003-8e97-53d90c1060ba tempest-ProjectReaderTests-220319515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c6433ab3-0b56-45e5-b70b-0618fb299a6e {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:16 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-522bc3e4-39ad-4eb8-be7f-250da4fe32fc tempest-ProjectMemberTests-2104250010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d7ec8cc8-d1aa-4baa-8eac-3224b3661300.7bc4351f-6ad2-48d7-92c6-5636cfd134d2" returned: 0 in 0.593s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-522bc3e4-39ad-4eb8-be7f-250da4fe32fc tempest-ProjectMemberTests-2104250010 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7ec8cc8-d1aa-4baa-8eac-3224b3661300(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:33:16 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b703ce5a-3b58-427a-8ec9-4359cd3d6102]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-522bc3e4-39ad-4eb8-be7f-250da4fe32fc tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d7ec8cc8-d1aa-4baa-8eac-3224b3661300 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:16 devstack sudo[106027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c6433ab3-0b56-45e5-b70b-0618fb299a6e Sep 23 00:33:16 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:16 devstack sudo[106018]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-57aa2729-9984-4323-86e9-11c9a85438b0 tempest-ProjectReaderTests-1672073403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-510c7381-8340-48f9-a8f3-cd424a30d71a 1073741824" returned: 0 in 0.658s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:16 devstack sudo[106029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d7ec8cc8-d1aa-4baa-8eac-3224b3661300 Sep 23 00:33:16 devstack sudo[106029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-57aa2729-9984-4323-86e9-11c9a85438b0 tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-510c7381-8340-48f9-a8f3-cd424a30d71a {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:16 devstack sudo[106032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-510c7381-8340-48f9-a8f3-cd424a30d71a Sep 23 00:33:16 devstack sudo[106032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:16 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:33:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:16 devstack sudo[106036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:33:16 devstack sudo[106036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:16 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-70570334-cec1-4003-8e97-53d90c1060ba tempest-ProjectReaderTests-220319515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c6433ab3-0b56-45e5-b70b-0618fb299a6e" returned: 0 in 0.509s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-70570334-cec1-4003-8e97-53d90c1060ba tempest-ProjectReaderTests-220319515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c6433ab3-0b56-45e5-b70b-0618fb299a6e {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:16 devstack sudo[106042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c6433ab3-0b56-45e5-b70b-0618fb299a6e Sep 23 00:33:16 devstack sudo[106042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:16 devstack sudo[106029]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-522bc3e4-39ad-4eb8-be7f-250da4fe32fc tempest-ProjectMemberTests-2104250010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d7ec8cc8-d1aa-4baa-8eac-3224b3661300" returned: 0 in 0.468s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-522bc3e4-39ad-4eb8-be7f-250da4fe32fc tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d7ec8cc8-d1aa-4baa-8eac-3224b3661300.7bc4351f-6ad2-48d7-92c6-5636cfd134d2 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:16 devstack sudo[106032]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-57aa2729-9984-4323-86e9-11c9a85438b0 tempest-ProjectReaderTests-1672073403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-510c7381-8340-48f9-a8f3-cd424a30d71a" returned: 0 in 0.349s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-57aa2729-9984-4323-86e9-11c9a85438b0 tempest-ProjectReaderTests-1672073403 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:33:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-57aa2729-9984-4323-86e9-11c9a85438b0 tempest-ProjectReaderTests-1672073403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-00e7dda9-ad03-4279-b509-2c118008d47d tempest-SnapshotDependencyTests-1390060396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.597s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:16 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-00e7dda9-ad03-4279-b509-2c118008d47d tempest-SnapshotDependencyTests-1390060396 None] Acquiring lock "cinder-quobyte-f18fdda5-ecfe-463f-94c9-87737dc761bd-ee40e70e-3594-4b67-a14e-f667f331a3bc" by "_create_volume_from_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:16 devstack sudo[106045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d7ec8cc8-d1aa-4baa-8eac-3224b3661300.7bc4351f-6ad2-48d7-92c6-5636cfd134d2 Sep 23 00:33:16 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-57aa2729-9984-4323-86e9-11c9a85438b0 tempest-ProjectReaderTests-1672073403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (701abcc1-e78e-4073-9bb6-fc1404e8b1e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-510c7381-8340-48f9-a8f3-cd424a30d71a', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-57aa2729-9984-4323-86e9-11c9a85438b0 tempest-ProjectReaderTests-1672073403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac03df0c-47df-464b-a5a9-a2c78316a916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:16 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-00e7dda9-ad03-4279-b509-2c118008d47d tempest-SnapshotDependencyTests-1390060396 None] Lock "cinder-quobyte-f18fdda5-ecfe-463f-94c9-87737dc761bd-ee40e70e-3594-4b67-a14e-f667f331a3bc" acquired by "_create_volume_from_snapshot" :: waited 0.043s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-00e7dda9-ad03-4279-b509-2c118008d47d tempest-SnapshotDependencyTests-1390060396 None] Creating volume ee40e70e-3594-4b67-a14e-f667f331a3bc from snapshot f18fdda5-ecfe-463f-94c9-87737dc761bd {{(pid=86591) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 00:33:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-00e7dda9-ad03-4279-b509-2c118008d47d tempest-SnapshotDependencyTests-1390060396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-00e7dda9-ad03-4279-b509-2c118008d47d tempest-SnapshotDependencyTests-1390060396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-00e7dda9-ad03-4279-b509-2c118008d47d tempest-SnapshotDependencyTests-1390060396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-00e7dda9-ad03-4279-b509-2c118008d47d tempest-SnapshotDependencyTests-1390060396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-00e7dda9-ad03-4279-b509-2c118008d47d tempest-SnapshotDependencyTests-1390060396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-00e7dda9-ad03-4279-b509-2c118008d47d tempest-SnapshotDependencyTests-1390060396 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:33:16 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-00e7dda9-ad03-4279-b509-2c118008d47d tempest-SnapshotDependencyTests-1390060396 None] Acquiring lock "cinder-quobyte-ee40e70e-3594-4b67-a14e-f667f331a3bc" by "_copy_volume_from_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:16 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-00e7dda9-ad03-4279-b509-2c118008d47d tempest-SnapshotDependencyTests-1390060396 None] Lock "cinder-quobyte-ee40e70e-3594-4b67-a14e-f667f331a3bc" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-00e7dda9-ad03-4279-b509-2c118008d47d tempest-SnapshotDependencyTests-1390060396 None] snapshot: f18fdda5-ecfe-463f-94c9-87737dc761bd, volume: ee40e70e-3594-4b67-a14e-f667f331a3bc, {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:33:16 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-57aa2729-9984-4323-86e9-11c9a85438b0 tempest-ProjectReaderTests-1672073403 None] Volume volume-510c7381-8340-48f9-a8f3-cd424a30d71a (510c7381-8340-48f9-a8f3-cd424a30d71a): created successfully Sep 23 00:33:16 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-57aa2729-9984-4323-86e9-11c9a85438b0 tempest-ProjectReaderTests-1672073403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac03df0c-47df-464b-a5a9-a2c78316a916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-57aa2729-9984-4323-86e9-11c9a85438b0 tempest-ProjectReaderTests-1672073403 None] Flow 'volume_create_manager' (53b9a13d-303a-40be-97da-239d80450ecc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-00e7dda9-ad03-4279-b509-2c118008d47d tempest-SnapshotDependencyTests-1390060396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-00e7dda9-ad03-4279-b509-2c118008d47d tempest-SnapshotDependencyTests-1390060396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:17 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-00e7dda9-ad03-4279-b509-2c118008d47d tempest-SnapshotDependencyTests-1390060396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:17 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-00e7dda9-ad03-4279-b509-2c118008d47d tempest-SnapshotDependencyTests-1390060396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:17 devstack sudo[106036]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-00e7dda9-ad03-4279-b509-2c118008d47d tempest-SnapshotDependencyTests-1390060396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:17 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-57aa2729-9984-4323-86e9-11c9a85438b0 tempest-ProjectReaderTests-1672073403 None] Created volume successfully. Sep 23 00:33:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.372s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:17 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:33:17 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running periodic task VolumeManager._thread_info {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:33:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] thread count: 29 {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:33:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] thread info: [<_MainThread(MainThread, started 135440660459648)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:33:17 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a165fe-1d82-4c20-a0a8-1dd63936cc46]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-00e7dda9-ad03-4279-b509-2c118008d47d tempest-SnapshotDependencyTests-1390060396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-06d7ad66-fb05-4190-9735-cf197f846a9a.f18fdda5-ecfe-463f-94c9-87737dc761bd {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:17 devstack sudo[106042]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-70570334-cec1-4003-8e97-53d90c1060ba tempest-ProjectReaderTests-220319515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-c6433ab3-0b56-45e5-b70b-0618fb299a6e" returned: 0 in 0.311s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-70570334-cec1-4003-8e97-53d90c1060ba tempest-ProjectReaderTests-220319515 None] Lock "cinder-quobyte-c6433ab3-0b56-45e5-b70b-0618fb299a6e" released by "delete_volume" :: held 0.878s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:17 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-70570334-cec1-4003-8e97-53d90c1060ba tempest-ProjectReaderTests-220319515 None] Created reservations ['db6b1f14-5383-4aef-8a29-b16603362638', '9e51b008-29e8-489d-b76b-3c8e0f49f690', '0efc8321-ee0b-4e4f-ad67-f7a011d04fae', '9b4a11eb-4063-40d5-ac8d-a82f2f9491a7'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:33:17 devstack sudo[106049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-06d7ad66-fb05-4190-9735-cf197f846a9a.f18fdda5-ecfe-463f-94c9-87737dc761bd Sep 23 00:33:17 devstack sudo[106049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-70570334-cec1-4003-8e97-53d90c1060ba tempest-ProjectReaderTests-220319515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-70570334-cec1-4003-8e97-53d90c1060ba tempest-ProjectReaderTests-220319515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:17 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-70570334-cec1-4003-8e97-53d90c1060ba tempest-ProjectReaderTests-220319515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:17 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-70570334-cec1-4003-8e97-53d90c1060ba tempest-ProjectReaderTests-220319515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-70570334-cec1-4003-8e97-53d90c1060ba tempest-ProjectReaderTests-220319515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-70570334-cec1-4003-8e97-53d90c1060ba tempest-ProjectReaderTests-220319515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:17 devstack sudo[106055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:33:17 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:17 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-522bc3e4-39ad-4eb8-be7f-250da4fe32fc tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d7ec8cc8-d1aa-4baa-8eac-3224b3661300.7bc4351f-6ad2-48d7-92c6-5636cfd134d2" returned: 0 in 0.603s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-522bc3e4-39ad-4eb8-be7f-250da4fe32fc tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d7ec8cc8-d1aa-4baa-8eac-3224b3661300.7bc4351f-6ad2-48d7-92c6-5636cfd134d2 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:17 devstack sudo[106058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d7ec8cc8-d1aa-4baa-8eac-3224b3661300.7bc4351f-6ad2-48d7-92c6-5636cfd134d2 Sep 23 00:33:17 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:17 devstack sudo[106049]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-00e7dda9-ad03-4279-b509-2c118008d47d tempest-SnapshotDependencyTests-1390060396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-06d7ad66-fb05-4190-9735-cf197f846a9a.f18fdda5-ecfe-463f-94c9-87737dc761bd" returned: 0 in 0.626s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:17 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-00e7dda9-ad03-4279-b509-2c118008d47d tempest-SnapshotDependencyTests-1390060396 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06d7ad66-fb05-4190-9735-cf197f846a9a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:33:17 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10428a4-eae9-4088-b4e3-a09fc9a31871]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-00e7dda9-ad03-4279-b509-2c118008d47d tempest-SnapshotDependencyTests-1390060396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-06d7ad66-fb05-4190-9735-cf197f846a9a {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:17 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-70570334-cec1-4003-8e97-53d90c1060ba tempest-ProjectReaderTests-220319515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.478s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:17 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-70570334-cec1-4003-8e97-53d90c1060ba tempest-ProjectReaderTests-220319515 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:33:17 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-70570334-cec1-4003-8e97-53d90c1060ba tempest-ProjectReaderTests-220319515 None] Deleted volume successfully. Sep 23 00:33:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-70570334-cec1-4003-8e97-53d90c1060ba tempest-ProjectReaderTests-220319515 None] Lock "cinder-c6433ab3-0b56-45e5-b70b-0618fb299a6e-delete_volume" released by "delete_volume" :: held 1.731s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ae3b1aee-7753-4444-a726-530046d51507 tempest-ProjectReaderTests-1672073403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:17 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-522bc3e4-39ad-4eb8-be7f-250da4fe32fc tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d7ec8cc8-d1aa-4baa-8eac-3224b3661300.7bc4351f-6ad2-48d7-92c6-5636cfd134d2" returned: 0 in 0.431s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-522bc3e4-39ad-4eb8-be7f-250da4fe32fc tempest-ProjectMemberTests-2104250010 None] Lock "cinder-quobyte-7bc4351f-6ad2-48d7-92c6-5636cfd134d2" released by "_delete_snapshot" :: held 2.229s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-522bc3e4-39ad-4eb8-be7f-250da4fe32fc tempest-ProjectMemberTests-2104250010 None] Lock "cinder-quobyte-d7ec8cc8-d1aa-4baa-8eac-3224b3661300" released by "delete_snapshot" :: held 2.257s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:17 devstack sudo[106064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-06d7ad66-fb05-4190-9735-cf197f846a9a Sep 23 00:33:17 devstack sudo[106064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:18 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-522bc3e4-39ad-4eb8-be7f-250da4fe32fc tempest-ProjectMemberTests-2104250010 None] Created reservations ['c75f40a4-ce68-4498-92ed-20a857016171', 'e127c613-59de-46ab-ac31-33aa2ed61e5e', 'e2822ef4-d4e2-48bd-b7dd-9b746bdbcaef', '0d168691-3de8-4c4f-af13-711030e48906'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:33:18 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-522bc3e4-39ad-4eb8-be7f-250da4fe32fc tempest-ProjectMemberTests-2104250010 None] Delete snapshot completed successfully. Sep 23 00:33:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-522bc3e4-39ad-4eb8-be7f-250da4fe32fc tempest-ProjectMemberTests-2104250010 None] Lock "cinder-7bc4351f-6ad2-48d7-92c6-5636cfd134d2-delete_snapshot" released by "delete_snapshot" :: held 2.470s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:18 devstack sudo[106064]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-00e7dda9-ad03-4279-b509-2c118008d47d tempest-SnapshotDependencyTests-1390060396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-06d7ad66-fb05-4190-9735-cf197f846a9a" returned: 0 in 0.542s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:18 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-00e7dda9-ad03-4279-b509-2c118008d47d tempest-SnapshotDependencyTests-1390060396 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-06d7ad66-fb05-4190-9735-cf197f846a9a {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:33:18 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-00e7dda9-ad03-4279-b509-2c118008d47d tempest-SnapshotDependencyTests-1390060396 None] Creating direct copy from snapshot {{(pid=86591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:33:18 devstack cinder-volume[86591]: DEBUG cinder.utils [None req-00e7dda9-ad03-4279-b509-2c118008d47d tempest-SnapshotDependencyTests-1390060396 None] Path /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ee40e70e-3594-4b67-a14e-f667f331a3bc not found in is_blk_device check {{(pid=86591) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:33:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-00e7dda9-ad03-4279-b509-2c118008d47d tempest-SnapshotDependencyTests-1390060396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-06d7ad66-fb05-4190-9735-cf197f846a9a /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ee40e70e-3594-4b67-a14e-f667f331a3bc {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:18 devstack sudo[106070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-06d7ad66-fb05-4190-9735-cf197f846a9a /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ee40e70e-3594-4b67-a14e-f667f331a3bc Sep 23 00:33:18 devstack sudo[106070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-71f38791-6bee-49b0-a695-da1d5cd37a0e tempest-ProjectMemberTests-2104250010 None] Acquiring lock "cinder-d7ec8cc8-d1aa-4baa-8eac-3224b3661300-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-71f38791-6bee-49b0-a695-da1d5cd37a0e tempest-ProjectMemberTests-2104250010 None] Lock "cinder-d7ec8cc8-d1aa-4baa-8eac-3224b3661300-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-71f38791-6bee-49b0-a695-da1d5cd37a0e tempest-ProjectMemberTests-2104250010 None] Acquiring lock "cinder-quobyte-d7ec8cc8-d1aa-4baa-8eac-3224b3661300" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-71f38791-6bee-49b0-a695-da1d5cd37a0e tempest-ProjectMemberTests-2104250010 None] Lock "cinder-quobyte-d7ec8cc8-d1aa-4baa-8eac-3224b3661300" acquired by "delete_volume" :: waited 0.041s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:19 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[247cc614-45c3-4d78-9a9f-239a9ab524b0]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-71f38791-6bee-49b0-a695-da1d5cd37a0e tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d7ec8cc8-d1aa-4baa-8eac-3224b3661300 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:19 devstack sudo[106116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d7ec8cc8-d1aa-4baa-8eac-3224b3661300 Sep 23 00:33:19 devstack sudo[106116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:20 devstack sudo[106116]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-71f38791-6bee-49b0-a695-da1d5cd37a0e tempest-ProjectMemberTests-2104250010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d7ec8cc8-d1aa-4baa-8eac-3224b3661300" returned: 0 in 1.074s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-71f38791-6bee-49b0-a695-da1d5cd37a0e tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d7ec8cc8-d1aa-4baa-8eac-3224b3661300 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:20 devstack sudo[106124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d7ec8cc8-d1aa-4baa-8eac-3224b3661300 Sep 23 00:33:20 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:21 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-71f38791-6bee-49b0-a695-da1d5cd37a0e tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-d7ec8cc8-d1aa-4baa-8eac-3224b3661300" returned: 0 in 0.703s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:21 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-71f38791-6bee-49b0-a695-da1d5cd37a0e tempest-ProjectMemberTests-2104250010 None] Lock "cinder-quobyte-d7ec8cc8-d1aa-4baa-8eac-3224b3661300" released by "delete_volume" :: held 2.004s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:21 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-71f38791-6bee-49b0-a695-da1d5cd37a0e tempest-ProjectMemberTests-2104250010 None] Created reservations ['71e6121c-c5a9-4497-9cb3-482d4cf6b2e4', '2f611cfc-0fd1-47cc-9924-edb681a40dd8', 'e89f0eb5-1ef2-41ab-92f8-c3322af09bab', '7e04700e-8099-4fb1-9351-9875bf57ff4f'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:33:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-71f38791-6bee-49b0-a695-da1d5cd37a0e tempest-ProjectMemberTests-2104250010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-71f38791-6bee-49b0-a695-da1d5cd37a0e tempest-ProjectMemberTests-2104250010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:21 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-71f38791-6bee-49b0-a695-da1d5cd37a0e tempest-ProjectMemberTests-2104250010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:21 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-71f38791-6bee-49b0-a695-da1d5cd37a0e tempest-ProjectMemberTests-2104250010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-71f38791-6bee-49b0-a695-da1d5cd37a0e tempest-ProjectMemberTests-2104250010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-71f38791-6bee-49b0-a695-da1d5cd37a0e tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:21 devstack sudo[106127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:33:21 devstack sudo[106127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:22 devstack sudo[106127]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-71f38791-6bee-49b0-a695-da1d5cd37a0e tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.640s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:22 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-71f38791-6bee-49b0-a695-da1d5cd37a0e tempest-ProjectMemberTests-2104250010 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:33:22 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-71f38791-6bee-49b0-a695-da1d5cd37a0e tempest-ProjectMemberTests-2104250010 None] Deleted volume successfully. Sep 23 00:33:22 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-71f38791-6bee-49b0-a695-da1d5cd37a0e tempest-ProjectMemberTests-2104250010 None] Lock "cinder-d7ec8cc8-d1aa-4baa-8eac-3224b3661300-delete_volume" released by "delete_volume" :: held 3.261s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:23 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-55aa64c6-4713-40bd-9dec-fc604d50fb84 tempest-ProjectMemberTests-2104250010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:33:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-55aa64c6-4713-40bd-9dec-fc604d50fb84 tempest-ProjectMemberTests-2104250010 None] Flow 'volume_create_manager' (56f31f72-aacf-4a1c-a0e9-57414cadb7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-55aa64c6-4713-40bd-9dec-fc604d50fb84 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25498165-3ef1-408e-8a31-b2e0c01d6825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-55aa64c6-4713-40bd-9dec-fc604d50fb84 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25498165-3ef1-408e-8a31-b2e0c01d6825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1679503547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04e697c9-6fab-4b21-b94f-55299c2cf6ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='105e2fcb253445d18a9a36e4adbf6662',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:24Z,use_quota=True,user_id='6f62c0bf87c2488e987066aaecad1a03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-55aa64c6-4713-40bd-9dec-fc604d50fb84 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b1b86d2-8129-4282-9047-972adfd0e20a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-55aa64c6-4713-40bd-9dec-fc604d50fb84 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b1b86d2-8129-4282-9047-972adfd0e20a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-55aa64c6-4713-40bd-9dec-fc604d50fb84 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e3c5112-3cfe-4040-b86d-6b9828f43bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-55aa64c6-4713-40bd-9dec-fc604d50fb84 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e3c5112-3cfe-4040-b86d-6b9828f43bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04e697c9-6fab-4b21-b94f-55299c2cf6ba', 'volume_name': 'volume-04e697c9-6fab-4b21-b94f-55299c2cf6ba', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-55aa64c6-4713-40bd-9dec-fc604d50fb84 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de7dbdad-876e-4f00-9e33-b139215f5d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-55aa64c6-4713-40bd-9dec-fc604d50fb84 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de7dbdad-876e-4f00-9e33-b139215f5d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:23 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-55aa64c6-4713-40bd-9dec-fc604d50fb84 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f01eaca6-7f49-4a2c-8797-c34ee850e41a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:23 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-55aa64c6-4713-40bd-9dec-fc604d50fb84 tempest-ProjectMemberTests-2104250010 None] Volume 04e697c9-6fab-4b21-b94f-55299c2cf6ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04e697c9-6fab-4b21-b94f-55299c2cf6ba', 'volume_size': 1} Sep 23 00:33:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-55aa64c6-4713-40bd-9dec-fc604d50fb84 tempest-ProjectMemberTests-2104250010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:26 devstack sudo[106070]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-00e7dda9-ad03-4279-b509-2c118008d47d tempest-SnapshotDependencyTests-1390060396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-06d7ad66-fb05-4190-9735-cf197f846a9a /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ee40e70e-3594-4b67-a14e-f667f331a3bc" returned: 0 in 8.660s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:26 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-00e7dda9-ad03-4279-b509-2c118008d47d tempest-SnapshotDependencyTests-1390060396 None] Image conversion details: src /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-06d7ad66-fb05-4190-9735-cf197f846a9a, size 1024.00 MB, duration 8.66 sec, destination /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ee40e70e-3594-4b67-a14e-f667f331a3bc {{(pid=86591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:33:26 devstack cinder-volume[86591]: INFO cinder.image.image_utils [None req-00e7dda9-ad03-4279-b509-2c118008d47d tempest-SnapshotDependencyTests-1390060396 None] Converted 1024.00 MB image at 118.23 MB/s Sep 23 00:33:26 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-00e7dda9-ad03-4279-b509-2c118008d47d tempest-SnapshotDependencyTests-1390060396 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ee40e70e-3594-4b67-a14e-f667f331a3bc is being set with open permissions: ugo+rw Sep 23 00:33:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-00e7dda9-ad03-4279-b509-2c118008d47d tempest-SnapshotDependencyTests-1390060396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ee40e70e-3594-4b67-a14e-f667f331a3bc {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:26 devstack sudo[106132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ee40e70e-3594-4b67-a14e-f667f331a3bc Sep 23 00:33:27 devstack sudo[106132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:27 devstack sudo[106132]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-00e7dda9-ad03-4279-b509-2c118008d47d tempest-SnapshotDependencyTests-1390060396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ee40e70e-3594-4b67-a14e-f667f331a3bc" returned: 0 in 0.311s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:27 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-00e7dda9-ad03-4279-b509-2c118008d47d tempest-SnapshotDependencyTests-1390060396 None] Lock "cinder-quobyte-ee40e70e-3594-4b67-a14e-f667f331a3bc" released by "_copy_volume_from_snapshot" :: held 10.314s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:27 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-00e7dda9-ad03-4279-b509-2c118008d47d tempest-SnapshotDependencyTests-1390060396 None] Lock "cinder-quobyte-f18fdda5-ecfe-463f-94c9-87737dc761bd-ee40e70e-3594-4b67-a14e-f667f331a3bc" released by "_create_volume_from_snapshot" :: held 10.404s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-00e7dda9-ad03-4279-b509-2c118008d47d tempest-SnapshotDependencyTests-1390060396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.450s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ae3b1aee-7753-4444-a726-530046d51507 tempest-ProjectReaderTests-1672073403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.444s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:27 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-ae3b1aee-7753-4444-a726-530046d51507 tempest-ProjectReaderTests-1672073403 None] Creating offline snapshot fb2bce37-cedf-409d-87f6-45614a49bda4 of volume 510c7381-8340-48f9-a8f3-cd424a30d71a {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:33:27 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-00e7dda9-ad03-4279-b509-2c118008d47d tempest-SnapshotDependencyTests-1390060396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbb04ebe-387e-439e-bd05-64251a26f752) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee40e70e-3594-4b67-a14e-f667f331a3bc', 'volume_size': 1, 'snapshot_id': 'f18fdda5-ecfe-463f-94c9-87737dc761bd'}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:27 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-00e7dda9-ad03-4279-b509-2c118008d47d tempest-SnapshotDependencyTests-1390060396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66d867c9-20a6-4553-9e3a-1446603038ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:27 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a50830-5211-4085-8d10-c92ac12425fa]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ae3b1aee-7753-4444-a726-530046d51507 tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-510c7381-8340-48f9-a8f3-cd424a30d71a {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:27 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-00e7dda9-ad03-4279-b509-2c118008d47d tempest-SnapshotDependencyTests-1390060396 None] Volume volume-ee40e70e-3594-4b67-a14e-f667f331a3bc (ee40e70e-3594-4b67-a14e-f667f331a3bc): created successfully Sep 23 00:33:27 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-00e7dda9-ad03-4279-b509-2c118008d47d tempest-SnapshotDependencyTests-1390060396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66d867c9-20a6-4553-9e3a-1446603038ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:27 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-00e7dda9-ad03-4279-b509-2c118008d47d tempest-SnapshotDependencyTests-1390060396 None] Flow 'volume_create_manager' (6c3eee0c-0fca-4917-a147-e9a318b9f4c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:27 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-00e7dda9-ad03-4279-b509-2c118008d47d tempest-SnapshotDependencyTests-1390060396 None] Created volume successfully. Sep 23 00:33:27 devstack sudo[106135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-510c7381-8340-48f9-a8f3-cd424a30d71a Sep 23 00:33:27 devstack sudo[106135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:27 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-46c65166-abab-42ff-a2b0-630c9f7f6646 tempest-SnapshotDependencyTests-1390060396 None] Acquiring lock "cinder-f18fdda5-ecfe-463f-94c9-87737dc761bd-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:27 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-46c65166-abab-42ff-a2b0-630c9f7f6646 tempest-SnapshotDependencyTests-1390060396 None] Lock "cinder-f18fdda5-ecfe-463f-94c9-87737dc761bd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:27 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-46c65166-abab-42ff-a2b0-630c9f7f6646 tempest-SnapshotDependencyTests-1390060396 None] Acquiring lock "cinder-quobyte-06d7ad66-fb05-4190-9735-cf197f846a9a" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:27 devstack sudo[106135]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ae3b1aee-7753-4444-a726-530046d51507 tempest-ProjectReaderTests-1672073403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-510c7381-8340-48f9-a8f3-cd424a30d71a" returned: 0 in 0.548s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ae3b1aee-7753-4444-a726-530046d51507 tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-510c7381-8340-48f9-a8f3-cd424a30d71a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-510c7381-8340-48f9-a8f3-cd424a30d71a.fb2bce37-cedf-409d-87f6-45614a49bda4 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:27 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-46c65166-abab-42ff-a2b0-630c9f7f6646 tempest-SnapshotDependencyTests-1390060396 None] Lock "cinder-quobyte-06d7ad66-fb05-4190-9735-cf197f846a9a" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:27 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-46c65166-abab-42ff-a2b0-630c9f7f6646 tempest-SnapshotDependencyTests-1390060396 None] Acquiring lock "cinder-quobyte-f18fdda5-ecfe-463f-94c9-87737dc761bd" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:27 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-46c65166-abab-42ff-a2b0-630c9f7f6646 tempest-SnapshotDependencyTests-1390060396 None] Lock "cinder-quobyte-f18fdda5-ecfe-463f-94c9-87737dc761bd" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:28 devstack sudo[106141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-510c7381-8340-48f9-a8f3-cd424a30d71a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-510c7381-8340-48f9-a8f3-cd424a30d71a.fb2bce37-cedf-409d-87f6-45614a49bda4 1G Sep 23 00:33:28 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-46c65166-abab-42ff-a2b0-630c9f7f6646 tempest-SnapshotDependencyTests-1390060396 None] Deleting offline snapshot f18fdda5-ecfe-463f-94c9-87737dc761bd of volume 06d7ad66-fb05-4190-9735-cf197f846a9a {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:33:28 devstack sudo[106141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:28 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-46c65166-abab-42ff-a2b0-630c9f7f6646 tempest-SnapshotDependencyTests-1390060396 None] snapshot_file for this snap is: volume-06d7ad66-fb05-4190-9735-cf197f846a9a.f18fdda5-ecfe-463f-94c9-87737dc761bd {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:33:28 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96fd06f-d491-4ad8-a33d-5b2ffe0b786a]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-46c65166-abab-42ff-a2b0-630c9f7f6646 tempest-SnapshotDependencyTests-1390060396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-06d7ad66-fb05-4190-9735-cf197f846a9a.f18fdda5-ecfe-463f-94c9-87737dc761bd {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:28 devstack sudo[106143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-06d7ad66-fb05-4190-9735-cf197f846a9a.f18fdda5-ecfe-463f-94c9-87737dc761bd Sep 23 00:33:28 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:28 devstack sudo[106141]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ae3b1aee-7753-4444-a726-530046d51507 tempest-ProjectReaderTests-1672073403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-510c7381-8340-48f9-a8f3-cd424a30d71a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-510c7381-8340-48f9-a8f3-cd424a30d71a.fb2bce37-cedf-409d-87f6-45614a49bda4 1G" returned: 0 in 0.538s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ae3b1aee-7753-4444-a726-530046d51507 tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-510c7381-8340-48f9-a8f3-cd424a30d71a -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-510c7381-8340-48f9-a8f3-cd424a30d71a.fb2bce37-cedf-409d-87f6-45614a49bda4 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:28 devstack sudo[106153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-510c7381-8340-48f9-a8f3-cd424a30d71a -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-510c7381-8340-48f9-a8f3-cd424a30d71a.fb2bce37-cedf-409d-87f6-45614a49bda4 Sep 23 00:33:28 devstack sudo[106153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:28 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-46c65166-abab-42ff-a2b0-630c9f7f6646 tempest-SnapshotDependencyTests-1390060396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-06d7ad66-fb05-4190-9735-cf197f846a9a.f18fdda5-ecfe-463f-94c9-87737dc761bd" returned: 0 in 0.532s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:28 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-46c65166-abab-42ff-a2b0-630c9f7f6646 tempest-SnapshotDependencyTests-1390060396 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06d7ad66-fb05-4190-9735-cf197f846a9a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:33:28 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb01f63-3bb9-410a-88fe-b0b8ac0dc812]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-46c65166-abab-42ff-a2b0-630c9f7f6646 tempest-SnapshotDependencyTests-1390060396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-06d7ad66-fb05-4190-9735-cf197f846a9a {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:28 devstack sudo[106155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-06d7ad66-fb05-4190-9735-cf197f846a9a Sep 23 00:33:28 devstack sudo[106155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:28 devstack sudo[106153]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ae3b1aee-7753-4444-a726-530046d51507 tempest-ProjectReaderTests-1672073403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-510c7381-8340-48f9-a8f3-cd424a30d71a -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-510c7381-8340-48f9-a8f3-cd424a30d71a.fb2bce37-cedf-409d-87f6-45614a49bda4" returned: 0 in 0.436s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:28 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-ae3b1aee-7753-4444-a726-530046d51507 tempest-ProjectReaderTests-1672073403 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-510c7381-8340-48f9-a8f3-cd424a30d71a.fb2bce37-cedf-409d-87f6-45614a49bda4 is being set with open permissions: ugo+rw Sep 23 00:33:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ae3b1aee-7753-4444-a726-530046d51507 tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-510c7381-8340-48f9-a8f3-cd424a30d71a.fb2bce37-cedf-409d-87f6-45614a49bda4 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:29 devstack sudo[106160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-510c7381-8340-48f9-a8f3-cd424a30d71a.fb2bce37-cedf-409d-87f6-45614a49bda4 Sep 23 00:33:29 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:29 devstack sudo[106155]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:29 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-46c65166-abab-42ff-a2b0-630c9f7f6646 tempest-SnapshotDependencyTests-1390060396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-06d7ad66-fb05-4190-9735-cf197f846a9a" returned: 0 in 0.649s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-46c65166-abab-42ff-a2b0-630c9f7f6646 tempest-SnapshotDependencyTests-1390060396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-06d7ad66-fb05-4190-9735-cf197f846a9a.f18fdda5-ecfe-463f-94c9-87737dc761bd {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ae3b1aee-7753-4444-a726-530046d51507 tempest-ProjectReaderTests-1672073403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-510c7381-8340-48f9-a8f3-cd424a30d71a.fb2bce37-cedf-409d-87f6-45614a49bda4" returned: 0 in 0.365s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:29 devstack sudo[106166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-06d7ad66-fb05-4190-9735-cf197f846a9a.f18fdda5-ecfe-463f-94c9-87737dc761bd Sep 23 00:33:29 devstack sudo[106166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ae3b1aee-7753-4444-a726-530046d51507 tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-510c7381-8340-48f9-a8f3-cd424a30d71a.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:29 devstack sudo[106168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-510c7381-8340-48f9-a8f3-cd424a30d71a.info Sep 23 00:33:29 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:29 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ae3b1aee-7753-4444-a726-530046d51507 tempest-ProjectReaderTests-1672073403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-510c7381-8340-48f9-a8f3-cd424a30d71a.info" returned: 0 in 0.405s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:29 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-ae3b1aee-7753-4444-a726-530046d51507 tempest-ProjectReaderTests-1672073403 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-510c7381-8340-48f9-a8f3-cd424a30d71a.info is being set with open permissions: ugo+rw Sep 23 00:33:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ae3b1aee-7753-4444-a726-530046d51507 tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-510c7381-8340-48f9-a8f3-cd424a30d71a.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:29 devstack sudo[106166]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-46c65166-abab-42ff-a2b0-630c9f7f6646 tempest-SnapshotDependencyTests-1390060396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-06d7ad66-fb05-4190-9735-cf197f846a9a.f18fdda5-ecfe-463f-94c9-87737dc761bd" returned: 0 in 0.492s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:29 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-46c65166-abab-42ff-a2b0-630c9f7f6646 tempest-SnapshotDependencyTests-1390060396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-06d7ad66-fb05-4190-9735-cf197f846a9a.f18fdda5-ecfe-463f-94c9-87737dc761bd {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:29 devstack sudo[106174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-510c7381-8340-48f9-a8f3-cd424a30d71a.info Sep 23 00:33:29 devstack sudo[106174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:29 devstack sudo[106175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-06d7ad66-fb05-4190-9735-cf197f846a9a.f18fdda5-ecfe-463f-94c9-87737dc761bd Sep 23 00:33:29 devstack sudo[106175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:30 devstack sudo[106174]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-ae3b1aee-7753-4444-a726-530046d51507 tempest-ProjectReaderTests-1672073403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-510c7381-8340-48f9-a8f3-cd424a30d71a.info" returned: 0 in 0.348s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-ae3b1aee-7753-4444-a726-530046d51507 tempest-ProjectReaderTests-1672073403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.785s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-55aa64c6-4713-40bd-9dec-fc604d50fb84 tempest-ProjectMemberTests-2104250010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.422s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:30 devstack sudo[106175]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:30 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-55aa64c6-4713-40bd-9dec-fc604d50fb84 tempest-ProjectMemberTests-2104250010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1679503547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04e697c9-6fab-4b21-b94f-55299c2cf6ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='105e2fcb253445d18a9a36e4adbf6662',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:24Z,use_quota=True,user_id='6f62c0bf87c2488e987066aaecad1a03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:33:30 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-55aa64c6-4713-40bd-9dec-fc604d50fb84 tempest-ProjectMemberTests-2104250010 None] Creating volume 04e697c9-6fab-4b21-b94f-55299c2cf6ba {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:33:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-55aa64c6-4713-40bd-9dec-fc604d50fb84 tempest-ProjectMemberTests-2104250010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-55aa64c6-4713-40bd-9dec-fc604d50fb84 tempest-ProjectMemberTests-2104250010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:30 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-55aa64c6-4713-40bd-9dec-fc604d50fb84 tempest-ProjectMemberTests-2104250010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:30 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-55aa64c6-4713-40bd-9dec-fc604d50fb84 tempest-ProjectMemberTests-2104250010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-55aa64c6-4713-40bd-9dec-fc604d50fb84 tempest-ProjectMemberTests-2104250010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:30 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-55aa64c6-4713-40bd-9dec-fc604d50fb84 tempest-ProjectMemberTests-2104250010 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:33:30 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-55aa64c6-4713-40bd-9dec-fc604d50fb84 tempest-ProjectMemberTests-2104250010 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:33:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-55aa64c6-4713-40bd-9dec-fc604d50fb84 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-04e697c9-6fab-4b21-b94f-55299c2cf6ba 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:30 devstack sudo[106180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-04e697c9-6fab-4b21-b94f-55299c2cf6ba 1073741824 Sep 23 00:33:30 devstack sudo[106180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-46c65166-abab-42ff-a2b0-630c9f7f6646 tempest-SnapshotDependencyTests-1390060396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-06d7ad66-fb05-4190-9735-cf197f846a9a.f18fdda5-ecfe-463f-94c9-87737dc761bd" returned: 0 in 0.403s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:30 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-ae3b1aee-7753-4444-a726-530046d51507 tempest-ProjectReaderTests-1672073403 None] Create snapshot completed successfully Sep 23 00:33:30 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-46c65166-abab-42ff-a2b0-630c9f7f6646 tempest-SnapshotDependencyTests-1390060396 None] Lock "cinder-quobyte-f18fdda5-ecfe-463f-94c9-87737dc761bd" released by "_delete_snapshot" :: held 2.244s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:30 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-46c65166-abab-42ff-a2b0-630c9f7f6646 tempest-SnapshotDependencyTests-1390060396 None] Lock "cinder-quobyte-06d7ad66-fb05-4190-9735-cf197f846a9a" released by "delete_snapshot" :: held 2.274s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:30 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-46c65166-abab-42ff-a2b0-630c9f7f6646 tempest-SnapshotDependencyTests-1390060396 None] Created reservations ['5a9aa6ed-5ee2-4ebc-a751-c2dbe6d921fc', '7ed6ae6a-d56c-437d-9523-79011f5da541', '4cd9786c-2a26-4f36-8e8e-005e434225af', 'd2ea8028-9d83-4bf6-89cc-e7c505f84ff9'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:33:30 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-46c65166-abab-42ff-a2b0-630c9f7f6646 tempest-SnapshotDependencyTests-1390060396 None] Delete snapshot completed successfully. Sep 23 00:33:30 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-46c65166-abab-42ff-a2b0-630c9f7f6646 tempest-SnapshotDependencyTests-1390060396 None] Lock "cinder-f18fdda5-ecfe-463f-94c9-87737dc761bd-delete_snapshot" released by "delete_snapshot" :: held 2.448s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:30 devstack sudo[106180]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-55aa64c6-4713-40bd-9dec-fc604d50fb84 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-04e697c9-6fab-4b21-b94f-55299c2cf6ba 1073741824" returned: 0 in 0.479s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-55aa64c6-4713-40bd-9dec-fc604d50fb84 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-04e697c9-6fab-4b21-b94f-55299c2cf6ba {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:30 devstack sudo[106186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-04e697c9-6fab-4b21-b94f-55299c2cf6ba Sep 23 00:33:30 devstack sudo[106186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:30 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-02058639-0221-453c-a8cd-1225572fc98e tempest-ProjectReaderTests-1672073403 None] Acquiring lock "cinder-fb2bce37-cedf-409d-87f6-45614a49bda4-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:30 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-02058639-0221-453c-a8cd-1225572fc98e tempest-ProjectReaderTests-1672073403 None] Lock "cinder-fb2bce37-cedf-409d-87f6-45614a49bda4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:30 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-02058639-0221-453c-a8cd-1225572fc98e tempest-ProjectReaderTests-1672073403 None] Acquiring lock "cinder-quobyte-510c7381-8340-48f9-a8f3-cd424a30d71a" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:30 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-02058639-0221-453c-a8cd-1225572fc98e tempest-ProjectReaderTests-1672073403 None] Lock "cinder-quobyte-510c7381-8340-48f9-a8f3-cd424a30d71a" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:30 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-02058639-0221-453c-a8cd-1225572fc98e tempest-ProjectReaderTests-1672073403 None] Acquiring lock "cinder-quobyte-fb2bce37-cedf-409d-87f6-45614a49bda4" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:30 devstack sudo[106186]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-55aa64c6-4713-40bd-9dec-fc604d50fb84 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-04e697c9-6fab-4b21-b94f-55299c2cf6ba" returned: 0 in 0.274s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:30 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-55aa64c6-4713-40bd-9dec-fc604d50fb84 tempest-ProjectMemberTests-2104250010 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:33:30 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-55aa64c6-4713-40bd-9dec-fc604d50fb84 tempest-ProjectMemberTests-2104250010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:30 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-02058639-0221-453c-a8cd-1225572fc98e tempest-ProjectReaderTests-1672073403 None] Lock "cinder-quobyte-fb2bce37-cedf-409d-87f6-45614a49bda4" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:30 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-02058639-0221-453c-a8cd-1225572fc98e tempest-ProjectReaderTests-1672073403 None] Deleting offline snapshot fb2bce37-cedf-409d-87f6-45614a49bda4 of volume 510c7381-8340-48f9-a8f3-cd424a30d71a {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:33:30 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-02058639-0221-453c-a8cd-1225572fc98e tempest-ProjectReaderTests-1672073403 None] snapshot_file for this snap is: volume-510c7381-8340-48f9-a8f3-cd424a30d71a.fb2bce37-cedf-409d-87f6-45614a49bda4 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:33:30 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-55aa64c6-4713-40bd-9dec-fc604d50fb84 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f01eaca6-7f49-4a2c-8797-c34ee850e41a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04e697c9-6fab-4b21-b94f-55299c2cf6ba', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:30 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-55aa64c6-4713-40bd-9dec-fc604d50fb84 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58251f09-0aa1-41d9-b8cc-16c070bd64ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:30 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc0a3e8-fa7a-4a5a-ab46-4902f147e160]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-02058639-0221-453c-a8cd-1225572fc98e tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-510c7381-8340-48f9-a8f3-cd424a30d71a.fb2bce37-cedf-409d-87f6-45614a49bda4 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:31 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-55aa64c6-4713-40bd-9dec-fc604d50fb84 tempest-ProjectMemberTests-2104250010 None] Volume volume-04e697c9-6fab-4b21-b94f-55299c2cf6ba (04e697c9-6fab-4b21-b94f-55299c2cf6ba): created successfully Sep 23 00:33:31 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-55aa64c6-4713-40bd-9dec-fc604d50fb84 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58251f09-0aa1-41d9-b8cc-16c070bd64ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:31 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-55aa64c6-4713-40bd-9dec-fc604d50fb84 tempest-ProjectMemberTests-2104250010 None] Flow 'volume_create_manager' (56f31f72-aacf-4a1c-a0e9-57414cadb7e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:31 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-55aa64c6-4713-40bd-9dec-fc604d50fb84 tempest-ProjectMemberTests-2104250010 None] Created volume successfully. Sep 23 00:33:31 devstack sudo[106189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-510c7381-8340-48f9-a8f3-cd424a30d71a.fb2bce37-cedf-409d-87f6-45614a49bda4 Sep 23 00:33:31 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:31 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-31cabbfc-3b49-476d-8a03-3875afa37631 tempest-SnapshotDependencyTests-1390060396 None] Acquiring lock "cinder-06d7ad66-fb05-4190-9735-cf197f846a9a-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:31 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-31cabbfc-3b49-476d-8a03-3875afa37631 tempest-SnapshotDependencyTests-1390060396 None] Lock "cinder-06d7ad66-fb05-4190-9735-cf197f846a9a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:31 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-31cabbfc-3b49-476d-8a03-3875afa37631 tempest-SnapshotDependencyTests-1390060396 None] Acquiring lock "cinder-quobyte-06d7ad66-fb05-4190-9735-cf197f846a9a" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:31 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-31cabbfc-3b49-476d-8a03-3875afa37631 tempest-SnapshotDependencyTests-1390060396 None] Lock "cinder-quobyte-06d7ad66-fb05-4190-9735-cf197f846a9a" acquired by "delete_volume" :: waited 0.033s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:31 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb70cbf8-f0d1-445b-a291-de89d2643ba5]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-31cabbfc-3b49-476d-8a03-3875afa37631 tempest-SnapshotDependencyTests-1390060396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-06d7ad66-fb05-4190-9735-cf197f846a9a {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9b5a8a3e-8ea1-4027-af85-1d0087036237 tempest-ProjectMemberTests-2104250010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9b5a8a3e-8ea1-4027-af85-1d0087036237 tempest-ProjectMemberTests-2104250010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:31 devstack sudo[106191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-06d7ad66-fb05-4190-9735-cf197f846a9a Sep 23 00:33:31 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:31 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-9b5a8a3e-8ea1-4027-af85-1d0087036237 tempest-ProjectMemberTests-2104250010 None] Creating offline snapshot fc71502b-1641-4de7-8268-a7dde2927270 of volume 04e697c9-6fab-4b21-b94f-55299c2cf6ba {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:33:31 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[80267692-d75e-4849-99ee-500b269abadf]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9b5a8a3e-8ea1-4027-af85-1d0087036237 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-04e697c9-6fab-4b21-b94f-55299c2cf6ba {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:31 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-02058639-0221-453c-a8cd-1225572fc98e tempest-ProjectReaderTests-1672073403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-510c7381-8340-48f9-a8f3-cd424a30d71a.fb2bce37-cedf-409d-87f6-45614a49bda4" returned: 0 in 0.564s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:31 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-02058639-0221-453c-a8cd-1225572fc98e tempest-ProjectReaderTests-1672073403 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-510c7381-8340-48f9-a8f3-cd424a30d71a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:33:31 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[987674b5-6fc3-4cc1-b12b-426bbf863f93]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-02058639-0221-453c-a8cd-1225572fc98e tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-510c7381-8340-48f9-a8f3-cd424a30d71a {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:31 devstack sudo[106196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-04e697c9-6fab-4b21-b94f-55299c2cf6ba Sep 23 00:33:31 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:31 devstack sudo[106197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-510c7381-8340-48f9-a8f3-cd424a30d71a Sep 23 00:33:31 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:31 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-31cabbfc-3b49-476d-8a03-3875afa37631 tempest-SnapshotDependencyTests-1390060396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-06d7ad66-fb05-4190-9735-cf197f846a9a" returned: 0 in 0.456s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-31cabbfc-3b49-476d-8a03-3875afa37631 tempest-SnapshotDependencyTests-1390060396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-06d7ad66-fb05-4190-9735-cf197f846a9a {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:31 devstack sudo[106203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-06d7ad66-fb05-4190-9735-cf197f846a9a Sep 23 00:33:31 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:31 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9b5a8a3e-8ea1-4027-af85-1d0087036237 tempest-ProjectMemberTests-2104250010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-04e697c9-6fab-4b21-b94f-55299c2cf6ba" returned: 0 in 0.462s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:31 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9b5a8a3e-8ea1-4027-af85-1d0087036237 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-04e697c9-6fab-4b21-b94f-55299c2cf6ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-04e697c9-6fab-4b21-b94f-55299c2cf6ba.fc71502b-1641-4de7-8268-a7dde2927270 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:32 devstack sudo[106210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-04e697c9-6fab-4b21-b94f-55299c2cf6ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-04e697c9-6fab-4b21-b94f-55299c2cf6ba.fc71502b-1641-4de7-8268-a7dde2927270 1G Sep 23 00:33:32 devstack sudo[106210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:32 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-02058639-0221-453c-a8cd-1225572fc98e tempest-ProjectReaderTests-1672073403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-510c7381-8340-48f9-a8f3-cd424a30d71a" returned: 0 in 0.481s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-02058639-0221-453c-a8cd-1225572fc98e tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-510c7381-8340-48f9-a8f3-cd424a30d71a.fb2bce37-cedf-409d-87f6-45614a49bda4 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:32 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-31cabbfc-3b49-476d-8a03-3875afa37631 tempest-SnapshotDependencyTests-1390060396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-06d7ad66-fb05-4190-9735-cf197f846a9a" returned: 0 in 0.275s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:32 devstack sudo[106214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-510c7381-8340-48f9-a8f3-cd424a30d71a.fb2bce37-cedf-409d-87f6-45614a49bda4 Sep 23 00:33:32 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:32 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-31cabbfc-3b49-476d-8a03-3875afa37631 tempest-SnapshotDependencyTests-1390060396 None] Lock "cinder-quobyte-06d7ad66-fb05-4190-9735-cf197f846a9a" released by "delete_volume" :: held 0.829s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:32 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-31cabbfc-3b49-476d-8a03-3875afa37631 tempest-SnapshotDependencyTests-1390060396 None] Created reservations ['4a022792-36e7-4cb2-9167-4a4d0fd38731', '1ea61dd6-3c9a-4bba-920c-733acc748723', '1c573706-e053-40c0-adba-e4719e82b3a4', 'ebcfa07c-09d7-4d9f-8123-842d9f10f6fc'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:33:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-31cabbfc-3b49-476d-8a03-3875afa37631 tempest-SnapshotDependencyTests-1390060396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-31cabbfc-3b49-476d-8a03-3875afa37631 tempest-SnapshotDependencyTests-1390060396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:32 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-31cabbfc-3b49-476d-8a03-3875afa37631 tempest-SnapshotDependencyTests-1390060396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:32 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-31cabbfc-3b49-476d-8a03-3875afa37631 tempest-SnapshotDependencyTests-1390060396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-31cabbfc-3b49-476d-8a03-3875afa37631 tempest-SnapshotDependencyTests-1390060396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-31cabbfc-3b49-476d-8a03-3875afa37631 tempest-SnapshotDependencyTests-1390060396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:32 devstack sudo[106217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:33:32 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:32 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-89436db8-c694-41bc-aabb-25c6b7632f07 tempest-SnapshotDependencyTests-1390060396 None] Acquiring lock "cinder-ee40e70e-3594-4b67-a14e-f667f331a3bc-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:32 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-89436db8-c694-41bc-aabb-25c6b7632f07 tempest-SnapshotDependencyTests-1390060396 None] Lock "cinder-ee40e70e-3594-4b67-a14e-f667f331a3bc-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:32 devstack sudo[106210]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:32 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:32 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9b5a8a3e-8ea1-4027-af85-1d0087036237 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-04e697c9-6fab-4b21-b94f-55299c2cf6ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-04e697c9-6fab-4b21-b94f-55299c2cf6ba.fc71502b-1641-4de7-8268-a7dde2927270 1G" returned: 0 in 0.614s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9b5a8a3e-8ea1-4027-af85-1d0087036237 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04e697c9-6fab-4b21-b94f-55299c2cf6ba -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-04e697c9-6fab-4b21-b94f-55299c2cf6ba.fc71502b-1641-4de7-8268-a7dde2927270 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:32 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-89436db8-c694-41bc-aabb-25c6b7632f07 tempest-SnapshotDependencyTests-1390060396 None] Acquiring lock "cinder-quobyte-ee40e70e-3594-4b67-a14e-f667f331a3bc" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-02058639-0221-453c-a8cd-1225572fc98e tempest-ProjectReaderTests-1672073403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-510c7381-8340-48f9-a8f3-cd424a30d71a.fb2bce37-cedf-409d-87f6-45614a49bda4" returned: 0 in 0.547s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-31cabbfc-3b49-476d-8a03-3875afa37631 tempest-SnapshotDependencyTests-1390060396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.365s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-02058639-0221-453c-a8cd-1225572fc98e tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-510c7381-8340-48f9-a8f3-cd424a30d71a.fb2bce37-cedf-409d-87f6-45614a49bda4 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:32 devstack sudo[106226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04e697c9-6fab-4b21-b94f-55299c2cf6ba -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-04e697c9-6fab-4b21-b94f-55299c2cf6ba.fc71502b-1641-4de7-8268-a7dde2927270 Sep 23 00:33:32 devstack sudo[106226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:32 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-31cabbfc-3b49-476d-8a03-3875afa37631 tempest-SnapshotDependencyTests-1390060396 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:33:32 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-31cabbfc-3b49-476d-8a03-3875afa37631 tempest-SnapshotDependencyTests-1390060396 None] Deleted volume successfully. Sep 23 00:33:32 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-89436db8-c694-41bc-aabb-25c6b7632f07 tempest-SnapshotDependencyTests-1390060396 None] Lock "cinder-quobyte-ee40e70e-3594-4b67-a14e-f667f331a3bc" acquired by "delete_volume" :: waited 0.050s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:32 devstack sudo[106227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-510c7381-8340-48f9-a8f3-cd424a30d71a.fb2bce37-cedf-409d-87f6-45614a49bda4 Sep 23 00:33:32 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:32 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-31cabbfc-3b49-476d-8a03-3875afa37631 tempest-SnapshotDependencyTests-1390060396 None] Lock "cinder-06d7ad66-fb05-4190-9735-cf197f846a9a-delete_volume" released by "delete_volume" :: held 1.490s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:32 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e694c966-e0db-4a15-bcb1-f80440ef2221]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-89436db8-c694-41bc-aabb-25c6b7632f07 tempest-SnapshotDependencyTests-1390060396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ee40e70e-3594-4b67-a14e-f667f331a3bc {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:32 devstack sudo[106230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ee40e70e-3594-4b67-a14e-f667f331a3bc Sep 23 00:33:32 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:32 devstack sudo[106226]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9b5a8a3e-8ea1-4027-af85-1d0087036237 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04e697c9-6fab-4b21-b94f-55299c2cf6ba -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-04e697c9-6fab-4b21-b94f-55299c2cf6ba.fc71502b-1641-4de7-8268-a7dde2927270" returned: 0 in 0.334s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:32 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-9b5a8a3e-8ea1-4027-af85-1d0087036237 tempest-ProjectMemberTests-2104250010 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-04e697c9-6fab-4b21-b94f-55299c2cf6ba.fc71502b-1641-4de7-8268-a7dde2927270 is being set with open permissions: ugo+rw Sep 23 00:33:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9b5a8a3e-8ea1-4027-af85-1d0087036237 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-04e697c9-6fab-4b21-b94f-55299c2cf6ba.fc71502b-1641-4de7-8268-a7dde2927270 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:32 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:32 devstack sudo[106236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-04e697c9-6fab-4b21-b94f-55299c2cf6ba.fc71502b-1641-4de7-8268-a7dde2927270 Sep 23 00:33:32 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:32 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-02058639-0221-453c-a8cd-1225572fc98e tempest-ProjectReaderTests-1672073403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-510c7381-8340-48f9-a8f3-cd424a30d71a.fb2bce37-cedf-409d-87f6-45614a49bda4" returned: 0 in 0.354s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:33 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-02058639-0221-453c-a8cd-1225572fc98e tempest-ProjectReaderTests-1672073403 None] Lock "cinder-quobyte-fb2bce37-cedf-409d-87f6-45614a49bda4" released by "_delete_snapshot" :: held 2.075s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:33 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-02058639-0221-453c-a8cd-1225572fc98e tempest-ProjectReaderTests-1672073403 None] Lock "cinder-quobyte-510c7381-8340-48f9-a8f3-cd424a30d71a" released by "delete_snapshot" :: held 2.101s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:33 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-02058639-0221-453c-a8cd-1225572fc98e tempest-ProjectReaderTests-1672073403 None] Created reservations ['159c82dd-fe29-47d8-b06a-bbf8d90fad9d', '7f7a9acb-d8e8-44ba-9314-df2410addf77', 'a25ae370-c1a0-4c48-b860-2b9dad6c9775', 'ac283bde-129f-49fa-9d25-6fdc7ca141d0'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:33:33 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-89436db8-c694-41bc-aabb-25c6b7632f07 tempest-SnapshotDependencyTests-1390060396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ee40e70e-3594-4b67-a14e-f667f331a3bc" returned: 0 in 0.480s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-89436db8-c694-41bc-aabb-25c6b7632f07 tempest-SnapshotDependencyTests-1390060396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ee40e70e-3594-4b67-a14e-f667f331a3bc {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:33 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-02058639-0221-453c-a8cd-1225572fc98e tempest-ProjectReaderTests-1672073403 None] Delete snapshot completed successfully. Sep 23 00:33:33 devstack sudo[106242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ee40e70e-3594-4b67-a14e-f667f331a3bc Sep 23 00:33:33 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:33 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-02058639-0221-453c-a8cd-1225572fc98e tempest-ProjectReaderTests-1672073403 None] Lock "cinder-fb2bce37-cedf-409d-87f6-45614a49bda4-delete_snapshot" released by "delete_snapshot" :: held 2.328s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:33 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9b5a8a3e-8ea1-4027-af85-1d0087036237 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-04e697c9-6fab-4b21-b94f-55299c2cf6ba.fc71502b-1641-4de7-8268-a7dde2927270" returned: 0 in 0.305s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9b5a8a3e-8ea1-4027-af85-1d0087036237 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-04e697c9-6fab-4b21-b94f-55299c2cf6ba.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:33 devstack sudo[106244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-04e697c9-6fab-4b21-b94f-55299c2cf6ba.info Sep 23 00:33:33 devstack sudo[106244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:33 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-89436db8-c694-41bc-aabb-25c6b7632f07 tempest-SnapshotDependencyTests-1390060396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-ee40e70e-3594-4b67-a14e-f667f331a3bc" returned: 0 in 0.295s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:33 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-89436db8-c694-41bc-aabb-25c6b7632f07 tempest-SnapshotDependencyTests-1390060396 None] Lock "cinder-quobyte-ee40e70e-3594-4b67-a14e-f667f331a3bc" released by "delete_volume" :: held 0.848s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:33 devstack sudo[106244]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9b5a8a3e-8ea1-4027-af85-1d0087036237 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-04e697c9-6fab-4b21-b94f-55299c2cf6ba.info" returned: 0 in 0.287s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:33 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-9b5a8a3e-8ea1-4027-af85-1d0087036237 tempest-ProjectMemberTests-2104250010 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-04e697c9-6fab-4b21-b94f-55299c2cf6ba.info is being set with open permissions: ugo+rw Sep 23 00:33:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9b5a8a3e-8ea1-4027-af85-1d0087036237 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-04e697c9-6fab-4b21-b94f-55299c2cf6ba.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:33 devstack sudo[106248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-04e697c9-6fab-4b21-b94f-55299c2cf6ba.info Sep 23 00:33:33 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:33 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-89436db8-c694-41bc-aabb-25c6b7632f07 tempest-SnapshotDependencyTests-1390060396 None] Created reservations ['a6cb4edf-c985-44ee-af0e-03f41a1f970e', 'd609bd7c-0eeb-4694-bc02-9dcdb5a1e544', '60f495e5-28ff-4cdf-8976-364d721a7a11', '04180ceb-73eb-42f4-9162-1572489b3988'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:33:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-89436db8-c694-41bc-aabb-25c6b7632f07 tempest-SnapshotDependencyTests-1390060396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-89436db8-c694-41bc-aabb-25c6b7632f07 tempest-SnapshotDependencyTests-1390060396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:33 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-89436db8-c694-41bc-aabb-25c6b7632f07 tempest-SnapshotDependencyTests-1390060396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:33 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-89436db8-c694-41bc-aabb-25c6b7632f07 tempest-SnapshotDependencyTests-1390060396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-89436db8-c694-41bc-aabb-25c6b7632f07 tempest-SnapshotDependencyTests-1390060396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-89436db8-c694-41bc-aabb-25c6b7632f07 tempest-SnapshotDependencyTests-1390060396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:33 devstack sudo[106250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:33:33 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:33 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9b5a8a3e-8ea1-4027-af85-1d0087036237 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-04e697c9-6fab-4b21-b94f-55299c2cf6ba.info" returned: 0 in 0.280s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:33 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9b5a8a3e-8ea1-4027-af85-1d0087036237 tempest-ProjectMemberTests-2104250010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.386s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:33 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-9b5a8a3e-8ea1-4027-af85-1d0087036237 tempest-ProjectMemberTests-2104250010 None] Create snapshot completed successfully Sep 23 00:33:33 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-89436db8-c694-41bc-aabb-25c6b7632f07 tempest-SnapshotDependencyTests-1390060396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.295s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:34 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-89436db8-c694-41bc-aabb-25c6b7632f07 tempest-SnapshotDependencyTests-1390060396 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:33:34 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-89436db8-c694-41bc-aabb-25c6b7632f07 tempest-SnapshotDependencyTests-1390060396 None] Deleted volume successfully. Sep 23 00:33:34 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-89436db8-c694-41bc-aabb-25c6b7632f07 tempest-SnapshotDependencyTests-1390060396 None] Lock "cinder-ee40e70e-3594-4b67-a14e-f667f331a3bc-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:34 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-1cf19f5d-c0cd-4d6d-8c24-5d2338eb57bf tempest-ProjectReaderTests-1672073403 None] Acquiring lock "cinder-510c7381-8340-48f9-a8f3-cd424a30d71a-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:34 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-1cf19f5d-c0cd-4d6d-8c24-5d2338eb57bf tempest-ProjectReaderTests-1672073403 None] Lock "cinder-510c7381-8340-48f9-a8f3-cd424a30d71a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:34 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-1cf19f5d-c0cd-4d6d-8c24-5d2338eb57bf tempest-ProjectReaderTests-1672073403 None] Acquiring lock "cinder-quobyte-510c7381-8340-48f9-a8f3-cd424a30d71a" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:34 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-1cf19f5d-c0cd-4d6d-8c24-5d2338eb57bf tempest-ProjectReaderTests-1672073403 None] Lock "cinder-quobyte-510c7381-8340-48f9-a8f3-cd424a30d71a" acquired by "delete_volume" :: waited 0.015s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:34 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e47eb2-50e2-40fb-8c02-14adc0019e90]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1cf19f5d-c0cd-4d6d-8c24-5d2338eb57bf tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-510c7381-8340-48f9-a8f3-cd424a30d71a {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:34 devstack sudo[106254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-510c7381-8340-48f9-a8f3-cd424a30d71a Sep 23 00:33:34 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:34 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1cf19f5d-c0cd-4d6d-8c24-5d2338eb57bf tempest-ProjectReaderTests-1672073403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-510c7381-8340-48f9-a8f3-cd424a30d71a" returned: 0 in 0.417s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1cf19f5d-c0cd-4d6d-8c24-5d2338eb57bf tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-510c7381-8340-48f9-a8f3-cd424a30d71a {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:34 devstack sudo[106259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-510c7381-8340-48f9-a8f3-cd424a30d71a Sep 23 00:33:34 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:34 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5b0fabe3-a9d6-430f-8327-c3ac36cbf9ad tempest-ProjectMemberTests-2104250010 None] Acquiring lock "cinder-fc71502b-1641-4de7-8268-a7dde2927270-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:34 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5b0fabe3-a9d6-430f-8327-c3ac36cbf9ad tempest-ProjectMemberTests-2104250010 None] Lock "cinder-fc71502b-1641-4de7-8268-a7dde2927270-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:34 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5b0fabe3-a9d6-430f-8327-c3ac36cbf9ad tempest-ProjectMemberTests-2104250010 None] Acquiring lock "cinder-quobyte-04e697c9-6fab-4b21-b94f-55299c2cf6ba" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:34 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5b0fabe3-a9d6-430f-8327-c3ac36cbf9ad tempest-ProjectMemberTests-2104250010 None] Lock "cinder-quobyte-04e697c9-6fab-4b21-b94f-55299c2cf6ba" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:34 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5b0fabe3-a9d6-430f-8327-c3ac36cbf9ad tempest-ProjectMemberTests-2104250010 None] Acquiring lock "cinder-quobyte-fc71502b-1641-4de7-8268-a7dde2927270" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:34 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5b0fabe3-a9d6-430f-8327-c3ac36cbf9ad tempest-ProjectMemberTests-2104250010 None] Lock "cinder-quobyte-fc71502b-1641-4de7-8268-a7dde2927270" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:34 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-5b0fabe3-a9d6-430f-8327-c3ac36cbf9ad tempest-ProjectMemberTests-2104250010 None] Deleting offline snapshot fc71502b-1641-4de7-8268-a7dde2927270 of volume 04e697c9-6fab-4b21-b94f-55299c2cf6ba {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:33:34 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-5b0fabe3-a9d6-430f-8327-c3ac36cbf9ad tempest-ProjectMemberTests-2104250010 None] snapshot_file for this snap is: volume-04e697c9-6fab-4b21-b94f-55299c2cf6ba.fc71502b-1641-4de7-8268-a7dde2927270 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:33:34 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d1ed65-3c76-4823-a719-61c956850007]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:34 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5b0fabe3-a9d6-430f-8327-c3ac36cbf9ad tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-04e697c9-6fab-4b21-b94f-55299c2cf6ba.fc71502b-1641-4de7-8268-a7dde2927270 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:35 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1cf19f5d-c0cd-4d6d-8c24-5d2338eb57bf tempest-ProjectReaderTests-1672073403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-510c7381-8340-48f9-a8f3-cd424a30d71a" returned: 0 in 0.382s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:35 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-1cf19f5d-c0cd-4d6d-8c24-5d2338eb57bf tempest-ProjectReaderTests-1672073403 None] Lock "cinder-quobyte-510c7381-8340-48f9-a8f3-cd424a30d71a" released by "delete_volume" :: held 0.882s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:35 devstack sudo[106261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-04e697c9-6fab-4b21-b94f-55299c2cf6ba.fc71502b-1641-4de7-8268-a7dde2927270 Sep 23 00:33:35 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:35 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-1cf19f5d-c0cd-4d6d-8c24-5d2338eb57bf tempest-ProjectReaderTests-1672073403 None] Created reservations ['7bb809e7-128f-4a59-815f-5f968577f902', '9b01d28f-dfa7-4370-82e7-d3859911e319', '69c8c8d2-42bb-42e4-b882-7827ed1dd885', '1cd93a12-8807-4735-a65d-2db14ac46add'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:33:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1cf19f5d-c0cd-4d6d-8c24-5d2338eb57bf tempest-ProjectReaderTests-1672073403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1cf19f5d-c0cd-4d6d-8c24-5d2338eb57bf tempest-ProjectReaderTests-1672073403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:35 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1cf19f5d-c0cd-4d6d-8c24-5d2338eb57bf tempest-ProjectReaderTests-1672073403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:35 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1cf19f5d-c0cd-4d6d-8c24-5d2338eb57bf tempest-ProjectReaderTests-1672073403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1cf19f5d-c0cd-4d6d-8c24-5d2338eb57bf tempest-ProjectReaderTests-1672073403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1cf19f5d-c0cd-4d6d-8c24-5d2338eb57bf tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:35 devstack sudo[106264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:33:35 devstack sudo[106264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:35 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5b0fabe3-a9d6-430f-8327-c3ac36cbf9ad tempest-ProjectMemberTests-2104250010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-04e697c9-6fab-4b21-b94f-55299c2cf6ba.fc71502b-1641-4de7-8268-a7dde2927270" returned: 0 in 0.556s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:35 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-5b0fabe3-a9d6-430f-8327-c3ac36cbf9ad tempest-ProjectMemberTests-2104250010 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04e697c9-6fab-4b21-b94f-55299c2cf6ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:33:35 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d91bd37-2ccb-4dd7-86ef-04d02b103ab4]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5b0fabe3-a9d6-430f-8327-c3ac36cbf9ad tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-04e697c9-6fab-4b21-b94f-55299c2cf6ba {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:35 devstack sudo[106264]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:35 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1cf19f5d-c0cd-4d6d-8c24-5d2338eb57bf tempest-ProjectReaderTests-1672073403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.386s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:35 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-1cf19f5d-c0cd-4d6d-8c24-5d2338eb57bf tempest-ProjectReaderTests-1672073403 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:33:35 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-1cf19f5d-c0cd-4d6d-8c24-5d2338eb57bf tempest-ProjectReaderTests-1672073403 None] Deleted volume successfully. Sep 23 00:33:35 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-1cf19f5d-c0cd-4d6d-8c24-5d2338eb57bf tempest-ProjectReaderTests-1672073403 None] Lock "cinder-510c7381-8340-48f9-a8f3-cd424a30d71a-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:35 devstack sudo[106270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-04e697c9-6fab-4b21-b94f-55299c2cf6ba Sep 23 00:33:35 devstack sudo[106270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:36 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-70716bda-1ba5-4ac6-b523-824d717f35bc tempest-ProjectReaderTests-1672073403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:33:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-70716bda-1ba5-4ac6-b523-824d717f35bc tempest-ProjectReaderTests-1672073403 None] Flow 'volume_create_manager' (50b2ebd3-f192-48ad-8207-10f0a91c92a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-70716bda-1ba5-4ac6-b523-824d717f35bc tempest-ProjectReaderTests-1672073403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc68991d-ac6d-48ba-bd33-ec8e866f15f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:36 devstack sudo[106270]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-70716bda-1ba5-4ac6-b523-824d717f35bc tempest-ProjectReaderTests-1672073403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc68991d-ac6d-48ba-bd33-ec8e866f15f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-746775785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b4e9198-5c48-472d-b091-a74e7cc03980,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a361786c5d944c5a73653e654c80def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:36Z,use_quota=True,user_id='f01a5c248a78434fb39a1d6e1e81a391',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-70716bda-1ba5-4ac6-b523-824d717f35bc tempest-ProjectReaderTests-1672073403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62ecc726-ea85-4452-9b4f-a2f636fd64fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-70716bda-1ba5-4ac6-b523-824d717f35bc tempest-ProjectReaderTests-1672073403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62ecc726-ea85-4452-9b4f-a2f636fd64fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-70716bda-1ba5-4ac6-b523-824d717f35bc tempest-ProjectReaderTests-1672073403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92e62b02-9544-40b0-a611-d012e3cabe05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-70716bda-1ba5-4ac6-b523-824d717f35bc tempest-ProjectReaderTests-1672073403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92e62b02-9544-40b0-a611-d012e3cabe05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b4e9198-5c48-472d-b091-a74e7cc03980', 'volume_name': 'volume-2b4e9198-5c48-472d-b091-a74e7cc03980', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-70716bda-1ba5-4ac6-b523-824d717f35bc tempest-ProjectReaderTests-1672073403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b0eb036-944b-4df8-9177-1b1f33950e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-70716bda-1ba5-4ac6-b523-824d717f35bc tempest-ProjectReaderTests-1672073403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b0eb036-944b-4df8-9177-1b1f33950e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:36 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-70716bda-1ba5-4ac6-b523-824d717f35bc tempest-ProjectReaderTests-1672073403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc41a87a-85aa-4306-bbac-bc636218aa4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:36 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-70716bda-1ba5-4ac6-b523-824d717f35bc tempest-ProjectReaderTests-1672073403 None] Volume 2b4e9198-5c48-472d-b091-a74e7cc03980: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b4e9198-5c48-472d-b091-a74e7cc03980', 'volume_size': 1} Sep 23 00:33:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-70716bda-1ba5-4ac6-b523-824d717f35bc tempest-ProjectReaderTests-1672073403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-70716bda-1ba5-4ac6-b523-824d717f35bc tempest-ProjectReaderTests-1672073403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:36 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-70716bda-1ba5-4ac6-b523-824d717f35bc tempest-ProjectReaderTests-1672073403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-746775785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b4e9198-5c48-472d-b091-a74e7cc03980,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a361786c5d944c5a73653e654c80def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:36Z,use_quota=True,user_id='f01a5c248a78434fb39a1d6e1e81a391',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:33:36 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-70716bda-1ba5-4ac6-b523-824d717f35bc tempest-ProjectReaderTests-1672073403 None] Creating volume 2b4e9198-5c48-472d-b091-a74e7cc03980 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:33:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-70716bda-1ba5-4ac6-b523-824d717f35bc tempest-ProjectReaderTests-1672073403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-70716bda-1ba5-4ac6-b523-824d717f35bc tempest-ProjectReaderTests-1672073403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:36 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-70716bda-1ba5-4ac6-b523-824d717f35bc tempest-ProjectReaderTests-1672073403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:36 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-70716bda-1ba5-4ac6-b523-824d717f35bc tempest-ProjectReaderTests-1672073403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-70716bda-1ba5-4ac6-b523-824d717f35bc tempest-ProjectReaderTests-1672073403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:36 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-70716bda-1ba5-4ac6-b523-824d717f35bc tempest-ProjectReaderTests-1672073403 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:33:36 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-70716bda-1ba5-4ac6-b523-824d717f35bc tempest-ProjectReaderTests-1672073403 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:33:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-70716bda-1ba5-4ac6-b523-824d717f35bc tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2b4e9198-5c48-472d-b091-a74e7cc03980 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5b0fabe3-a9d6-430f-8327-c3ac36cbf9ad tempest-ProjectMemberTests-2104250010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-04e697c9-6fab-4b21-b94f-55299c2cf6ba" returned: 0 in 0.706s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5b0fabe3-a9d6-430f-8327-c3ac36cbf9ad tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-04e697c9-6fab-4b21-b94f-55299c2cf6ba.fc71502b-1641-4de7-8268-a7dde2927270 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:36 devstack sudo[106277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2b4e9198-5c48-472d-b091-a74e7cc03980 1073741824 Sep 23 00:33:36 devstack sudo[106277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:36 devstack sudo[106278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-04e697c9-6fab-4b21-b94f-55299c2cf6ba.fc71502b-1641-4de7-8268-a7dde2927270 Sep 23 00:33:36 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:36 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5b0fabe3-a9d6-430f-8327-c3ac36cbf9ad tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-04e697c9-6fab-4b21-b94f-55299c2cf6ba.fc71502b-1641-4de7-8268-a7dde2927270" returned: 0 in 0.400s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5b0fabe3-a9d6-430f-8327-c3ac36cbf9ad tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-04e697c9-6fab-4b21-b94f-55299c2cf6ba.fc71502b-1641-4de7-8268-a7dde2927270 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:36 devstack sudo[106287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-04e697c9-6fab-4b21-b94f-55299c2cf6ba.fc71502b-1641-4de7-8268-a7dde2927270 Sep 23 00:33:36 devstack sudo[106287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:36 devstack sudo[106277]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-70716bda-1ba5-4ac6-b523-824d717f35bc tempest-ProjectReaderTests-1672073403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2b4e9198-5c48-472d-b091-a74e7cc03980 1073741824" returned: 0 in 0.532s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:36 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-70716bda-1ba5-4ac6-b523-824d717f35bc tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2b4e9198-5c48-472d-b091-a74e7cc03980 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:36 devstack sudo[106289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2b4e9198-5c48-472d-b091-a74e7cc03980 Sep 23 00:33:36 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:37 devstack sudo[106287]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-5b0fabe3-a9d6-430f-8327-c3ac36cbf9ad tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-04e697c9-6fab-4b21-b94f-55299c2cf6ba.fc71502b-1641-4de7-8268-a7dde2927270" returned: 0 in 0.352s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:37 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5b0fabe3-a9d6-430f-8327-c3ac36cbf9ad tempest-ProjectMemberTests-2104250010 None] Lock "cinder-quobyte-fc71502b-1641-4de7-8268-a7dde2927270" released by "_delete_snapshot" :: held 2.187s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:37 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5b0fabe3-a9d6-430f-8327-c3ac36cbf9ad tempest-ProjectMemberTests-2104250010 None] Lock "cinder-quobyte-04e697c9-6fab-4b21-b94f-55299c2cf6ba" released by "delete_snapshot" :: held 2.230s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:37 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-70716bda-1ba5-4ac6-b523-824d717f35bc tempest-ProjectReaderTests-1672073403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2b4e9198-5c48-472d-b091-a74e7cc03980" returned: 0 in 0.349s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:37 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-70716bda-1ba5-4ac6-b523-824d717f35bc tempest-ProjectReaderTests-1672073403 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:33:37 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-70716bda-1ba5-4ac6-b523-824d717f35bc tempest-ProjectReaderTests-1672073403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:37 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-5b0fabe3-a9d6-430f-8327-c3ac36cbf9ad tempest-ProjectMemberTests-2104250010 None] Created reservations ['ccb027b9-5510-4dc6-902f-135e4790e874', '446f0770-4b7a-410e-a384-5b6cbd4f6901', '2926f886-020a-49a6-b31d-8eadcdc911a4', '0ad76292-4797-4fcc-b2c5-a52e35acad1f'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:33:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-70716bda-1ba5-4ac6-b523-824d717f35bc tempest-ProjectReaderTests-1672073403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc41a87a-85aa-4306-bbac-bc636218aa4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b4e9198-5c48-472d-b091-a74e7cc03980', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-70716bda-1ba5-4ac6-b523-824d717f35bc tempest-ProjectReaderTests-1672073403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (871fd002-619c-488e-b97a-6d4862b97f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:37 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-70716bda-1ba5-4ac6-b523-824d717f35bc tempest-ProjectReaderTests-1672073403 None] Volume volume-2b4e9198-5c48-472d-b091-a74e7cc03980 (2b4e9198-5c48-472d-b091-a74e7cc03980): created successfully Sep 23 00:33:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-70716bda-1ba5-4ac6-b523-824d717f35bc tempest-ProjectReaderTests-1672073403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (871fd002-619c-488e-b97a-6d4862b97f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:37 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-70716bda-1ba5-4ac6-b523-824d717f35bc tempest-ProjectReaderTests-1672073403 None] Flow 'volume_create_manager' (50b2ebd3-f192-48ad-8207-10f0a91c92a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:37 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-70716bda-1ba5-4ac6-b523-824d717f35bc tempest-ProjectReaderTests-1672073403 None] Created volume successfully. Sep 23 00:33:37 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-5b0fabe3-a9d6-430f-8327-c3ac36cbf9ad tempest-ProjectMemberTests-2104250010 None] Delete snapshot completed successfully. Sep 23 00:33:37 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-5b0fabe3-a9d6-430f-8327-c3ac36cbf9ad tempest-ProjectMemberTests-2104250010 None] Lock "cinder-fc71502b-1641-4de7-8268-a7dde2927270-delete_snapshot" released by "delete_snapshot" :: held 2.485s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:38 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-54916a52-4dfb-4fdd-839d-d5ce6bf2a096 tempest-ProjectMemberTests-2104250010 None] Acquiring lock "cinder-04e697c9-6fab-4b21-b94f-55299c2cf6ba-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:38 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-54916a52-4dfb-4fdd-839d-d5ce6bf2a096 tempest-ProjectMemberTests-2104250010 None] Lock "cinder-04e697c9-6fab-4b21-b94f-55299c2cf6ba-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:38 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-54916a52-4dfb-4fdd-839d-d5ce6bf2a096 tempest-ProjectMemberTests-2104250010 None] Acquiring lock "cinder-quobyte-04e697c9-6fab-4b21-b94f-55299c2cf6ba" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:38 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-54916a52-4dfb-4fdd-839d-d5ce6bf2a096 tempest-ProjectMemberTests-2104250010 None] Lock "cinder-quobyte-04e697c9-6fab-4b21-b94f-55299c2cf6ba" acquired by "delete_volume" :: waited 0.032s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:38 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c30277d-dd15-41ca-a6a6-fe4f48bc1c18]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-54916a52-4dfb-4fdd-839d-d5ce6bf2a096 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-04e697c9-6fab-4b21-b94f-55299c2cf6ba {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:38 devstack sudo[106295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-04e697c9-6fab-4b21-b94f-55299c2cf6ba Sep 23 00:33:38 devstack sudo[106295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-588d441d-43c9-44cc-9e14-b9d6584bebaf tempest-ProjectReaderTests-1672073403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-588d441d-43c9-44cc-9e14-b9d6584bebaf tempest-ProjectReaderTests-1672073403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:38 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-588d441d-43c9-44cc-9e14-b9d6584bebaf tempest-ProjectReaderTests-1672073403 None] Creating offline snapshot 0c66a752-7e53-4e54-b0a9-4531e0e69c04 of volume 2b4e9198-5c48-472d-b091-a74e7cc03980 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:33:38 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[93de16c7-cb11-4f87-9bf5-d30e57b32307]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-588d441d-43c9-44cc-9e14-b9d6584bebaf tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2b4e9198-5c48-472d-b091-a74e7cc03980 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:38 devstack sudo[106297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2b4e9198-5c48-472d-b091-a74e7cc03980 Sep 23 00:33:38 devstack sudo[106297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:38 devstack sudo[106295]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-54916a52-4dfb-4fdd-839d-d5ce6bf2a096 tempest-ProjectMemberTests-2104250010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-04e697c9-6fab-4b21-b94f-55299c2cf6ba" returned: 0 in 0.421s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-54916a52-4dfb-4fdd-839d-d5ce6bf2a096 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-04e697c9-6fab-4b21-b94f-55299c2cf6ba {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:38 devstack sudo[106302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-04e697c9-6fab-4b21-b94f-55299c2cf6ba Sep 23 00:33:38 devstack sudo[106302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:38 devstack sudo[106297]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-588d441d-43c9-44cc-9e14-b9d6584bebaf tempest-ProjectReaderTests-1672073403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2b4e9198-5c48-472d-b091-a74e7cc03980" returned: 0 in 0.396s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:38 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-588d441d-43c9-44cc-9e14-b9d6584bebaf tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2b4e9198-5c48-472d-b091-a74e7cc03980,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2b4e9198-5c48-472d-b091-a74e7cc03980.0c66a752-7e53-4e54-b0a9-4531e0e69c04 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:38 devstack sudo[106307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2b4e9198-5c48-472d-b091-a74e7cc03980,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2b4e9198-5c48-472d-b091-a74e7cc03980.0c66a752-7e53-4e54-b0a9-4531e0e69c04 1G Sep 23 00:33:38 devstack sudo[106307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:39 devstack sudo[106302]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-54916a52-4dfb-4fdd-839d-d5ce6bf2a096 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-04e697c9-6fab-4b21-b94f-55299c2cf6ba" returned: 0 in 0.296s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:39 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-54916a52-4dfb-4fdd-839d-d5ce6bf2a096 tempest-ProjectMemberTests-2104250010 None] Lock "cinder-quobyte-04e697c9-6fab-4b21-b94f-55299c2cf6ba" released by "delete_volume" :: held 0.852s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:39 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-54916a52-4dfb-4fdd-839d-d5ce6bf2a096 tempest-ProjectMemberTests-2104250010 None] Created reservations ['15738be1-371b-4e40-a3dc-249a4c6bf827', 'b60dee13-8f5c-437a-b5a7-16f3d77a7bfd', 'e371464d-60e1-4bff-901e-acfeac48d776', '98fb5db3-755d-4600-8bac-970a90a2e62a'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:33:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-54916a52-4dfb-4fdd-839d-d5ce6bf2a096 tempest-ProjectMemberTests-2104250010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-54916a52-4dfb-4fdd-839d-d5ce6bf2a096 tempest-ProjectMemberTests-2104250010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:39 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-54916a52-4dfb-4fdd-839d-d5ce6bf2a096 tempest-ProjectMemberTests-2104250010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:39 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-54916a52-4dfb-4fdd-839d-d5ce6bf2a096 tempest-ProjectMemberTests-2104250010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-54916a52-4dfb-4fdd-839d-d5ce6bf2a096 tempest-ProjectMemberTests-2104250010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-54916a52-4dfb-4fdd-839d-d5ce6bf2a096 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:39 devstack sudo[106313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:33:39 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:39 devstack sudo[106307]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-588d441d-43c9-44cc-9e14-b9d6584bebaf tempest-ProjectReaderTests-1672073403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2b4e9198-5c48-472d-b091-a74e7cc03980,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2b4e9198-5c48-472d-b091-a74e7cc03980.0c66a752-7e53-4e54-b0a9-4531e0e69c04 1G" returned: 0 in 0.660s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-588d441d-43c9-44cc-9e14-b9d6584bebaf tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b4e9198-5c48-472d-b091-a74e7cc03980 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2b4e9198-5c48-472d-b091-a74e7cc03980.0c66a752-7e53-4e54-b0a9-4531e0e69c04 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:39 devstack sudo[106315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b4e9198-5c48-472d-b091-a74e7cc03980 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2b4e9198-5c48-472d-b091-a74e7cc03980.0c66a752-7e53-4e54-b0a9-4531e0e69c04 Sep 23 00:33:39 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:39 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:39 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-54916a52-4dfb-4fdd-839d-d5ce6bf2a096 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.450s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:39 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-54916a52-4dfb-4fdd-839d-d5ce6bf2a096 tempest-ProjectMemberTests-2104250010 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:33:39 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-54916a52-4dfb-4fdd-839d-d5ce6bf2a096 tempest-ProjectMemberTests-2104250010 None] Deleted volume successfully. Sep 23 00:33:39 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-54916a52-4dfb-4fdd-839d-d5ce6bf2a096 tempest-ProjectMemberTests-2104250010 None] Lock "cinder-04e697c9-6fab-4b21-b94f-55299c2cf6ba-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:40 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-588d441d-43c9-44cc-9e14-b9d6584bebaf tempest-ProjectReaderTests-1672073403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b4e9198-5c48-472d-b091-a74e7cc03980 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2b4e9198-5c48-472d-b091-a74e7cc03980.0c66a752-7e53-4e54-b0a9-4531e0e69c04" returned: 0 in 0.434s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:40 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-588d441d-43c9-44cc-9e14-b9d6584bebaf tempest-ProjectReaderTests-1672073403 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2b4e9198-5c48-472d-b091-a74e7cc03980.0c66a752-7e53-4e54-b0a9-4531e0e69c04 is being set with open permissions: ugo+rw Sep 23 00:33:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-588d441d-43c9-44cc-9e14-b9d6584bebaf tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2b4e9198-5c48-472d-b091-a74e7cc03980.0c66a752-7e53-4e54-b0a9-4531e0e69c04 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:40 devstack sudo[106321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2b4e9198-5c48-472d-b091-a74e7cc03980.0c66a752-7e53-4e54-b0a9-4531e0e69c04 Sep 23 00:33:40 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:40 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=170,cinder:INSERT=58,cinder:UPDATE=231,cinder:DELETE=20 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:33:40 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a6e49e0-227e-4adb-94f4-25365318945b tempest-ProjectMemberTests-2104250010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:33:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7a6e49e0-227e-4adb-94f4-25365318945b tempest-ProjectMemberTests-2104250010 None] Flow 'volume_create_manager' (b4dddaf5-4083-4d7d-be0b-cf5ed292693e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7a6e49e0-227e-4adb-94f4-25365318945b tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aa0244e-f059-4f9f-a9cc-2e4d3100a06b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7a6e49e0-227e-4adb-94f4-25365318945b tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aa0244e-f059-4f9f-a9cc-2e4d3100a06b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-717137168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='105e2fcb253445d18a9a36e4adbf6662',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:40Z,use_quota=True,user_id='6f62c0bf87c2488e987066aaecad1a03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7a6e49e0-227e-4adb-94f4-25365318945b tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79249711-3186-4e07-825a-8577817d43f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7a6e49e0-227e-4adb-94f4-25365318945b tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79249711-3186-4e07-825a-8577817d43f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7a6e49e0-227e-4adb-94f4-25365318945b tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e17809f7-cfcb-4880-a42c-6abeed26c861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7a6e49e0-227e-4adb-94f4-25365318945b tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e17809f7-cfcb-4880-a42c-6abeed26c861) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0', 'volume_name': 'volume-3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7a6e49e0-227e-4adb-94f4-25365318945b tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b95e50a-e68d-4a96-912e-81cf89c82ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7a6e49e0-227e-4adb-94f4-25365318945b tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b95e50a-e68d-4a96-912e-81cf89c82ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:40 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7a6e49e0-227e-4adb-94f4-25365318945b tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09136780-4098-4c9a-9ef7-0a448e9c9c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:40 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-7a6e49e0-227e-4adb-94f4-25365318945b tempest-ProjectMemberTests-2104250010 None] Volume 3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0', 'volume_size': 1} Sep 23 00:33:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7a6e49e0-227e-4adb-94f4-25365318945b tempest-ProjectMemberTests-2104250010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:40 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-588d441d-43c9-44cc-9e14-b9d6584bebaf tempest-ProjectReaderTests-1672073403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2b4e9198-5c48-472d-b091-a74e7cc03980.0c66a752-7e53-4e54-b0a9-4531e0e69c04" returned: 0 in 0.265s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-588d441d-43c9-44cc-9e14-b9d6584bebaf tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2b4e9198-5c48-472d-b091-a74e7cc03980.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:40 devstack sudo[106324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2b4e9198-5c48-472d-b091-a74e7cc03980.info Sep 23 00:33:40 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:40 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-588d441d-43c9-44cc-9e14-b9d6584bebaf tempest-ProjectReaderTests-1672073403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2b4e9198-5c48-472d-b091-a74e7cc03980.info" returned: 0 in 0.358s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:40 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-588d441d-43c9-44cc-9e14-b9d6584bebaf tempest-ProjectReaderTests-1672073403 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2b4e9198-5c48-472d-b091-a74e7cc03980.info is being set with open permissions: ugo+rw Sep 23 00:33:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-588d441d-43c9-44cc-9e14-b9d6584bebaf tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2b4e9198-5c48-472d-b091-a74e7cc03980.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:40 devstack sudo[106328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2b4e9198-5c48-472d-b091-a74e7cc03980.info Sep 23 00:33:40 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:40 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:40 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-588d441d-43c9-44cc-9e14-b9d6584bebaf tempest-ProjectReaderTests-1672073403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2b4e9198-5c48-472d-b091-a74e7cc03980.info" returned: 0 in 0.290s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-588d441d-43c9-44cc-9e14-b9d6584bebaf tempest-ProjectReaderTests-1672073403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.516s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7a6e49e0-227e-4adb-94f4-25365318945b tempest-ProjectMemberTests-2104250010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.839s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7a6e49e0-227e-4adb-94f4-25365318945b tempest-ProjectMemberTests-2104250010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-717137168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='105e2fcb253445d18a9a36e4adbf6662',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:40Z,use_quota=True,user_id='6f62c0bf87c2488e987066aaecad1a03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:33:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-7a6e49e0-227e-4adb-94f4-25365318945b tempest-ProjectMemberTests-2104250010 None] Creating volume 3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:33:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7a6e49e0-227e-4adb-94f4-25365318945b tempest-ProjectMemberTests-2104250010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7a6e49e0-227e-4adb-94f4-25365318945b tempest-ProjectMemberTests-2104250010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7a6e49e0-227e-4adb-94f4-25365318945b tempest-ProjectMemberTests-2104250010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7a6e49e0-227e-4adb-94f4-25365318945b tempest-ProjectMemberTests-2104250010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7a6e49e0-227e-4adb-94f4-25365318945b tempest-ProjectMemberTests-2104250010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7a6e49e0-227e-4adb-94f4-25365318945b tempest-ProjectMemberTests-2104250010 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:33:41 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-7a6e49e0-227e-4adb-94f4-25365318945b tempest-ProjectMemberTests-2104250010 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:33:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7a6e49e0-227e-4adb-94f4-25365318945b tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:41 devstack sudo[106331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0 1073741824 Sep 23 00:33:41 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:41 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:UPDATE=229,cinder:SELECT=175,cinder:DELETE=17,cinder:INSERT=62 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:33:41 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-588d441d-43c9-44cc-9e14-b9d6584bebaf tempest-ProjectReaderTests-1672073403 None] Create snapshot completed successfully Sep 23 00:33:41 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7a6e49e0-227e-4adb-94f4-25365318945b tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0 1073741824" returned: 0 in 0.479s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7a6e49e0-227e-4adb-94f4-25365318945b tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:41 devstack sudo[106337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0 Sep 23 00:33:41 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:41 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9d44e2dd-f886-4bda-9162-12d11151c2cd tempest-ProjectReaderTests-1672073403 None] Acquiring lock "cinder-0c66a752-7e53-4e54-b0a9-4531e0e69c04-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:41 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9d44e2dd-f886-4bda-9162-12d11151c2cd tempest-ProjectReaderTests-1672073403 None] Lock "cinder-0c66a752-7e53-4e54-b0a9-4531e0e69c04-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:41 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9d44e2dd-f886-4bda-9162-12d11151c2cd tempest-ProjectReaderTests-1672073403 None] Acquiring lock "cinder-quobyte-2b4e9198-5c48-472d-b091-a74e7cc03980" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:41 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9d44e2dd-f886-4bda-9162-12d11151c2cd tempest-ProjectReaderTests-1672073403 None] Lock "cinder-quobyte-2b4e9198-5c48-472d-b091-a74e7cc03980" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:41 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9d44e2dd-f886-4bda-9162-12d11151c2cd tempest-ProjectReaderTests-1672073403 None] Acquiring lock "cinder-quobyte-0c66a752-7e53-4e54-b0a9-4531e0e69c04" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:41 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9d44e2dd-f886-4bda-9162-12d11151c2cd tempest-ProjectReaderTests-1672073403 None] Lock "cinder-quobyte-0c66a752-7e53-4e54-b0a9-4531e0e69c04" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-9d44e2dd-f886-4bda-9162-12d11151c2cd tempest-ProjectReaderTests-1672073403 None] Deleting offline snapshot 0c66a752-7e53-4e54-b0a9-4531e0e69c04 of volume 2b4e9198-5c48-472d-b091-a74e7cc03980 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:33:41 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-9d44e2dd-f886-4bda-9162-12d11151c2cd tempest-ProjectReaderTests-1672073403 None] snapshot_file for this snap is: volume-2b4e9198-5c48-472d-b091-a74e7cc03980.0c66a752-7e53-4e54-b0a9-4531e0e69c04 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:33:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7a6e49e0-227e-4adb-94f4-25365318945b tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0" returned: 0 in 0.384s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:41 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7a6e49e0-227e-4adb-94f4-25365318945b tempest-ProjectMemberTests-2104250010 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:33:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7a6e49e0-227e-4adb-94f4-25365318945b tempest-ProjectMemberTests-2104250010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7a6e49e0-227e-4adb-94f4-25365318945b tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09136780-4098-4c9a-9ef7-0a448e9c9c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:41 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7a6e49e0-227e-4adb-94f4-25365318945b tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f161945-9a26-45d7-9858-3c7edff75be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:41 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a53fee-6b5f-4872-9523-92385f92fd41]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:41 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9d44e2dd-f886-4bda-9162-12d11151c2cd tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2b4e9198-5c48-472d-b091-a74e7cc03980.0c66a752-7e53-4e54-b0a9-4531e0e69c04 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:41 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-7a6e49e0-227e-4adb-94f4-25365318945b tempest-ProjectMemberTests-2104250010 None] Volume volume-3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0 (3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0): created successfully Sep 23 00:33:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7a6e49e0-227e-4adb-94f4-25365318945b tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f161945-9a26-45d7-9858-3c7edff75be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:42 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7a6e49e0-227e-4adb-94f4-25365318945b tempest-ProjectMemberTests-2104250010 None] Flow 'volume_create_manager' (b4dddaf5-4083-4d7d-be0b-cf5ed292693e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:42 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-7a6e49e0-227e-4adb-94f4-25365318945b tempest-ProjectMemberTests-2104250010 None] Created volume successfully. Sep 23 00:33:42 devstack sudo[106340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2b4e9198-5c48-472d-b091-a74e7cc03980.0c66a752-7e53-4e54-b0a9-4531e0e69c04 Sep 23 00:33:42 devstack sudo[106340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-15985911-ce7b-4b3a-ab14-cdbd146cf67f tempest-ProjectMemberTests-2104250010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-15985911-ce7b-4b3a-ab14-cdbd146cf67f tempest-ProjectMemberTests-2104250010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-15985911-ce7b-4b3a-ab14-cdbd146cf67f tempest-ProjectMemberTests-2104250010 None] Creating offline snapshot 05816fcd-bd62-4bba-b9d2-612e7407ce2c of volume 3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:33:42 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[3255a4bd-5c83-4144-b4cd-52866e0425e4]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-15985911-ce7b-4b3a-ab14-cdbd146cf67f tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:42 devstack sudo[106340]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9d44e2dd-f886-4bda-9162-12d11151c2cd tempest-ProjectReaderTests-1672073403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2b4e9198-5c48-472d-b091-a74e7cc03980.0c66a752-7e53-4e54-b0a9-4531e0e69c04" returned: 0 in 0.465s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:42 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-9d44e2dd-f886-4bda-9162-12d11151c2cd tempest-ProjectReaderTests-1672073403 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b4e9198-5c48-472d-b091-a74e7cc03980(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:33:42 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec6d130-f99d-4595-82b9-4b3f2f426cff]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9d44e2dd-f886-4bda-9162-12d11151c2cd tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2b4e9198-5c48-472d-b091-a74e7cc03980 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:42 devstack sudo[106345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0 Sep 23 00:33:42 devstack sudo[106345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:42 devstack sudo[106346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2b4e9198-5c48-472d-b091-a74e7cc03980 Sep 23 00:33:42 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:42 devstack sudo[106345]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-15985911-ce7b-4b3a-ab14-cdbd146cf67f tempest-ProjectMemberTests-2104250010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0" returned: 0 in 0.497s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:42 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-15985911-ce7b-4b3a-ab14-cdbd146cf67f tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0.05816fcd-bd62-4bba-b9d2-612e7407ce2c 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:42 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0.05816fcd-bd62-4bba-b9d2-612e7407ce2c 1G Sep 23 00:33:42 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:43 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9d44e2dd-f886-4bda-9162-12d11151c2cd tempest-ProjectReaderTests-1672073403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2b4e9198-5c48-472d-b091-a74e7cc03980" returned: 0 in 0.524s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9d44e2dd-f886-4bda-9162-12d11151c2cd tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2b4e9198-5c48-472d-b091-a74e7cc03980.0c66a752-7e53-4e54-b0a9-4531e0e69c04 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:43 devstack sudo[106358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2b4e9198-5c48-472d-b091-a74e7cc03980.0c66a752-7e53-4e54-b0a9-4531e0e69c04 Sep 23 00:33:43 devstack sudo[106358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:43 devstack sudo[106358]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9d44e2dd-f886-4bda-9162-12d11151c2cd tempest-ProjectReaderTests-1672073403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2b4e9198-5c48-472d-b091-a74e7cc03980.0c66a752-7e53-4e54-b0a9-4531e0e69c04" returned: 0 in 0.364s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9d44e2dd-f886-4bda-9162-12d11151c2cd tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2b4e9198-5c48-472d-b091-a74e7cc03980.0c66a752-7e53-4e54-b0a9-4531e0e69c04 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:43 devstack sudo[106368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2b4e9198-5c48-472d-b091-a74e7cc03980.0c66a752-7e53-4e54-b0a9-4531e0e69c04 Sep 23 00:33:43 devstack sudo[106368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:43 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-15985911-ce7b-4b3a-ab14-cdbd146cf67f tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0.05816fcd-bd62-4bba-b9d2-612e7407ce2c 1G" returned: 0 in 0.520s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-15985911-ce7b-4b3a-ab14-cdbd146cf67f tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0.05816fcd-bd62-4bba-b9d2-612e7407ce2c {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:43 devstack sudo[106370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0.05816fcd-bd62-4bba-b9d2-612e7407ce2c Sep 23 00:33:43 devstack sudo[106370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:43 devstack sudo[106368]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9d44e2dd-f886-4bda-9162-12d11151c2cd tempest-ProjectReaderTests-1672073403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2b4e9198-5c48-472d-b091-a74e7cc03980.0c66a752-7e53-4e54-b0a9-4531e0e69c04" returned: 0 in 0.285s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:43 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9d44e2dd-f886-4bda-9162-12d11151c2cd tempest-ProjectReaderTests-1672073403 None] Lock "cinder-quobyte-0c66a752-7e53-4e54-b0a9-4531e0e69c04" released by "_delete_snapshot" :: held 1.797s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:43 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9d44e2dd-f886-4bda-9162-12d11151c2cd tempest-ProjectReaderTests-1672073403 None] Lock "cinder-quobyte-2b4e9198-5c48-472d-b091-a74e7cc03980" released by "delete_snapshot" :: held 1.825s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:43 devstack sudo[106370]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-15985911-ce7b-4b3a-ab14-cdbd146cf67f tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0.05816fcd-bd62-4bba-b9d2-612e7407ce2c" returned: 0 in 0.344s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:43 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-15985911-ce7b-4b3a-ab14-cdbd146cf67f tempest-ProjectMemberTests-2104250010 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0.05816fcd-bd62-4bba-b9d2-612e7407ce2c is being set with open permissions: ugo+rw Sep 23 00:33:43 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-15985911-ce7b-4b3a-ab14-cdbd146cf67f tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0.05816fcd-bd62-4bba-b9d2-612e7407ce2c {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:43 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-9d44e2dd-f886-4bda-9162-12d11151c2cd tempest-ProjectReaderTests-1672073403 None] Created reservations ['c7d425da-35b6-4e11-b255-90612087539c', '21478932-4960-4383-b590-3277410bdd0a', '62c9f343-26d7-4e0e-9879-ed09e2fb6227', '5f94f176-3be6-4f86-a25b-e9471e75ba93'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:33:43 devstack sudo[106376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0.05816fcd-bd62-4bba-b9d2-612e7407ce2c Sep 23 00:33:43 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:43 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-9d44e2dd-f886-4bda-9162-12d11151c2cd tempest-ProjectReaderTests-1672073403 None] Delete snapshot completed successfully. Sep 23 00:33:43 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9d44e2dd-f886-4bda-9162-12d11151c2cd tempest-ProjectReaderTests-1672073403 None] Lock "cinder-0c66a752-7e53-4e54-b0a9-4531e0e69c04-delete_snapshot" released by "delete_snapshot" :: held 2.083s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:44 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b22d554d-44de-4341-b482-662e9fc577dd tempest-ProjectReaderTests-1672073403 None] Acquiring lock "cinder-2b4e9198-5c48-472d-b091-a74e7cc03980-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:44 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b22d554d-44de-4341-b482-662e9fc577dd tempest-ProjectReaderTests-1672073403 None] Lock "cinder-2b4e9198-5c48-472d-b091-a74e7cc03980-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:44 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b22d554d-44de-4341-b482-662e9fc577dd tempest-ProjectReaderTests-1672073403 None] Acquiring lock "cinder-quobyte-2b4e9198-5c48-472d-b091-a74e7cc03980" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:44 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-15985911-ce7b-4b3a-ab14-cdbd146cf67f tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0.05816fcd-bd62-4bba-b9d2-612e7407ce2c" returned: 0 in 0.346s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:44 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b22d554d-44de-4341-b482-662e9fc577dd tempest-ProjectReaderTests-1672073403 None] Lock "cinder-quobyte-2b4e9198-5c48-472d-b091-a74e7cc03980" acquired by "delete_volume" :: waited 0.024s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-15985911-ce7b-4b3a-ab14-cdbd146cf67f tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:44 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[8612d97d-14cf-4788-be97-1f9c6c902ecf]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b22d554d-44de-4341-b482-662e9fc577dd tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2b4e9198-5c48-472d-b091-a74e7cc03980 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:44 devstack sudo[106379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0.info Sep 23 00:33:44 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:44 devstack sudo[106380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2b4e9198-5c48-472d-b091-a74e7cc03980 Sep 23 00:33:44 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:44 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-15985911-ce7b-4b3a-ab14-cdbd146cf67f tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0.info" returned: 0 in 0.277s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:44 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-15985911-ce7b-4b3a-ab14-cdbd146cf67f tempest-ProjectMemberTests-2104250010 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0.info is being set with open permissions: ugo+rw Sep 23 00:33:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-15985911-ce7b-4b3a-ab14-cdbd146cf67f tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:44 devstack sudo[106384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0.info Sep 23 00:33:44 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:44 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b22d554d-44de-4341-b482-662e9fc577dd tempest-ProjectReaderTests-1672073403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2b4e9198-5c48-472d-b091-a74e7cc03980" returned: 0 in 0.432s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b22d554d-44de-4341-b482-662e9fc577dd tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2b4e9198-5c48-472d-b091-a74e7cc03980 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:44 devstack sudo[106389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2b4e9198-5c48-472d-b091-a74e7cc03980 Sep 23 00:33:44 devstack sudo[106389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:44 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-15985911-ce7b-4b3a-ab14-cdbd146cf67f tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0.info" returned: 0 in 0.313s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-15985911-ce7b-4b3a-ab14-cdbd146cf67f tempest-ProjectMemberTests-2104250010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.433s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:44 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-15985911-ce7b-4b3a-ab14-cdbd146cf67f tempest-ProjectMemberTests-2104250010 None] Create snapshot completed successfully Sep 23 00:33:44 devstack sudo[106389]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:44 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b22d554d-44de-4341-b482-662e9fc577dd tempest-ProjectReaderTests-1672073403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-2b4e9198-5c48-472d-b091-a74e7cc03980" returned: 0 in 0.323s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:44 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b22d554d-44de-4341-b482-662e9fc577dd tempest-ProjectReaderTests-1672073403 None] Lock "cinder-quobyte-2b4e9198-5c48-472d-b091-a74e7cc03980" released by "delete_volume" :: held 0.844s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:45 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-b22d554d-44de-4341-b482-662e9fc577dd tempest-ProjectReaderTests-1672073403 None] Created reservations ['9a79a664-7295-4e3b-b89c-6ba43ddeb9d9', '225115b8-2aad-44ec-9f4b-314116483273', 'd9cf3d87-31a0-4b34-aba0-4dddbfdfc75f', '42a6be53-9f39-40d8-85cf-bfa0e38df184'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:33:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b22d554d-44de-4341-b482-662e9fc577dd tempest-ProjectReaderTests-1672073403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b22d554d-44de-4341-b482-662e9fc577dd tempest-ProjectReaderTests-1672073403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:45 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b22d554d-44de-4341-b482-662e9fc577dd tempest-ProjectReaderTests-1672073403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:45 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b22d554d-44de-4341-b482-662e9fc577dd tempest-ProjectReaderTests-1672073403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b22d554d-44de-4341-b482-662e9fc577dd tempest-ProjectReaderTests-1672073403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b22d554d-44de-4341-b482-662e9fc577dd tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:45 devstack sudo[106393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:33:45 devstack sudo[106393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:45 devstack sudo[106393]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b22d554d-44de-4341-b482-662e9fc577dd tempest-ProjectReaderTests-1672073403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.290s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:45 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-b22d554d-44de-4341-b482-662e9fc577dd tempest-ProjectReaderTests-1672073403 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:33:45 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-b22d554d-44de-4341-b482-662e9fc577dd tempest-ProjectReaderTests-1672073403 None] Deleted volume successfully. Sep 23 00:33:45 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b22d554d-44de-4341-b482-662e9fc577dd tempest-ProjectReaderTests-1672073403 None] Lock "cinder-2b4e9198-5c48-472d-b091-a74e7cc03980-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:45 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-98b6ce51-a4be-4596-940e-ba123b9024b5 tempest-ProjectMemberTests-2104250010 None] Acquiring lock "cinder-05816fcd-bd62-4bba-b9d2-612e7407ce2c-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:45 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-98b6ce51-a4be-4596-940e-ba123b9024b5 tempest-ProjectMemberTests-2104250010 None] Lock "cinder-05816fcd-bd62-4bba-b9d2-612e7407ce2c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:45 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-98b6ce51-a4be-4596-940e-ba123b9024b5 tempest-ProjectMemberTests-2104250010 None] Acquiring lock "cinder-quobyte-3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:45 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-98b6ce51-a4be-4596-940e-ba123b9024b5 tempest-ProjectMemberTests-2104250010 None] Lock "cinder-quobyte-3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:45 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-98b6ce51-a4be-4596-940e-ba123b9024b5 tempest-ProjectMemberTests-2104250010 None] Acquiring lock "cinder-quobyte-05816fcd-bd62-4bba-b9d2-612e7407ce2c" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:45 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-98b6ce51-a4be-4596-940e-ba123b9024b5 tempest-ProjectMemberTests-2104250010 None] Lock "cinder-quobyte-05816fcd-bd62-4bba-b9d2-612e7407ce2c" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:45 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-98b6ce51-a4be-4596-940e-ba123b9024b5 tempest-ProjectMemberTests-2104250010 None] Deleting offline snapshot 05816fcd-bd62-4bba-b9d2-612e7407ce2c of volume 3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:33:45 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-98b6ce51-a4be-4596-940e-ba123b9024b5 tempest-ProjectMemberTests-2104250010 None] snapshot_file for this snap is: volume-3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0.05816fcd-bd62-4bba-b9d2-612e7407ce2c {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:33:45 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[600c7fa4-1b2b-45d9-a280-a18bd97a04da]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:45 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-98b6ce51-a4be-4596-940e-ba123b9024b5 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0.05816fcd-bd62-4bba-b9d2-612e7407ce2c {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:45 devstack sudo[106396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0.05816fcd-bd62-4bba-b9d2-612e7407ce2c Sep 23 00:33:45 devstack sudo[106396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:45 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d8f70a6-feb7-4d07-bc4f-624f777fbad5 tempest-ProjectReaderTests-1672073403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:33:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0d8f70a6-feb7-4d07-bc4f-624f777fbad5 tempest-ProjectReaderTests-1672073403 None] Flow 'volume_create_manager' (2d837b15-d039-4122-bb64-393970373a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0d8f70a6-feb7-4d07-bc4f-624f777fbad5 tempest-ProjectReaderTests-1672073403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (451240af-03e6-47e3-a815-4e723e145fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:45 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0d8f70a6-feb7-4d07-bc4f-624f777fbad5 tempest-ProjectReaderTests-1672073403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (451240af-03e6-47e3-a815-4e723e145fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-798346534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92f962ad-62e8-42b0-9dcb-09ddf3bd270b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a361786c5d944c5a73653e654c80def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:46Z,use_quota=True,user_id='f01a5c248a78434fb39a1d6e1e81a391',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0d8f70a6-feb7-4d07-bc4f-624f777fbad5 tempest-ProjectReaderTests-1672073403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0149a7e1-ae51-48be-821c-7116f88c654a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0d8f70a6-feb7-4d07-bc4f-624f777fbad5 tempest-ProjectReaderTests-1672073403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0149a7e1-ae51-48be-821c-7116f88c654a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0d8f70a6-feb7-4d07-bc4f-624f777fbad5 tempest-ProjectReaderTests-1672073403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fb8b482-f06c-4737-acaf-ba2c0fe9366c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0d8f70a6-feb7-4d07-bc4f-624f777fbad5 tempest-ProjectReaderTests-1672073403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fb8b482-f06c-4737-acaf-ba2c0fe9366c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92f962ad-62e8-42b0-9dcb-09ddf3bd270b', 'volume_name': 'volume-92f962ad-62e8-42b0-9dcb-09ddf3bd270b', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0d8f70a6-feb7-4d07-bc4f-624f777fbad5 tempest-ProjectReaderTests-1672073403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7261a1d3-cd1e-4b8f-b48e-d12573cfa243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0d8f70a6-feb7-4d07-bc4f-624f777fbad5 tempest-ProjectReaderTests-1672073403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7261a1d3-cd1e-4b8f-b48e-d12573cfa243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:46 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0d8f70a6-feb7-4d07-bc4f-624f777fbad5 tempest-ProjectReaderTests-1672073403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ab81fa5-d83a-466c-a176-e6539557b666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:46 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-0d8f70a6-feb7-4d07-bc4f-624f777fbad5 tempest-ProjectReaderTests-1672073403 None] Volume 92f962ad-62e8-42b0-9dcb-09ddf3bd270b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92f962ad-62e8-42b0-9dcb-09ddf3bd270b', 'volume_size': 1} Sep 23 00:33:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0d8f70a6-feb7-4d07-bc4f-624f777fbad5 tempest-ProjectReaderTests-1672073403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0d8f70a6-feb7-4d07-bc4f-624f777fbad5 tempest-ProjectReaderTests-1672073403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0d8f70a6-feb7-4d07-bc4f-624f777fbad5 tempest-ProjectReaderTests-1672073403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-798346534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92f962ad-62e8-42b0-9dcb-09ddf3bd270b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a361786c5d944c5a73653e654c80def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:46Z,use_quota=True,user_id='f01a5c248a78434fb39a1d6e1e81a391',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:33:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-0d8f70a6-feb7-4d07-bc4f-624f777fbad5 tempest-ProjectReaderTests-1672073403 None] Creating volume 92f962ad-62e8-42b0-9dcb-09ddf3bd270b {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:33:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0d8f70a6-feb7-4d07-bc4f-624f777fbad5 tempest-ProjectReaderTests-1672073403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0d8f70a6-feb7-4d07-bc4f-624f777fbad5 tempest-ProjectReaderTests-1672073403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0d8f70a6-feb7-4d07-bc4f-624f777fbad5 tempest-ProjectReaderTests-1672073403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0d8f70a6-feb7-4d07-bc4f-624f777fbad5 tempest-ProjectReaderTests-1672073403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0d8f70a6-feb7-4d07-bc4f-624f777fbad5 tempest-ProjectReaderTests-1672073403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0d8f70a6-feb7-4d07-bc4f-624f777fbad5 tempest-ProjectReaderTests-1672073403 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:33:46 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-0d8f70a6-feb7-4d07-bc4f-624f777fbad5 tempest-ProjectReaderTests-1672073403 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:33:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0d8f70a6-feb7-4d07-bc4f-624f777fbad5 tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-92f962ad-62e8-42b0-9dcb-09ddf3bd270b 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:46 devstack sudo[106398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-92f962ad-62e8-42b0-9dcb-09ddf3bd270b 1073741824 Sep 23 00:33:46 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:46 devstack sudo[106396]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-98b6ce51-a4be-4596-940e-ba123b9024b5 tempest-ProjectMemberTests-2104250010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0.05816fcd-bd62-4bba-b9d2-612e7407ce2c" returned: 0 in 0.468s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-98b6ce51-a4be-4596-940e-ba123b9024b5 tempest-ProjectMemberTests-2104250010 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:33:46 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87f3dfe-fca4-439a-ae23-1df5c6e0b83d]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-98b6ce51-a4be-4596-940e-ba123b9024b5 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:46 devstack sudo[106404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0 Sep 23 00:33:46 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:46 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0d8f70a6-feb7-4d07-bc4f-624f777fbad5 tempest-ProjectReaderTests-1672073403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-92f962ad-62e8-42b0-9dcb-09ddf3bd270b 1073741824" returned: 0 in 0.553s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0d8f70a6-feb7-4d07-bc4f-624f777fbad5 tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-92f962ad-62e8-42b0-9dcb-09ddf3bd270b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:46 devstack sudo[106412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-92f962ad-62e8-42b0-9dcb-09ddf3bd270b Sep 23 00:33:46 devstack sudo[106412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:46 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-98b6ce51-a4be-4596-940e-ba123b9024b5 tempest-ProjectMemberTests-2104250010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0" returned: 0 in 0.450s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-98b6ce51-a4be-4596-940e-ba123b9024b5 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0.05816fcd-bd62-4bba-b9d2-612e7407ce2c {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:46 devstack sudo[106415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0.05816fcd-bd62-4bba-b9d2-612e7407ce2c Sep 23 00:33:46 devstack sudo[106415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:46 devstack sudo[106412]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-0d8f70a6-feb7-4d07-bc4f-624f777fbad5 tempest-ProjectReaderTests-1672073403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-92f962ad-62e8-42b0-9dcb-09ddf3bd270b" returned: 0 in 0.339s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:46 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-0d8f70a6-feb7-4d07-bc4f-624f777fbad5 tempest-ProjectReaderTests-1672073403 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:33:46 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-0d8f70a6-feb7-4d07-bc4f-624f777fbad5 tempest-ProjectReaderTests-1672073403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0d8f70a6-feb7-4d07-bc4f-624f777fbad5 tempest-ProjectReaderTests-1672073403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ab81fa5-d83a-466c-a176-e6539557b666) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92f962ad-62e8-42b0-9dcb-09ddf3bd270b', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0d8f70a6-feb7-4d07-bc4f-624f777fbad5 tempest-ProjectReaderTests-1672073403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4df141e-2b86-43ad-ab0e-a8772bb6d5e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:47 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-0d8f70a6-feb7-4d07-bc4f-624f777fbad5 tempest-ProjectReaderTests-1672073403 None] Volume volume-92f962ad-62e8-42b0-9dcb-09ddf3bd270b (92f962ad-62e8-42b0-9dcb-09ddf3bd270b): created successfully Sep 23 00:33:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0d8f70a6-feb7-4d07-bc4f-624f777fbad5 tempest-ProjectReaderTests-1672073403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4df141e-2b86-43ad-ab0e-a8772bb6d5e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:47 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-0d8f70a6-feb7-4d07-bc4f-624f777fbad5 tempest-ProjectReaderTests-1672073403 None] Flow 'volume_create_manager' (2d837b15-d039-4122-bb64-393970373a45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:47 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-0d8f70a6-feb7-4d07-bc4f-624f777fbad5 tempest-ProjectReaderTests-1672073403 None] Created volume successfully. Sep 23 00:33:47 devstack sudo[106415]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-98b6ce51-a4be-4596-940e-ba123b9024b5 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0.05816fcd-bd62-4bba-b9d2-612e7407ce2c" returned: 0 in 0.403s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-98b6ce51-a4be-4596-940e-ba123b9024b5 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0.05816fcd-bd62-4bba-b9d2-612e7407ce2c {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:47 devstack sudo[106422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0.05816fcd-bd62-4bba-b9d2-612e7407ce2c Sep 23 00:33:47 devstack sudo[106422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:47 devstack sudo[106422]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-98b6ce51-a4be-4596-940e-ba123b9024b5 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0.05816fcd-bd62-4bba-b9d2-612e7407ce2c" returned: 0 in 0.283s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:47 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-98b6ce51-a4be-4596-940e-ba123b9024b5 tempest-ProjectMemberTests-2104250010 None] Lock "cinder-quobyte-05816fcd-bd62-4bba-b9d2-612e7407ce2c" released by "_delete_snapshot" :: held 1.746s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:47 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-98b6ce51-a4be-4596-940e-ba123b9024b5 tempest-ProjectMemberTests-2104250010 None] Lock "cinder-quobyte-3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0" released by "delete_snapshot" :: held 1.785s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:47 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-98b6ce51-a4be-4596-940e-ba123b9024b5 tempest-ProjectMemberTests-2104250010 None] Created reservations ['c8a8b770-e444-42a0-a017-1ef37cf6f21a', '011ea103-cdac-447f-a248-867c5ab70e56', 'a16b12d7-4bbf-4ca8-9c98-41680b84156f', 'ca8426c2-b6b5-49e2-ba02-51a359061329'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:33:47 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-98b6ce51-a4be-4596-940e-ba123b9024b5 tempest-ProjectMemberTests-2104250010 None] Delete snapshot completed successfully. Sep 23 00:33:47 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-98b6ce51-a4be-4596-940e-ba123b9024b5 tempest-ProjectMemberTests-2104250010 None] Lock "cinder-05816fcd-bd62-4bba-b9d2-612e7407ce2c-delete_snapshot" released by "delete_snapshot" :: held 1.954s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:47 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-899fa6b5-826b-45c1-a951-64df8e8efddb tempest-ProjectMemberTests-2104250010 None] Acquiring lock "cinder-3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:47 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-899fa6b5-826b-45c1-a951-64df8e8efddb tempest-ProjectMemberTests-2104250010 None] Lock "cinder-3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:47 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-899fa6b5-826b-45c1-a951-64df8e8efddb tempest-ProjectMemberTests-2104250010 None] Acquiring lock "cinder-quobyte-3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:47 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-899fa6b5-826b-45c1-a951-64df8e8efddb tempest-ProjectMemberTests-2104250010 None] Lock "cinder-quobyte-3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0" acquired by "delete_volume" :: waited 0.027s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:47 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b852099-edc7-4dc0-bf85-cf191b62bc97]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-899fa6b5-826b-45c1-a951-64df8e8efddb tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:48 devstack sudo[106426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0 Sep 23 00:33:48 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-68b6a20c-ed58-4a3a-99a3-d34accd821a0 tempest-ProjectReaderTests-1672073403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-68b6a20c-ed58-4a3a-99a3-d34accd821a0 tempest-ProjectReaderTests-1672073403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:48 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-68b6a20c-ed58-4a3a-99a3-d34accd821a0 tempest-ProjectReaderTests-1672073403 None] Creating offline snapshot b34c16c0-9eb1-43af-8dc8-27b5afca66e6 of volume 92f962ad-62e8-42b0-9dcb-09ddf3bd270b {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:33:48 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4607ce9-ea84-4462-a384-f7ce415e2305]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-68b6a20c-ed58-4a3a-99a3-d34accd821a0 tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-92f962ad-62e8-42b0-9dcb-09ddf3bd270b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:48 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-899fa6b5-826b-45c1-a951-64df8e8efddb tempest-ProjectMemberTests-2104250010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0" returned: 0 in 0.453s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-899fa6b5-826b-45c1-a951-64df8e8efddb tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:48 devstack sudo[106428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-92f962ad-62e8-42b0-9dcb-09ddf3bd270b Sep 23 00:33:48 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:48 devstack sudo[106432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0 Sep 23 00:33:48 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:48 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-899fa6b5-826b-45c1-a951-64df8e8efddb tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0" returned: 0 in 0.304s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:48 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-899fa6b5-826b-45c1-a951-64df8e8efddb tempest-ProjectMemberTests-2104250010 None] Lock "cinder-quobyte-3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0" released by "delete_volume" :: held 0.865s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:48 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-68b6a20c-ed58-4a3a-99a3-d34accd821a0 tempest-ProjectReaderTests-1672073403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-92f962ad-62e8-42b0-9dcb-09ddf3bd270b" returned: 0 in 0.508s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-68b6a20c-ed58-4a3a-99a3-d34accd821a0 tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-92f962ad-62e8-42b0-9dcb-09ddf3bd270b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-92f962ad-62e8-42b0-9dcb-09ddf3bd270b.b34c16c0-9eb1-43af-8dc8-27b5afca66e6 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:48 devstack sudo[106439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-92f962ad-62e8-42b0-9dcb-09ddf3bd270b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-92f962ad-62e8-42b0-9dcb-09ddf3bd270b.b34c16c0-9eb1-43af-8dc8-27b5afca66e6 1G Sep 23 00:33:48 devstack sudo[106439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:48 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-899fa6b5-826b-45c1-a951-64df8e8efddb tempest-ProjectMemberTests-2104250010 None] Created reservations ['52cc4da6-66d2-4765-bfd9-2fc5288b2f74', '59defe5a-5e50-48ed-bc0e-8ac4e1d7027d', '4a6ff0ad-b987-47fd-8001-e7ff12d3b8a8', '5095e793-0b18-49d8-afd2-860f74f563a1'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:33:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-899fa6b5-826b-45c1-a951-64df8e8efddb tempest-ProjectMemberTests-2104250010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-899fa6b5-826b-45c1-a951-64df8e8efddb tempest-ProjectMemberTests-2104250010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:48 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-899fa6b5-826b-45c1-a951-64df8e8efddb tempest-ProjectMemberTests-2104250010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:48 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-899fa6b5-826b-45c1-a951-64df8e8efddb tempest-ProjectMemberTests-2104250010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-899fa6b5-826b-45c1-a951-64df8e8efddb tempest-ProjectMemberTests-2104250010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:48 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-899fa6b5-826b-45c1-a951-64df8e8efddb tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:48 devstack sudo[106441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:33:48 devstack sudo[106441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:49 devstack sudo[106441]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-899fa6b5-826b-45c1-a951-64df8e8efddb tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.282s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:49 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-899fa6b5-826b-45c1-a951-64df8e8efddb tempest-ProjectMemberTests-2104250010 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:33:49 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-899fa6b5-826b-45c1-a951-64df8e8efddb tempest-ProjectMemberTests-2104250010 None] Deleted volume successfully. Sep 23 00:33:49 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-899fa6b5-826b-45c1-a951-64df8e8efddb tempest-ProjectMemberTests-2104250010 None] Lock "cinder-3a8e23b3-5567-4b5c-8b26-f36aeb14f2e0-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:49 devstack sudo[106439]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-68b6a20c-ed58-4a3a-99a3-d34accd821a0 tempest-ProjectReaderTests-1672073403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-92f962ad-62e8-42b0-9dcb-09ddf3bd270b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-92f962ad-62e8-42b0-9dcb-09ddf3bd270b.b34c16c0-9eb1-43af-8dc8-27b5afca66e6 1G" returned: 0 in 0.483s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-68b6a20c-ed58-4a3a-99a3-d34accd821a0 tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92f962ad-62e8-42b0-9dcb-09ddf3bd270b -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-92f962ad-62e8-42b0-9dcb-09ddf3bd270b.b34c16c0-9eb1-43af-8dc8-27b5afca66e6 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:49 devstack sudo[106447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92f962ad-62e8-42b0-9dcb-09ddf3bd270b -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-92f962ad-62e8-42b0-9dcb-09ddf3bd270b.b34c16c0-9eb1-43af-8dc8-27b5afca66e6 Sep 23 00:33:49 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:49 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5df1bd7-3c27-4201-86ff-8acb9a820e22 tempest-ProjectMemberTests-2104250010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:33:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a5df1bd7-3c27-4201-86ff-8acb9a820e22 tempest-ProjectMemberTests-2104250010 None] Flow 'volume_create_manager' (6ce12771-dfe1-483c-b42c-d190f2e922e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a5df1bd7-3c27-4201-86ff-8acb9a820e22 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a18a13ca-00a1-42ae-ab78-eef22bcf0715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:49 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-68b6a20c-ed58-4a3a-99a3-d34accd821a0 tempest-ProjectReaderTests-1672073403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92f962ad-62e8-42b0-9dcb-09ddf3bd270b -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-92f962ad-62e8-42b0-9dcb-09ddf3bd270b.b34c16c0-9eb1-43af-8dc8-27b5afca66e6" returned: 0 in 0.326s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:49 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-68b6a20c-ed58-4a3a-99a3-d34accd821a0 tempest-ProjectReaderTests-1672073403 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-92f962ad-62e8-42b0-9dcb-09ddf3bd270b.b34c16c0-9eb1-43af-8dc8-27b5afca66e6 is being set with open permissions: ugo+rw Sep 23 00:33:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-68b6a20c-ed58-4a3a-99a3-d34accd821a0 tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-92f962ad-62e8-42b0-9dcb-09ddf3bd270b.b34c16c0-9eb1-43af-8dc8-27b5afca66e6 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:49 devstack sudo[106454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-92f962ad-62e8-42b0-9dcb-09ddf3bd270b.b34c16c0-9eb1-43af-8dc8-27b5afca66e6 Sep 23 00:33:49 devstack sudo[106454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a5df1bd7-3c27-4201-86ff-8acb9a820e22 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a18a13ca-00a1-42ae-ab78-eef22bcf0715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-91440737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99b25ae5-e01d-4596-9b5c-b602c174e565,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='105e2fcb253445d18a9a36e4adbf6662',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:50Z,use_quota=True,user_id='6f62c0bf87c2488e987066aaecad1a03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a5df1bd7-3c27-4201-86ff-8acb9a820e22 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f64a91e-02e5-4ddc-bb00-7fd97aab0393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a5df1bd7-3c27-4201-86ff-8acb9a820e22 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f64a91e-02e5-4ddc-bb00-7fd97aab0393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a5df1bd7-3c27-4201-86ff-8acb9a820e22 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbf37298-538b-4e61-a52f-2b1f193a817e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a5df1bd7-3c27-4201-86ff-8acb9a820e22 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbf37298-538b-4e61-a52f-2b1f193a817e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99b25ae5-e01d-4596-9b5c-b602c174e565', 'volume_name': 'volume-99b25ae5-e01d-4596-9b5c-b602c174e565', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a5df1bd7-3c27-4201-86ff-8acb9a820e22 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb4cd76d-4d4c-4021-9337-c260228e87bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a5df1bd7-3c27-4201-86ff-8acb9a820e22 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb4cd76d-4d4c-4021-9337-c260228e87bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a5df1bd7-3c27-4201-86ff-8acb9a820e22 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98f7a7ae-d9a2-4053-83da-47ba21db0105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:49 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-a5df1bd7-3c27-4201-86ff-8acb9a820e22 tempest-ProjectMemberTests-2104250010 None] Volume 99b25ae5-e01d-4596-9b5c-b602c174e565: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99b25ae5-e01d-4596-9b5c-b602c174e565', 'volume_size': 1} Sep 23 00:33:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a5df1bd7-3c27-4201-86ff-8acb9a820e22 tempest-ProjectMemberTests-2104250010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:49 devstack sudo[106454]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-68b6a20c-ed58-4a3a-99a3-d34accd821a0 tempest-ProjectReaderTests-1672073403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-92f962ad-62e8-42b0-9dcb-09ddf3bd270b.b34c16c0-9eb1-43af-8dc8-27b5afca66e6" returned: 0 in 0.264s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:49 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-68b6a20c-ed58-4a3a-99a3-d34accd821a0 tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-92f962ad-62e8-42b0-9dcb-09ddf3bd270b.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:49 devstack sudo[106457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-92f962ad-62e8-42b0-9dcb-09ddf3bd270b.info Sep 23 00:33:49 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:50 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-68b6a20c-ed58-4a3a-99a3-d34accd821a0 tempest-ProjectReaderTests-1672073403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-92f962ad-62e8-42b0-9dcb-09ddf3bd270b.info" returned: 0 in 0.247s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:50 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-68b6a20c-ed58-4a3a-99a3-d34accd821a0 tempest-ProjectReaderTests-1672073403 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-92f962ad-62e8-42b0-9dcb-09ddf3bd270b.info is being set with open permissions: ugo+rw Sep 23 00:33:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-68b6a20c-ed58-4a3a-99a3-d34accd821a0 tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-92f962ad-62e8-42b0-9dcb-09ddf3bd270b.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:50 devstack sudo[106460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-92f962ad-62e8-42b0-9dcb-09ddf3bd270b.info Sep 23 00:33:50 devstack sudo[106460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:50 devstack sudo[106460]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-68b6a20c-ed58-4a3a-99a3-d34accd821a0 tempest-ProjectReaderTests-1672073403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-92f962ad-62e8-42b0-9dcb-09ddf3bd270b.info" returned: 0 in 0.250s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-68b6a20c-ed58-4a3a-99a3-d34accd821a0 tempest-ProjectReaderTests-1672073403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.177s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a5df1bd7-3c27-4201-86ff-8acb9a820e22 tempest-ProjectMemberTests-2104250010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.740s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:50 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a5df1bd7-3c27-4201-86ff-8acb9a820e22 tempest-ProjectMemberTests-2104250010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-91440737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99b25ae5-e01d-4596-9b5c-b602c174e565,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='105e2fcb253445d18a9a36e4adbf6662',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:50Z,use_quota=True,user_id='6f62c0bf87c2488e987066aaecad1a03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:33:50 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-a5df1bd7-3c27-4201-86ff-8acb9a820e22 tempest-ProjectMemberTests-2104250010 None] Creating volume 99b25ae5-e01d-4596-9b5c-b602c174e565 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:33:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a5df1bd7-3c27-4201-86ff-8acb9a820e22 tempest-ProjectMemberTests-2104250010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a5df1bd7-3c27-4201-86ff-8acb9a820e22 tempest-ProjectMemberTests-2104250010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:50 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a5df1bd7-3c27-4201-86ff-8acb9a820e22 tempest-ProjectMemberTests-2104250010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:50 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a5df1bd7-3c27-4201-86ff-8acb9a820e22 tempest-ProjectMemberTests-2104250010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a5df1bd7-3c27-4201-86ff-8acb9a820e22 tempest-ProjectMemberTests-2104250010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:50 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a5df1bd7-3c27-4201-86ff-8acb9a820e22 tempest-ProjectMemberTests-2104250010 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:33:50 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-a5df1bd7-3c27-4201-86ff-8acb9a820e22 tempest-ProjectMemberTests-2104250010 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:33:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a5df1bd7-3c27-4201-86ff-8acb9a820e22 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-99b25ae5-e01d-4596-9b5c-b602c174e565 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:50 devstack sudo[106463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-99b25ae5-e01d-4596-9b5c-b602c174e565 1073741824 Sep 23 00:33:50 devstack sudo[106463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:50 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-68b6a20c-ed58-4a3a-99a3-d34accd821a0 tempest-ProjectReaderTests-1672073403 None] Create snapshot completed successfully Sep 23 00:33:50 devstack sudo[106463]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a5df1bd7-3c27-4201-86ff-8acb9a820e22 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-99b25ae5-e01d-4596-9b5c-b602c174e565 1073741824" returned: 0 in 0.462s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:50 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a5df1bd7-3c27-4201-86ff-8acb9a820e22 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-99b25ae5-e01d-4596-9b5c-b602c174e565 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:50 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-99b25ae5-e01d-4596-9b5c-b602c174e565 Sep 23 00:33:50 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:51 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a5df1bd7-3c27-4201-86ff-8acb9a820e22 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-99b25ae5-e01d-4596-9b5c-b602c174e565" returned: 0 in 0.248s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:51 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-a5df1bd7-3c27-4201-86ff-8acb9a820e22 tempest-ProjectMemberTests-2104250010 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:33:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-a5df1bd7-3c27-4201-86ff-8acb9a820e22 tempest-ProjectMemberTests-2104250010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a5df1bd7-3c27-4201-86ff-8acb9a820e22 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98f7a7ae-d9a2-4053-83da-47ba21db0105) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99b25ae5-e01d-4596-9b5c-b602c174e565', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a5df1bd7-3c27-4201-86ff-8acb9a820e22 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52afac1b-436b-41d3-b2c7-3553d49021e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:51 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-a5df1bd7-3c27-4201-86ff-8acb9a820e22 tempest-ProjectMemberTests-2104250010 None] Volume volume-99b25ae5-e01d-4596-9b5c-b602c174e565 (99b25ae5-e01d-4596-9b5c-b602c174e565): created successfully Sep 23 00:33:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a5df1bd7-3c27-4201-86ff-8acb9a820e22 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52afac1b-436b-41d3-b2c7-3553d49021e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:51 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-a5df1bd7-3c27-4201-86ff-8acb9a820e22 tempest-ProjectMemberTests-2104250010 None] Flow 'volume_create_manager' (6ce12771-dfe1-483c-b42c-d190f2e922e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:51 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-a5df1bd7-3c27-4201-86ff-8acb9a820e22 tempest-ProjectMemberTests-2104250010 None] Created volume successfully. Sep 23 00:33:51 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-19cf4a50-5f37-489c-a370-92d16d64be09 tempest-ProjectReaderTests-1672073403 None] Acquiring lock "cinder-b34c16c0-9eb1-43af-8dc8-27b5afca66e6-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:51 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-19cf4a50-5f37-489c-a370-92d16d64be09 tempest-ProjectReaderTests-1672073403 None] Lock "cinder-b34c16c0-9eb1-43af-8dc8-27b5afca66e6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:51 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-19cf4a50-5f37-489c-a370-92d16d64be09 tempest-ProjectReaderTests-1672073403 None] Acquiring lock "cinder-quobyte-92f962ad-62e8-42b0-9dcb-09ddf3bd270b" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:51 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-19cf4a50-5f37-489c-a370-92d16d64be09 tempest-ProjectReaderTests-1672073403 None] Lock "cinder-quobyte-92f962ad-62e8-42b0-9dcb-09ddf3bd270b" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:51 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-19cf4a50-5f37-489c-a370-92d16d64be09 tempest-ProjectReaderTests-1672073403 None] Acquiring lock "cinder-quobyte-b34c16c0-9eb1-43af-8dc8-27b5afca66e6" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:51 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-19cf4a50-5f37-489c-a370-92d16d64be09 tempest-ProjectReaderTests-1672073403 None] Lock "cinder-quobyte-b34c16c0-9eb1-43af-8dc8-27b5afca66e6" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:51 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-19cf4a50-5f37-489c-a370-92d16d64be09 tempest-ProjectReaderTests-1672073403 None] Deleting offline snapshot b34c16c0-9eb1-43af-8dc8-27b5afca66e6 of volume 92f962ad-62e8-42b0-9dcb-09ddf3bd270b {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:33:51 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-19cf4a50-5f37-489c-a370-92d16d64be09 tempest-ProjectReaderTests-1672073403 None] snapshot_file for this snap is: volume-92f962ad-62e8-42b0-9dcb-09ddf3bd270b.b34c16c0-9eb1-43af-8dc8-27b5afca66e6 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:33:51 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[f920b6cc-53d2-4730-b4c9-507f6caf2bad]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-19cf4a50-5f37-489c-a370-92d16d64be09 tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-92f962ad-62e8-42b0-9dcb-09ddf3bd270b.b34c16c0-9eb1-43af-8dc8-27b5afca66e6 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:51 devstack sudo[106471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-92f962ad-62e8-42b0-9dcb-09ddf3bd270b.b34c16c0-9eb1-43af-8dc8-27b5afca66e6 Sep 23 00:33:51 devstack sudo[106471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-199ddc3c-3e70-4eed-8a8e-370a3a683f11 tempest-ProjectMemberTests-2104250010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-199ddc3c-3e70-4eed-8a8e-370a3a683f11 tempest-ProjectMemberTests-2104250010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:51 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-199ddc3c-3e70-4eed-8a8e-370a3a683f11 tempest-ProjectMemberTests-2104250010 None] Creating offline snapshot da39ef51-c0cc-4287-b769-b2cf7a22352c of volume 99b25ae5-e01d-4596-9b5c-b602c174e565 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:33:51 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c82eb3c-3581-493b-a816-d17ecc857350]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-199ddc3c-3e70-4eed-8a8e-370a3a683f11 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-99b25ae5-e01d-4596-9b5c-b602c174e565 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:51 devstack sudo[106471]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-19cf4a50-5f37-489c-a370-92d16d64be09 tempest-ProjectReaderTests-1672073403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-92f962ad-62e8-42b0-9dcb-09ddf3bd270b.b34c16c0-9eb1-43af-8dc8-27b5afca66e6" returned: 0 in 0.389s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:51 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-19cf4a50-5f37-489c-a370-92d16d64be09 tempest-ProjectReaderTests-1672073403 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92f962ad-62e8-42b0-9dcb-09ddf3bd270b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:33:51 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[980c11ec-6a9f-459b-8066-080223caf282]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:51 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-19cf4a50-5f37-489c-a370-92d16d64be09 tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-92f962ad-62e8-42b0-9dcb-09ddf3bd270b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:51 devstack sudo[106476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-99b25ae5-e01d-4596-9b5c-b602c174e565 Sep 23 00:33:51 devstack sudo[106476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:52 devstack sudo[106477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-92f962ad-62e8-42b0-9dcb-09ddf3bd270b Sep 23 00:33:52 devstack sudo[106477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:52 devstack sudo[106476]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-199ddc3c-3e70-4eed-8a8e-370a3a683f11 tempest-ProjectMemberTests-2104250010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-99b25ae5-e01d-4596-9b5c-b602c174e565" returned: 0 in 0.399s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-199ddc3c-3e70-4eed-8a8e-370a3a683f11 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-99b25ae5-e01d-4596-9b5c-b602c174e565,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-99b25ae5-e01d-4596-9b5c-b602c174e565.da39ef51-c0cc-4287-b769-b2cf7a22352c 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:52 devstack sudo[106486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-99b25ae5-e01d-4596-9b5c-b602c174e565,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-99b25ae5-e01d-4596-9b5c-b602c174e565.da39ef51-c0cc-4287-b769-b2cf7a22352c 1G Sep 23 00:33:52 devstack sudo[106486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:52 devstack sudo[106477]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-19cf4a50-5f37-489c-a370-92d16d64be09 tempest-ProjectReaderTests-1672073403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-92f962ad-62e8-42b0-9dcb-09ddf3bd270b" returned: 0 in 0.393s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-19cf4a50-5f37-489c-a370-92d16d64be09 tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-92f962ad-62e8-42b0-9dcb-09ddf3bd270b.b34c16c0-9eb1-43af-8dc8-27b5afca66e6 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:52 devstack sudo[106488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-92f962ad-62e8-42b0-9dcb-09ddf3bd270b.b34c16c0-9eb1-43af-8dc8-27b5afca66e6 Sep 23 00:33:52 devstack sudo[106488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:52 devstack sudo[106488]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-19cf4a50-5f37-489c-a370-92d16d64be09 tempest-ProjectReaderTests-1672073403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-92f962ad-62e8-42b0-9dcb-09ddf3bd270b.b34c16c0-9eb1-43af-8dc8-27b5afca66e6" returned: 0 in 0.425s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-19cf4a50-5f37-489c-a370-92d16d64be09 tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-92f962ad-62e8-42b0-9dcb-09ddf3bd270b.b34c16c0-9eb1-43af-8dc8-27b5afca66e6 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:52 devstack sudo[106486]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-199ddc3c-3e70-4eed-8a8e-370a3a683f11 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-99b25ae5-e01d-4596-9b5c-b602c174e565,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-99b25ae5-e01d-4596-9b5c-b602c174e565.da39ef51-c0cc-4287-b769-b2cf7a22352c 1G" returned: 0 in 0.505s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:52 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-199ddc3c-3e70-4eed-8a8e-370a3a683f11 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99b25ae5-e01d-4596-9b5c-b602c174e565 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-99b25ae5-e01d-4596-9b5c-b602c174e565.da39ef51-c0cc-4287-b769-b2cf7a22352c {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:52 devstack sudo[106497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-92f962ad-62e8-42b0-9dcb-09ddf3bd270b.b34c16c0-9eb1-43af-8dc8-27b5afca66e6 Sep 23 00:33:52 devstack sudo[106497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:52 devstack sudo[106498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99b25ae5-e01d-4596-9b5c-b602c174e565 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-99b25ae5-e01d-4596-9b5c-b602c174e565.da39ef51-c0cc-4287-b769-b2cf7a22352c Sep 23 00:33:52 devstack sudo[106498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:53 devstack sudo[106497]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-19cf4a50-5f37-489c-a370-92d16d64be09 tempest-ProjectReaderTests-1672073403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-92f962ad-62e8-42b0-9dcb-09ddf3bd270b.b34c16c0-9eb1-43af-8dc8-27b5afca66e6" returned: 0 in 0.253s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:53 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-19cf4a50-5f37-489c-a370-92d16d64be09 tempest-ProjectReaderTests-1672073403 None] Lock "cinder-quobyte-b34c16c0-9eb1-43af-8dc8-27b5afca66e6" released by "_delete_snapshot" :: held 1.583s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:53 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-19cf4a50-5f37-489c-a370-92d16d64be09 tempest-ProjectReaderTests-1672073403 None] Lock "cinder-quobyte-92f962ad-62e8-42b0-9dcb-09ddf3bd270b" released by "delete_snapshot" :: held 1.606s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:53 devstack sudo[106498]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-199ddc3c-3e70-4eed-8a8e-370a3a683f11 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99b25ae5-e01d-4596-9b5c-b602c174e565 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-99b25ae5-e01d-4596-9b5c-b602c174e565.da39ef51-c0cc-4287-b769-b2cf7a22352c" returned: 0 in 0.352s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:53 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-199ddc3c-3e70-4eed-8a8e-370a3a683f11 tempest-ProjectMemberTests-2104250010 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-99b25ae5-e01d-4596-9b5c-b602c174e565.da39ef51-c0cc-4287-b769-b2cf7a22352c is being set with open permissions: ugo+rw Sep 23 00:33:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-199ddc3c-3e70-4eed-8a8e-370a3a683f11 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-99b25ae5-e01d-4596-9b5c-b602c174e565.da39ef51-c0cc-4287-b769-b2cf7a22352c {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:53 devstack sudo[106505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-99b25ae5-e01d-4596-9b5c-b602c174e565.da39ef51-c0cc-4287-b769-b2cf7a22352c Sep 23 00:33:53 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:53 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-19cf4a50-5f37-489c-a370-92d16d64be09 tempest-ProjectReaderTests-1672073403 None] Created reservations ['987df835-1503-4f68-bbf6-c8f015988266', '3923f126-5f7c-41c9-a8ee-bf42e2ba9d5d', 'b398cec4-5911-4610-972e-5a49dba7689f', '74294b08-7f10-4ad9-8e60-c1f326fc2fdf'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:33:53 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-19cf4a50-5f37-489c-a370-92d16d64be09 tempest-ProjectReaderTests-1672073403 None] Delete snapshot completed successfully. Sep 23 00:33:53 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-19cf4a50-5f37-489c-a370-92d16d64be09 tempest-ProjectReaderTests-1672073403 None] Lock "cinder-b34c16c0-9eb1-43af-8dc8-27b5afca66e6-delete_snapshot" released by "delete_snapshot" :: held 1.895s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:53 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-199ddc3c-3e70-4eed-8a8e-370a3a683f11 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-99b25ae5-e01d-4596-9b5c-b602c174e565.da39ef51-c0cc-4287-b769-b2cf7a22352c" returned: 0 in 0.253s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-199ddc3c-3e70-4eed-8a8e-370a3a683f11 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-99b25ae5-e01d-4596-9b5c-b602c174e565.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:53 devstack sudo[106508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-99b25ae5-e01d-4596-9b5c-b602c174e565.info Sep 23 00:33:53 devstack sudo[106508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:53 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-85f1c5d0-34c9-41d5-a636-4c9ce1646671 tempest-ProjectReaderTests-1672073403 None] Acquiring lock "cinder-92f962ad-62e8-42b0-9dcb-09ddf3bd270b-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:53 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-85f1c5d0-34c9-41d5-a636-4c9ce1646671 tempest-ProjectReaderTests-1672073403 None] Lock "cinder-92f962ad-62e8-42b0-9dcb-09ddf3bd270b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:53 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-85f1c5d0-34c9-41d5-a636-4c9ce1646671 tempest-ProjectReaderTests-1672073403 None] Acquiring lock "cinder-quobyte-92f962ad-62e8-42b0-9dcb-09ddf3bd270b" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:53 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-85f1c5d0-34c9-41d5-a636-4c9ce1646671 tempest-ProjectReaderTests-1672073403 None] Lock "cinder-quobyte-92f962ad-62e8-42b0-9dcb-09ddf3bd270b" acquired by "delete_volume" :: waited 0.014s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:53 devstack sudo[106508]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-199ddc3c-3e70-4eed-8a8e-370a3a683f11 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-99b25ae5-e01d-4596-9b5c-b602c174e565.info" returned: 0 in 0.307s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:53 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-199ddc3c-3e70-4eed-8a8e-370a3a683f11 tempest-ProjectMemberTests-2104250010 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-99b25ae5-e01d-4596-9b5c-b602c174e565.info is being set with open permissions: ugo+rw Sep 23 00:33:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-199ddc3c-3e70-4eed-8a8e-370a3a683f11 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-99b25ae5-e01d-4596-9b5c-b602c174e565.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:53 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5dc337-7c3a-4f68-82e0-46168ae4953c]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-85f1c5d0-34c9-41d5-a636-4c9ce1646671 tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-92f962ad-62e8-42b0-9dcb-09ddf3bd270b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:53 devstack sudo[106511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-99b25ae5-e01d-4596-9b5c-b602c174e565.info Sep 23 00:33:53 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:53 devstack sudo[106512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-92f962ad-62e8-42b0-9dcb-09ddf3bd270b Sep 23 00:33:53 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:53 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-199ddc3c-3e70-4eed-8a8e-370a3a683f11 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-99b25ae5-e01d-4596-9b5c-b602c174e565.info" returned: 0 in 0.249s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:53 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-199ddc3c-3e70-4eed-8a8e-370a3a683f11 tempest-ProjectMemberTests-2104250010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.161s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:54 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-199ddc3c-3e70-4eed-8a8e-370a3a683f11 tempest-ProjectMemberTests-2104250010 None] Create snapshot completed successfully Sep 23 00:33:54 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-85f1c5d0-34c9-41d5-a636-4c9ce1646671 tempest-ProjectReaderTests-1672073403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-92f962ad-62e8-42b0-9dcb-09ddf3bd270b" returned: 0 in 0.390s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-85f1c5d0-34c9-41d5-a636-4c9ce1646671 tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-92f962ad-62e8-42b0-9dcb-09ddf3bd270b {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:54 devstack sudo[106519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-92f962ad-62e8-42b0-9dcb-09ddf3bd270b Sep 23 00:33:54 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:54 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-85f1c5d0-34c9-41d5-a636-4c9ce1646671 tempest-ProjectReaderTests-1672073403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-92f962ad-62e8-42b0-9dcb-09ddf3bd270b" returned: 0 in 0.232s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:54 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-85f1c5d0-34c9-41d5-a636-4c9ce1646671 tempest-ProjectReaderTests-1672073403 None] Lock "cinder-quobyte-92f962ad-62e8-42b0-9dcb-09ddf3bd270b" released by "delete_volume" :: held 0.688s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:54 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-85f1c5d0-34c9-41d5-a636-4c9ce1646671 tempest-ProjectReaderTests-1672073403 None] Created reservations ['0ba95f47-4f9c-47cf-9528-a1edd5b10531', '39a84f65-1e3c-4068-bbb1-c064418bd679', 'd23d6c13-c3a6-439d-9731-77cc96445e3b', 'b1073c5c-88c5-4dfb-8434-9673aa38f5ef'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:33:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-85f1c5d0-34c9-41d5-a636-4c9ce1646671 tempest-ProjectReaderTests-1672073403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-85f1c5d0-34c9-41d5-a636-4c9ce1646671 tempest-ProjectReaderTests-1672073403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-85f1c5d0-34c9-41d5-a636-4c9ce1646671 tempest-ProjectReaderTests-1672073403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:54 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-85f1c5d0-34c9-41d5-a636-4c9ce1646671 tempest-ProjectReaderTests-1672073403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-85f1c5d0-34c9-41d5-a636-4c9ce1646671 tempest-ProjectReaderTests-1672073403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-85f1c5d0-34c9-41d5-a636-4c9ce1646671 tempest-ProjectReaderTests-1672073403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:54 devstack sudo[106522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:33:54 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:54 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:54 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-85f1c5d0-34c9-41d5-a636-4c9ce1646671 tempest-ProjectReaderTests-1672073403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.281s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:54 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-85f1c5d0-34c9-41d5-a636-4c9ce1646671 tempest-ProjectReaderTests-1672073403 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:33:54 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-85f1c5d0-34c9-41d5-a636-4c9ce1646671 tempest-ProjectReaderTests-1672073403 None] Deleted volume successfully. Sep 23 00:33:54 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-85f1c5d0-34c9-41d5-a636-4c9ce1646671 tempest-ProjectReaderTests-1672073403 None] Lock "cinder-92f962ad-62e8-42b0-9dcb-09ddf3bd270b-delete_volume" released by "delete_volume" :: held 1.198s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:55 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-552c0bc4-a0b8-4472-abf5-8c1d52fecc01 tempest-ProjectMemberTests-2104250010 None] Acquiring lock "cinder-da39ef51-c0cc-4287-b769-b2cf7a22352c-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:55 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-552c0bc4-a0b8-4472-abf5-8c1d52fecc01 tempest-ProjectMemberTests-2104250010 None] Lock "cinder-da39ef51-c0cc-4287-b769-b2cf7a22352c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:55 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-552c0bc4-a0b8-4472-abf5-8c1d52fecc01 tempest-ProjectMemberTests-2104250010 None] Acquiring lock "cinder-quobyte-99b25ae5-e01d-4596-9b5c-b602c174e565" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:55 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-552c0bc4-a0b8-4472-abf5-8c1d52fecc01 tempest-ProjectMemberTests-2104250010 None] Lock "cinder-quobyte-99b25ae5-e01d-4596-9b5c-b602c174e565" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:55 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-552c0bc4-a0b8-4472-abf5-8c1d52fecc01 tempest-ProjectMemberTests-2104250010 None] Acquiring lock "cinder-quobyte-da39ef51-c0cc-4287-b769-b2cf7a22352c" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:55 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-552c0bc4-a0b8-4472-abf5-8c1d52fecc01 tempest-ProjectMemberTests-2104250010 None] Lock "cinder-quobyte-da39ef51-c0cc-4287-b769-b2cf7a22352c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:55 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-552c0bc4-a0b8-4472-abf5-8c1d52fecc01 tempest-ProjectMemberTests-2104250010 None] Deleting offline snapshot da39ef51-c0cc-4287-b769-b2cf7a22352c of volume 99b25ae5-e01d-4596-9b5c-b602c174e565 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:33:55 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-552c0bc4-a0b8-4472-abf5-8c1d52fecc01 tempest-ProjectMemberTests-2104250010 None] snapshot_file for this snap is: volume-99b25ae5-e01d-4596-9b5c-b602c174e565.da39ef51-c0cc-4287-b769-b2cf7a22352c {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:33:55 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[208763fb-5fa7-4da0-bbdd-055462174fbb]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-552c0bc4-a0b8-4472-abf5-8c1d52fecc01 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-99b25ae5-e01d-4596-9b5c-b602c174e565.da39ef51-c0cc-4287-b769-b2cf7a22352c {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:55 devstack sudo[106525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-99b25ae5-e01d-4596-9b5c-b602c174e565.da39ef51-c0cc-4287-b769-b2cf7a22352c Sep 23 00:33:55 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:55 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-552c0bc4-a0b8-4472-abf5-8c1d52fecc01 tempest-ProjectMemberTests-2104250010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-99b25ae5-e01d-4596-9b5c-b602c174e565.da39ef51-c0cc-4287-b769-b2cf7a22352c" returned: 0 in 0.450s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:55 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-552c0bc4-a0b8-4472-abf5-8c1d52fecc01 tempest-ProjectMemberTests-2104250010 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99b25ae5-e01d-4596-9b5c-b602c174e565(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:33:55 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[beaec3d9-1c65-432d-98be-d99e8ea69544]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:55 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-552c0bc4-a0b8-4472-abf5-8c1d52fecc01 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-99b25ae5-e01d-4596-9b5c-b602c174e565 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:55 devstack sudo[106531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-99b25ae5-e01d-4596-9b5c-b602c174e565 Sep 23 00:33:55 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:56 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-552c0bc4-a0b8-4472-abf5-8c1d52fecc01 tempest-ProjectMemberTests-2104250010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-99b25ae5-e01d-4596-9b5c-b602c174e565" returned: 0 in 0.430s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-552c0bc4-a0b8-4472-abf5-8c1d52fecc01 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-99b25ae5-e01d-4596-9b5c-b602c174e565.da39ef51-c0cc-4287-b769-b2cf7a22352c {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:56 devstack sudo[106536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-99b25ae5-e01d-4596-9b5c-b602c174e565.da39ef51-c0cc-4287-b769-b2cf7a22352c Sep 23 00:33:56 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:56 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-552c0bc4-a0b8-4472-abf5-8c1d52fecc01 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-99b25ae5-e01d-4596-9b5c-b602c174e565.da39ef51-c0cc-4287-b769-b2cf7a22352c" returned: 0 in 0.411s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-552c0bc4-a0b8-4472-abf5-8c1d52fecc01 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-99b25ae5-e01d-4596-9b5c-b602c174e565.da39ef51-c0cc-4287-b769-b2cf7a22352c {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:56 devstack sudo[106542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-99b25ae5-e01d-4596-9b5c-b602c174e565.da39ef51-c0cc-4287-b769-b2cf7a22352c Sep 23 00:33:56 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:56 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:56 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-552c0bc4-a0b8-4472-abf5-8c1d52fecc01 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-99b25ae5-e01d-4596-9b5c-b602c174e565.da39ef51-c0cc-4287-b769-b2cf7a22352c" returned: 0 in 0.326s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:56 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-552c0bc4-a0b8-4472-abf5-8c1d52fecc01 tempest-ProjectMemberTests-2104250010 None] Lock "cinder-quobyte-da39ef51-c0cc-4287-b769-b2cf7a22352c" released by "_delete_snapshot" :: held 1.753s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:56 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-552c0bc4-a0b8-4472-abf5-8c1d52fecc01 tempest-ProjectMemberTests-2104250010 None] Lock "cinder-quobyte-99b25ae5-e01d-4596-9b5c-b602c174e565" released by "delete_snapshot" :: held 1.785s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:56 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-552c0bc4-a0b8-4472-abf5-8c1d52fecc01 tempest-ProjectMemberTests-2104250010 None] Created reservations ['f59015c9-2c83-4838-b128-f4d85ce03309', '95fc6146-8d50-4ee4-ac10-98fc89a1fb28', '686adef3-fc08-463d-b4b1-da035bab4d4b', '899f6b55-bc77-4efd-b5a7-96baa51df39b'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:33:57 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-552c0bc4-a0b8-4472-abf5-8c1d52fecc01 tempest-ProjectMemberTests-2104250010 None] Delete snapshot completed successfully. Sep 23 00:33:57 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-552c0bc4-a0b8-4472-abf5-8c1d52fecc01 tempest-ProjectMemberTests-2104250010 None] Lock "cinder-da39ef51-c0cc-4287-b769-b2cf7a22352c-delete_snapshot" released by "delete_snapshot" :: held 1.968s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:57 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9e5dd0fc-808a-49ab-a735-821e0582df5d tempest-ProjectMemberTests-2104250010 None] Acquiring lock "cinder-99b25ae5-e01d-4596-9b5c-b602c174e565-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:57 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9e5dd0fc-808a-49ab-a735-821e0582df5d tempest-ProjectMemberTests-2104250010 None] Lock "cinder-99b25ae5-e01d-4596-9b5c-b602c174e565-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:57 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9e5dd0fc-808a-49ab-a735-821e0582df5d tempest-ProjectMemberTests-2104250010 None] Acquiring lock "cinder-quobyte-99b25ae5-e01d-4596-9b5c-b602c174e565" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:57 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9e5dd0fc-808a-49ab-a735-821e0582df5d tempest-ProjectMemberTests-2104250010 None] Lock "cinder-quobyte-99b25ae5-e01d-4596-9b5c-b602c174e565" acquired by "delete_volume" :: waited 0.019s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:57 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[546bcff3-7032-4379-a94b-61437b273b59]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9e5dd0fc-808a-49ab-a735-821e0582df5d tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-99b25ae5-e01d-4596-9b5c-b602c174e565 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:57 devstack sudo[106545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-99b25ae5-e01d-4596-9b5c-b602c174e565 Sep 23 00:33:57 devstack sudo[106545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:57 devstack sudo[106545]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9e5dd0fc-808a-49ab-a735-821e0582df5d tempest-ProjectMemberTests-2104250010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-99b25ae5-e01d-4596-9b5c-b602c174e565" returned: 0 in 0.401s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:57 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9e5dd0fc-808a-49ab-a735-821e0582df5d tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-99b25ae5-e01d-4596-9b5c-b602c174e565 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:57 devstack sudo[106551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-99b25ae5-e01d-4596-9b5c-b602c174e565 Sep 23 00:33:57 devstack sudo[106551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:58 devstack sudo[106551]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9e5dd0fc-808a-49ab-a735-821e0582df5d tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-99b25ae5-e01d-4596-9b5c-b602c174e565" returned: 0 in 0.256s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:58 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9e5dd0fc-808a-49ab-a735-821e0582df5d tempest-ProjectMemberTests-2104250010 None] Lock "cinder-quobyte-99b25ae5-e01d-4596-9b5c-b602c174e565" released by "delete_volume" :: held 0.755s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:58 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-9e5dd0fc-808a-49ab-a735-821e0582df5d tempest-ProjectMemberTests-2104250010 None] Created reservations ['22a91ced-5580-400c-9b41-f4eaa7748905', 'b456a132-8d99-41c4-b986-d21dbf9a7c3a', '2691fd18-a557-4883-967d-2f868a83de54', '0fe09bd5-aa1f-4604-b410-6151ec0b435d'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:33:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9e5dd0fc-808a-49ab-a735-821e0582df5d tempest-ProjectMemberTests-2104250010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9e5dd0fc-808a-49ab-a735-821e0582df5d tempest-ProjectMemberTests-2104250010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:58 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9e5dd0fc-808a-49ab-a735-821e0582df5d tempest-ProjectMemberTests-2104250010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:58 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-9e5dd0fc-808a-49ab-a735-821e0582df5d tempest-ProjectMemberTests-2104250010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9e5dd0fc-808a-49ab-a735-821e0582df5d tempest-ProjectMemberTests-2104250010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9e5dd0fc-808a-49ab-a735-821e0582df5d tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:58 devstack sudo[106554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:33:58 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:58 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:58 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-9e5dd0fc-808a-49ab-a735-821e0582df5d tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.259s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:58 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-9e5dd0fc-808a-49ab-a735-821e0582df5d tempest-ProjectMemberTests-2104250010 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:33:58 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-9e5dd0fc-808a-49ab-a735-821e0582df5d tempest-ProjectMemberTests-2104250010 None] Deleted volume successfully. Sep 23 00:33:58 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-9e5dd0fc-808a-49ab-a735-821e0582df5d tempest-ProjectMemberTests-2104250010 None] Lock "cinder-99b25ae5-e01d-4596-9b5c-b602c174e565-delete_volume" released by "delete_volume" :: held 1.234s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:58 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-44862dbc-5c8e-4d68-aa57-4dd04f9b3917 tempest-ProjectMemberTests-2104250010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:33:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-44862dbc-5c8e-4d68-aa57-4dd04f9b3917 tempest-ProjectMemberTests-2104250010 None] Flow 'volume_create_manager' (d39c6355-bc66-4a89-8564-ca3e09058546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-44862dbc-5c8e-4d68-aa57-4dd04f9b3917 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (310c1fd0-f197-4bc3-bb02-c56fda44362d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-44862dbc-5c8e-4d68-aa57-4dd04f9b3917 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (310c1fd0-f197-4bc3-bb02-c56fda44362d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-390324733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=229c48bf-3707-4793-8c0f-1e4127202550,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='105e2fcb253445d18a9a36e4adbf6662',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:59Z,use_quota=True,user_id='6f62c0bf87c2488e987066aaecad1a03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-44862dbc-5c8e-4d68-aa57-4dd04f9b3917 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c48def7-98d6-4d0d-86b6-6c42cff6c4a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:58 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-44862dbc-5c8e-4d68-aa57-4dd04f9b3917 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c48def7-98d6-4d0d-86b6-6c42cff6c4a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-44862dbc-5c8e-4d68-aa57-4dd04f9b3917 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (567e190a-2833-483d-b94a-747d12464d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-44862dbc-5c8e-4d68-aa57-4dd04f9b3917 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (567e190a-2833-483d-b94a-747d12464d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '229c48bf-3707-4793-8c0f-1e4127202550', 'volume_name': 'volume-229c48bf-3707-4793-8c0f-1e4127202550', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-44862dbc-5c8e-4d68-aa57-4dd04f9b3917 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e54d7fa2-92a3-452e-a457-419cf5fa893e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-44862dbc-5c8e-4d68-aa57-4dd04f9b3917 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e54d7fa2-92a3-452e-a457-419cf5fa893e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-44862dbc-5c8e-4d68-aa57-4dd04f9b3917 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7963e755-e012-4e92-a8f6-49d784f86107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:59 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-44862dbc-5c8e-4d68-aa57-4dd04f9b3917 tempest-ProjectMemberTests-2104250010 None] Volume 229c48bf-3707-4793-8c0f-1e4127202550: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-229c48bf-3707-4793-8c0f-1e4127202550', 'volume_size': 1} Sep 23 00:33:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-44862dbc-5c8e-4d68-aa57-4dd04f9b3917 tempest-ProjectMemberTests-2104250010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-44862dbc-5c8e-4d68-aa57-4dd04f9b3917 tempest-ProjectMemberTests-2104250010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-44862dbc-5c8e-4d68-aa57-4dd04f9b3917 tempest-ProjectMemberTests-2104250010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-390324733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=229c48bf-3707-4793-8c0f-1e4127202550,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='105e2fcb253445d18a9a36e4adbf6662',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:59Z,use_quota=True,user_id='6f62c0bf87c2488e987066aaecad1a03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:33:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-44862dbc-5c8e-4d68-aa57-4dd04f9b3917 tempest-ProjectMemberTests-2104250010 None] Creating volume 229c48bf-3707-4793-8c0f-1e4127202550 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:33:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-44862dbc-5c8e-4d68-aa57-4dd04f9b3917 tempest-ProjectMemberTests-2104250010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-44862dbc-5c8e-4d68-aa57-4dd04f9b3917 tempest-ProjectMemberTests-2104250010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-44862dbc-5c8e-4d68-aa57-4dd04f9b3917 tempest-ProjectMemberTests-2104250010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-44862dbc-5c8e-4d68-aa57-4dd04f9b3917 tempest-ProjectMemberTests-2104250010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-44862dbc-5c8e-4d68-aa57-4dd04f9b3917 tempest-ProjectMemberTests-2104250010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-44862dbc-5c8e-4d68-aa57-4dd04f9b3917 tempest-ProjectMemberTests-2104250010 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:33:59 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-44862dbc-5c8e-4d68-aa57-4dd04f9b3917 tempest-ProjectMemberTests-2104250010 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:33:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-44862dbc-5c8e-4d68-aa57-4dd04f9b3917 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-229c48bf-3707-4793-8c0f-1e4127202550 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:59 devstack sudo[106557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-229c48bf-3707-4793-8c0f-1e4127202550 1073741824 Sep 23 00:33:59 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:59 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-44862dbc-5c8e-4d68-aa57-4dd04f9b3917 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-229c48bf-3707-4793-8c0f-1e4127202550 1073741824" returned: 0 in 0.538s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-44862dbc-5c8e-4d68-aa57-4dd04f9b3917 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-229c48bf-3707-4793-8c0f-1e4127202550 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:59 devstack sudo[106563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-229c48bf-3707-4793-8c0f-1e4127202550 Sep 23 00:33:59 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:59 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-44862dbc-5c8e-4d68-aa57-4dd04f9b3917 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-229c48bf-3707-4793-8c0f-1e4127202550" returned: 0 in 0.254s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:59 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-44862dbc-5c8e-4d68-aa57-4dd04f9b3917 tempest-ProjectMemberTests-2104250010 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:33:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-44862dbc-5c8e-4d68-aa57-4dd04f9b3917 tempest-ProjectMemberTests-2104250010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-44862dbc-5c8e-4d68-aa57-4dd04f9b3917 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7963e755-e012-4e92-a8f6-49d784f86107) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-229c48bf-3707-4793-8c0f-1e4127202550', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-44862dbc-5c8e-4d68-aa57-4dd04f9b3917 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00486f10-5c32-45a1-89c5-2237c8cc935a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:59 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-44862dbc-5c8e-4d68-aa57-4dd04f9b3917 tempest-ProjectMemberTests-2104250010 None] Volume volume-229c48bf-3707-4793-8c0f-1e4127202550 (229c48bf-3707-4793-8c0f-1e4127202550): created successfully Sep 23 00:33:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-44862dbc-5c8e-4d68-aa57-4dd04f9b3917 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00486f10-5c32-45a1-89c5-2237c8cc935a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:59 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-44862dbc-5c8e-4d68-aa57-4dd04f9b3917 tempest-ProjectMemberTests-2104250010 None] Flow 'volume_create_manager' (d39c6355-bc66-4a89-8564-ca3e09058546) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:59 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-44862dbc-5c8e-4d68-aa57-4dd04f9b3917 tempest-ProjectMemberTests-2104250010 None] Created volume successfully. Sep 23 00:34:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-37643d7a-13f1-49c8-b86c-de5ea80b1531 tempest-ProjectMemberTests-2104250010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-37643d7a-13f1-49c8-b86c-de5ea80b1531 tempest-ProjectMemberTests-2104250010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:01 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-37643d7a-13f1-49c8-b86c-de5ea80b1531 tempest-ProjectMemberTests-2104250010 None] Creating offline snapshot c132c937-d070-48c0-82fe-aee914c177ae of volume 229c48bf-3707-4793-8c0f-1e4127202550 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:34:01 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bad3dae-581e-4fcd-801f-7aef658401c6]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-37643d7a-13f1-49c8-b86c-de5ea80b1531 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-229c48bf-3707-4793-8c0f-1e4127202550 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:01 devstack sudo[106566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-229c48bf-3707-4793-8c0f-1e4127202550 Sep 23 00:34:01 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:01 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-37643d7a-13f1-49c8-b86c-de5ea80b1531 tempest-ProjectMemberTests-2104250010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-229c48bf-3707-4793-8c0f-1e4127202550" returned: 0 in 0.491s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:01 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-37643d7a-13f1-49c8-b86c-de5ea80b1531 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-229c48bf-3707-4793-8c0f-1e4127202550,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-229c48bf-3707-4793-8c0f-1e4127202550.c132c937-d070-48c0-82fe-aee914c177ae 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:01 devstack sudo[106571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-229c48bf-3707-4793-8c0f-1e4127202550,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-229c48bf-3707-4793-8c0f-1e4127202550.c132c937-d070-48c0-82fe-aee914c177ae 1G Sep 23 00:34:01 devstack sudo[106571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:02 devstack sudo[106571]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-37643d7a-13f1-49c8-b86c-de5ea80b1531 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-229c48bf-3707-4793-8c0f-1e4127202550,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-229c48bf-3707-4793-8c0f-1e4127202550.c132c937-d070-48c0-82fe-aee914c177ae 1G" returned: 0 in 0.508s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-37643d7a-13f1-49c8-b86c-de5ea80b1531 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-229c48bf-3707-4793-8c0f-1e4127202550 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-229c48bf-3707-4793-8c0f-1e4127202550.c132c937-d070-48c0-82fe-aee914c177ae {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:02 devstack sudo[106577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-229c48bf-3707-4793-8c0f-1e4127202550 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-229c48bf-3707-4793-8c0f-1e4127202550.c132c937-d070-48c0-82fe-aee914c177ae Sep 23 00:34:02 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:02 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-37643d7a-13f1-49c8-b86c-de5ea80b1531 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-229c48bf-3707-4793-8c0f-1e4127202550 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-229c48bf-3707-4793-8c0f-1e4127202550.c132c937-d070-48c0-82fe-aee914c177ae" returned: 0 in 0.383s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:02 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-37643d7a-13f1-49c8-b86c-de5ea80b1531 tempest-ProjectMemberTests-2104250010 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-229c48bf-3707-4793-8c0f-1e4127202550.c132c937-d070-48c0-82fe-aee914c177ae is being set with open permissions: ugo+rw Sep 23 00:34:02 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-37643d7a-13f1-49c8-b86c-de5ea80b1531 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-229c48bf-3707-4793-8c0f-1e4127202550.c132c937-d070-48c0-82fe-aee914c177ae {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:02 devstack sudo[106583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-229c48bf-3707-4793-8c0f-1e4127202550.c132c937-d070-48c0-82fe-aee914c177ae Sep 23 00:34:02 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:03 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-37643d7a-13f1-49c8-b86c-de5ea80b1531 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-229c48bf-3707-4793-8c0f-1e4127202550.c132c937-d070-48c0-82fe-aee914c177ae" returned: 0 in 0.309s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-37643d7a-13f1-49c8-b86c-de5ea80b1531 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-229c48bf-3707-4793-8c0f-1e4127202550.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:03 devstack sudo[106586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-229c48bf-3707-4793-8c0f-1e4127202550.info Sep 23 00:34:03 devstack sudo[106586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:03 devstack sudo[106586]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-37643d7a-13f1-49c8-b86c-de5ea80b1531 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-229c48bf-3707-4793-8c0f-1e4127202550.info" returned: 0 in 0.306s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:03 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-37643d7a-13f1-49c8-b86c-de5ea80b1531 tempest-ProjectMemberTests-2104250010 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-229c48bf-3707-4793-8c0f-1e4127202550.info is being set with open permissions: ugo+rw Sep 23 00:34:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-37643d7a-13f1-49c8-b86c-de5ea80b1531 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-229c48bf-3707-4793-8c0f-1e4127202550.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:03 devstack sudo[106589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-229c48bf-3707-4793-8c0f-1e4127202550.info Sep 23 00:34:03 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:03 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-37643d7a-13f1-49c8-b86c-de5ea80b1531 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-229c48bf-3707-4793-8c0f-1e4127202550.info" returned: 0 in 0.279s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:03 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-37643d7a-13f1-49c8-b86c-de5ea80b1531 tempest-ProjectMemberTests-2104250010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.403s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:03 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-37643d7a-13f1-49c8-b86c-de5ea80b1531 tempest-ProjectMemberTests-2104250010 None] Create snapshot completed successfully Sep 23 00:34:04 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-17af983a-08a2-4a3b-b123-04d734f0a409 tempest-ProjectMemberTests-2104250010 None] Acquiring lock "cinder-c132c937-d070-48c0-82fe-aee914c177ae-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:04 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-17af983a-08a2-4a3b-b123-04d734f0a409 tempest-ProjectMemberTests-2104250010 None] Lock "cinder-c132c937-d070-48c0-82fe-aee914c177ae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:04 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-17af983a-08a2-4a3b-b123-04d734f0a409 tempest-ProjectMemberTests-2104250010 None] Acquiring lock "cinder-quobyte-229c48bf-3707-4793-8c0f-1e4127202550" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:04 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-17af983a-08a2-4a3b-b123-04d734f0a409 tempest-ProjectMemberTests-2104250010 None] Lock "cinder-quobyte-229c48bf-3707-4793-8c0f-1e4127202550" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:04 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-17af983a-08a2-4a3b-b123-04d734f0a409 tempest-ProjectMemberTests-2104250010 None] Acquiring lock "cinder-quobyte-c132c937-d070-48c0-82fe-aee914c177ae" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:04 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-17af983a-08a2-4a3b-b123-04d734f0a409 tempest-ProjectMemberTests-2104250010 None] Lock "cinder-quobyte-c132c937-d070-48c0-82fe-aee914c177ae" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:04 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-17af983a-08a2-4a3b-b123-04d734f0a409 tempest-ProjectMemberTests-2104250010 None] Deleting offline snapshot c132c937-d070-48c0-82fe-aee914c177ae of volume 229c48bf-3707-4793-8c0f-1e4127202550 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:34:04 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-17af983a-08a2-4a3b-b123-04d734f0a409 tempest-ProjectMemberTests-2104250010 None] snapshot_file for this snap is: volume-229c48bf-3707-4793-8c0f-1e4127202550.c132c937-d070-48c0-82fe-aee914c177ae {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:34:04 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd5037e3-78e8-412b-99c1-af772bebbfc4]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:04 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-17af983a-08a2-4a3b-b123-04d734f0a409 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-229c48bf-3707-4793-8c0f-1e4127202550.c132c937-d070-48c0-82fe-aee914c177ae {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:04 devstack sudo[106592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-229c48bf-3707-4793-8c0f-1e4127202550.c132c937-d070-48c0-82fe-aee914c177ae Sep 23 00:34:04 devstack sudo[106592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:05 devstack sudo[106592]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-17af983a-08a2-4a3b-b123-04d734f0a409 tempest-ProjectMemberTests-2104250010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-229c48bf-3707-4793-8c0f-1e4127202550.c132c937-d070-48c0-82fe-aee914c177ae" returned: 0 in 0.491s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:05 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-17af983a-08a2-4a3b-b123-04d734f0a409 tempest-ProjectMemberTests-2104250010 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-229c48bf-3707-4793-8c0f-1e4127202550(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:34:05 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfcb97b5-81ac-4ca8-a2bd-f97a13e23c9b]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-17af983a-08a2-4a3b-b123-04d734f0a409 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-229c48bf-3707-4793-8c0f-1e4127202550 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:05 devstack sudo[106597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-229c48bf-3707-4793-8c0f-1e4127202550 Sep 23 00:34:05 devstack sudo[106597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:05 devstack sudo[106597]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-17af983a-08a2-4a3b-b123-04d734f0a409 tempest-ProjectMemberTests-2104250010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-229c48bf-3707-4793-8c0f-1e4127202550" returned: 0 in 0.519s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-17af983a-08a2-4a3b-b123-04d734f0a409 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-229c48bf-3707-4793-8c0f-1e4127202550.c132c937-d070-48c0-82fe-aee914c177ae {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:05 devstack sudo[106602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-229c48bf-3707-4793-8c0f-1e4127202550.c132c937-d070-48c0-82fe-aee914c177ae Sep 23 00:34:05 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:06 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-17af983a-08a2-4a3b-b123-04d734f0a409 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-229c48bf-3707-4793-8c0f-1e4127202550.c132c937-d070-48c0-82fe-aee914c177ae" returned: 0 in 0.482s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-17af983a-08a2-4a3b-b123-04d734f0a409 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-229c48bf-3707-4793-8c0f-1e4127202550.c132c937-d070-48c0-82fe-aee914c177ae {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:06 devstack sudo[106607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-229c48bf-3707-4793-8c0f-1e4127202550.c132c937-d070-48c0-82fe-aee914c177ae Sep 23 00:34:06 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:06 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-17af983a-08a2-4a3b-b123-04d734f0a409 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-229c48bf-3707-4793-8c0f-1e4127202550.c132c937-d070-48c0-82fe-aee914c177ae" returned: 0 in 0.288s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:06 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-17af983a-08a2-4a3b-b123-04d734f0a409 tempest-ProjectMemberTests-2104250010 None] Lock "cinder-quobyte-c132c937-d070-48c0-82fe-aee914c177ae" released by "_delete_snapshot" :: held 1.924s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:06 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-17af983a-08a2-4a3b-b123-04d734f0a409 tempest-ProjectMemberTests-2104250010 None] Lock "cinder-quobyte-229c48bf-3707-4793-8c0f-1e4127202550" released by "delete_snapshot" :: held 1.953s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:06 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-17af983a-08a2-4a3b-b123-04d734f0a409 tempest-ProjectMemberTests-2104250010 None] Created reservations ['19d5a8d3-cc3c-446c-b1e0-5a9bf949ce3a', 'ab0a0845-4b78-47cf-b6f5-8d4d0a30db7e', '08d4a680-07a9-417f-bb7c-f780c7f14835', '11ef3489-5ca5-4f25-8bf6-a203ef21d707'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:34:06 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-17af983a-08a2-4a3b-b123-04d734f0a409 tempest-ProjectMemberTests-2104250010 None] Delete snapshot completed successfully. Sep 23 00:34:06 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-17af983a-08a2-4a3b-b123-04d734f0a409 tempest-ProjectMemberTests-2104250010 None] Lock "cinder-c132c937-d070-48c0-82fe-aee914c177ae-delete_snapshot" released by "delete_snapshot" :: held 2.153s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:07 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b92c31e8-2e10-4400-b815-3f655bb14333 tempest-ProjectMemberTests-2104250010 None] Acquiring lock "cinder-229c48bf-3707-4793-8c0f-1e4127202550-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:07 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b92c31e8-2e10-4400-b815-3f655bb14333 tempest-ProjectMemberTests-2104250010 None] Lock "cinder-229c48bf-3707-4793-8c0f-1e4127202550-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:07 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b92c31e8-2e10-4400-b815-3f655bb14333 tempest-ProjectMemberTests-2104250010 None] Acquiring lock "cinder-quobyte-229c48bf-3707-4793-8c0f-1e4127202550" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:07 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b92c31e8-2e10-4400-b815-3f655bb14333 tempest-ProjectMemberTests-2104250010 None] Lock "cinder-quobyte-229c48bf-3707-4793-8c0f-1e4127202550" acquired by "delete_volume" :: waited 0.020s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:07 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[953d806f-9055-443a-9562-b6bf27e5987d]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b92c31e8-2e10-4400-b815-3f655bb14333 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-229c48bf-3707-4793-8c0f-1e4127202550 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:08 devstack sudo[106612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-229c48bf-3707-4793-8c0f-1e4127202550 Sep 23 00:34:08 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:08 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b92c31e8-2e10-4400-b815-3f655bb14333 tempest-ProjectMemberTests-2104250010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-229c48bf-3707-4793-8c0f-1e4127202550" returned: 0 in 0.478s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b92c31e8-2e10-4400-b815-3f655bb14333 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-229c48bf-3707-4793-8c0f-1e4127202550 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:08 devstack sudo[106617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-229c48bf-3707-4793-8c0f-1e4127202550 Sep 23 00:34:08 devstack sudo[106617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:08 devstack sudo[106617]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b92c31e8-2e10-4400-b815-3f655bb14333 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-229c48bf-3707-4793-8c0f-1e4127202550" returned: 0 in 0.329s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:08 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b92c31e8-2e10-4400-b815-3f655bb14333 tempest-ProjectMemberTests-2104250010 None] Lock "cinder-quobyte-229c48bf-3707-4793-8c0f-1e4127202550" released by "delete_volume" :: held 0.896s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:08 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-b92c31e8-2e10-4400-b815-3f655bb14333 tempest-ProjectMemberTests-2104250010 None] Created reservations ['56615a81-caae-4e91-a2c5-01af1398d164', '94272c0a-af34-458b-87a9-67344222bef3', 'f74a19df-c33a-4e9a-a277-60c66d5f43a2', '5691e92e-b1e2-4312-a540-069af568e40d'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:34:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b92c31e8-2e10-4400-b815-3f655bb14333 tempest-ProjectMemberTests-2104250010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b92c31e8-2e10-4400-b815-3f655bb14333 tempest-ProjectMemberTests-2104250010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:08 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b92c31e8-2e10-4400-b815-3f655bb14333 tempest-ProjectMemberTests-2104250010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:08 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b92c31e8-2e10-4400-b815-3f655bb14333 tempest-ProjectMemberTests-2104250010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b92c31e8-2e10-4400-b815-3f655bb14333 tempest-ProjectMemberTests-2104250010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:08 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b92c31e8-2e10-4400-b815-3f655bb14333 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:08 devstack sudo[106620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:34:08 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:09 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b92c31e8-2e10-4400-b815-3f655bb14333 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.292s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:09 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-b92c31e8-2e10-4400-b815-3f655bb14333 tempest-ProjectMemberTests-2104250010 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:34:09 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-b92c31e8-2e10-4400-b815-3f655bb14333 tempest-ProjectMemberTests-2104250010 None] Deleted volume successfully. Sep 23 00:34:09 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b92c31e8-2e10-4400-b815-3f655bb14333 tempest-ProjectMemberTests-2104250010 None] Lock "cinder-229c48bf-3707-4793-8c0f-1e4127202550-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:09 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-72ad20eb-4f20-4e2a-86f2-6aa2b25637a2 tempest-ProjectMemberTests-2104250010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:34:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-72ad20eb-4f20-4e2a-86f2-6aa2b25637a2 tempest-ProjectMemberTests-2104250010 None] Flow 'volume_create_manager' (2b0a9797-0fab-4d77-be38-8bf15190a0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-72ad20eb-4f20-4e2a-86f2-6aa2b25637a2 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43edbf3a-8b78-4ec9-8d11-0d2b075ed09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-72ad20eb-4f20-4e2a-86f2-6aa2b25637a2 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43edbf3a-8b78-4ec9-8d11-0d2b075ed09b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1012999683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ab366b2-4a05-4810-a6e7-c20ad4e30350,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='105e2fcb253445d18a9a36e4adbf6662',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:10Z,use_quota=True,user_id='6f62c0bf87c2488e987066aaecad1a03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-72ad20eb-4f20-4e2a-86f2-6aa2b25637a2 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4598ba6b-52a1-4a70-9034-e0770ab749cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-72ad20eb-4f20-4e2a-86f2-6aa2b25637a2 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4598ba6b-52a1-4a70-9034-e0770ab749cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-72ad20eb-4f20-4e2a-86f2-6aa2b25637a2 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b19499a-8bad-4328-ab80-d176b9c888f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-72ad20eb-4f20-4e2a-86f2-6aa2b25637a2 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b19499a-8bad-4328-ab80-d176b9c888f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ab366b2-4a05-4810-a6e7-c20ad4e30350', 'volume_name': 'volume-9ab366b2-4a05-4810-a6e7-c20ad4e30350', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-72ad20eb-4f20-4e2a-86f2-6aa2b25637a2 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (271b985c-03fd-4d47-b64b-5dbc58cd03da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-72ad20eb-4f20-4e2a-86f2-6aa2b25637a2 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (271b985c-03fd-4d47-b64b-5dbc58cd03da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-72ad20eb-4f20-4e2a-86f2-6aa2b25637a2 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a33ace7-c7a4-410c-a08d-472d3c66f609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:09 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-72ad20eb-4f20-4e2a-86f2-6aa2b25637a2 tempest-ProjectMemberTests-2104250010 None] Volume 9ab366b2-4a05-4810-a6e7-c20ad4e30350: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ab366b2-4a05-4810-a6e7-c20ad4e30350', 'volume_size': 1} Sep 23 00:34:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-72ad20eb-4f20-4e2a-86f2-6aa2b25637a2 tempest-ProjectMemberTests-2104250010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-72ad20eb-4f20-4e2a-86f2-6aa2b25637a2 tempest-ProjectMemberTests-2104250010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:09 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-72ad20eb-4f20-4e2a-86f2-6aa2b25637a2 tempest-ProjectMemberTests-2104250010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1012999683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ab366b2-4a05-4810-a6e7-c20ad4e30350,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='105e2fcb253445d18a9a36e4adbf6662',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:10Z,use_quota=True,user_id='6f62c0bf87c2488e987066aaecad1a03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:34:09 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-72ad20eb-4f20-4e2a-86f2-6aa2b25637a2 tempest-ProjectMemberTests-2104250010 None] Creating volume 9ab366b2-4a05-4810-a6e7-c20ad4e30350 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:34:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-72ad20eb-4f20-4e2a-86f2-6aa2b25637a2 tempest-ProjectMemberTests-2104250010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-72ad20eb-4f20-4e2a-86f2-6aa2b25637a2 tempest-ProjectMemberTests-2104250010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:09 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-72ad20eb-4f20-4e2a-86f2-6aa2b25637a2 tempest-ProjectMemberTests-2104250010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:09 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-72ad20eb-4f20-4e2a-86f2-6aa2b25637a2 tempest-ProjectMemberTests-2104250010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-72ad20eb-4f20-4e2a-86f2-6aa2b25637a2 tempest-ProjectMemberTests-2104250010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:09 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-72ad20eb-4f20-4e2a-86f2-6aa2b25637a2 tempest-ProjectMemberTests-2104250010 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:34:09 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-72ad20eb-4f20-4e2a-86f2-6aa2b25637a2 tempest-ProjectMemberTests-2104250010 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:34:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-72ad20eb-4f20-4e2a-86f2-6aa2b25637a2 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9ab366b2-4a05-4810-a6e7-c20ad4e30350 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:09 devstack sudo[106624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9ab366b2-4a05-4810-a6e7-c20ad4e30350 1073741824 Sep 23 00:34:09 devstack sudo[106624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:09 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-3701d184-67a4-4c54-9119-37aaf821e524 tempest-ProjectReaderTests-2031349546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:34:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3701d184-67a4-4c54-9119-37aaf821e524 tempest-ProjectReaderTests-2031349546 None] Flow 'volume_create_manager' (1d60eca1-bf76-4849-ada6-def36e0d8fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3701d184-67a4-4c54-9119-37aaf821e524 tempest-ProjectReaderTests-2031349546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (773602c9-7710-41a2-9306-8f4f9e3554ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3701d184-67a4-4c54-9119-37aaf821e524 tempest-ProjectReaderTests-2031349546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (773602c9-7710-41a2-9306-8f4f9e3554ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-955174699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47d97d06-5694-4919-b404-fdb6c83143b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63267e01c1d6464ba9d96563872ff60b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:10Z,use_quota=True,user_id='0d945b80b6ab4be7acdfeeda16ca1045',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3701d184-67a4-4c54-9119-37aaf821e524 tempest-ProjectReaderTests-2031349546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (597cc374-7e3d-42e4-99c0-4f66a72befd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3701d184-67a4-4c54-9119-37aaf821e524 tempest-ProjectReaderTests-2031349546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (597cc374-7e3d-42e4-99c0-4f66a72befd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3701d184-67a4-4c54-9119-37aaf821e524 tempest-ProjectReaderTests-2031349546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56995a30-f910-401f-8a7e-a141eeadb00c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3701d184-67a4-4c54-9119-37aaf821e524 tempest-ProjectReaderTests-2031349546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56995a30-f910-401f-8a7e-a141eeadb00c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47d97d06-5694-4919-b404-fdb6c83143b3', 'volume_name': 'volume-47d97d06-5694-4919-b404-fdb6c83143b3', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3701d184-67a4-4c54-9119-37aaf821e524 tempest-ProjectReaderTests-2031349546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9b63fe2-3764-4696-8e72-9ac305479b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3701d184-67a4-4c54-9119-37aaf821e524 tempest-ProjectReaderTests-2031349546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9b63fe2-3764-4696-8e72-9ac305479b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:09 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3701d184-67a4-4c54-9119-37aaf821e524 tempest-ProjectReaderTests-2031349546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a4dbc0b-27c8-40f5-a27d-e1b0f45f5839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:09 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-3701d184-67a4-4c54-9119-37aaf821e524 tempest-ProjectReaderTests-2031349546 None] Volume 47d97d06-5694-4919-b404-fdb6c83143b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47d97d06-5694-4919-b404-fdb6c83143b3', 'volume_size': 1} Sep 23 00:34:09 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-3701d184-67a4-4c54-9119-37aaf821e524 tempest-ProjectReaderTests-2031349546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:10 devstack sudo[106624]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-72ad20eb-4f20-4e2a-86f2-6aa2b25637a2 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9ab366b2-4a05-4810-a6e7-c20ad4e30350 1073741824" returned: 0 in 0.470s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-72ad20eb-4f20-4e2a-86f2-6aa2b25637a2 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9ab366b2-4a05-4810-a6e7-c20ad4e30350 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:10 devstack sudo[106630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9ab366b2-4a05-4810-a6e7-c20ad4e30350 Sep 23 00:34:10 devstack sudo[106630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:10 devstack sudo[106630]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-72ad20eb-4f20-4e2a-86f2-6aa2b25637a2 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9ab366b2-4a05-4810-a6e7-c20ad4e30350" returned: 0 in 0.268s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:10 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-72ad20eb-4f20-4e2a-86f2-6aa2b25637a2 tempest-ProjectMemberTests-2104250010 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:34:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-72ad20eb-4f20-4e2a-86f2-6aa2b25637a2 tempest-ProjectMemberTests-2104250010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-3701d184-67a4-4c54-9119-37aaf821e524 tempest-ProjectReaderTests-2031349546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.644s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:10 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-3701d184-67a4-4c54-9119-37aaf821e524 tempest-ProjectReaderTests-2031349546 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-955174699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47d97d06-5694-4919-b404-fdb6c83143b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63267e01c1d6464ba9d96563872ff60b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:10Z,use_quota=True,user_id='0d945b80b6ab4be7acdfeeda16ca1045',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:34:10 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-3701d184-67a4-4c54-9119-37aaf821e524 tempest-ProjectReaderTests-2031349546 None] Creating volume 47d97d06-5694-4919-b404-fdb6c83143b3 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:34:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-3701d184-67a4-4c54-9119-37aaf821e524 tempest-ProjectReaderTests-2031349546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-3701d184-67a4-4c54-9119-37aaf821e524 tempest-ProjectReaderTests-2031349546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:10 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-3701d184-67a4-4c54-9119-37aaf821e524 tempest-ProjectReaderTests-2031349546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:10 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-3701d184-67a4-4c54-9119-37aaf821e524 tempest-ProjectReaderTests-2031349546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-3701d184-67a4-4c54-9119-37aaf821e524 tempest-ProjectReaderTests-2031349546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:10 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-3701d184-67a4-4c54-9119-37aaf821e524 tempest-ProjectReaderTests-2031349546 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:34:10 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-3701d184-67a4-4c54-9119-37aaf821e524 tempest-ProjectReaderTests-2031349546 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:34:10 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3701d184-67a4-4c54-9119-37aaf821e524 tempest-ProjectReaderTests-2031349546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-47d97d06-5694-4919-b404-fdb6c83143b3 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:10 devstack sudo[106633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-47d97d06-5694-4919-b404-fdb6c83143b3 1073741824 Sep 23 00:34:10 devstack sudo[106633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-72ad20eb-4f20-4e2a-86f2-6aa2b25637a2 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a33ace7-c7a4-410c-a08d-472d3c66f609) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ab366b2-4a05-4810-a6e7-c20ad4e30350', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-72ad20eb-4f20-4e2a-86f2-6aa2b25637a2 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2c40d4e-3cb1-4b91-a44b-46f68a06329e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:10 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-72ad20eb-4f20-4e2a-86f2-6aa2b25637a2 tempest-ProjectMemberTests-2104250010 None] Volume volume-9ab366b2-4a05-4810-a6e7-c20ad4e30350 (9ab366b2-4a05-4810-a6e7-c20ad4e30350): created successfully Sep 23 00:34:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-72ad20eb-4f20-4e2a-86f2-6aa2b25637a2 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2c40d4e-3cb1-4b91-a44b-46f68a06329e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:10 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-72ad20eb-4f20-4e2a-86f2-6aa2b25637a2 tempest-ProjectMemberTests-2104250010 None] Flow 'volume_create_manager' (2b0a9797-0fab-4d77-be38-8bf15190a0da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:10 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-72ad20eb-4f20-4e2a-86f2-6aa2b25637a2 tempest-ProjectMemberTests-2104250010 None] Created volume successfully. Sep 23 00:34:11 devstack sudo[106633]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3701d184-67a4-4c54-9119-37aaf821e524 tempest-ProjectReaderTests-2031349546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-47d97d06-5694-4919-b404-fdb6c83143b3 1073741824" returned: 0 in 0.474s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3701d184-67a4-4c54-9119-37aaf821e524 tempest-ProjectReaderTests-2031349546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-47d97d06-5694-4919-b404-fdb6c83143b3 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:11 devstack sudo[106639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-47d97d06-5694-4919-b404-fdb6c83143b3 Sep 23 00:34:11 devstack sudo[106639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:11 devstack sudo[106639]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-3701d184-67a4-4c54-9119-37aaf821e524 tempest-ProjectReaderTests-2031349546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-47d97d06-5694-4919-b404-fdb6c83143b3" returned: 0 in 0.293s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:11 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-3701d184-67a4-4c54-9119-37aaf821e524 tempest-ProjectReaderTests-2031349546 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:34:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-3701d184-67a4-4c54-9119-37aaf821e524 tempest-ProjectReaderTests-2031349546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:11 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3701d184-67a4-4c54-9119-37aaf821e524 tempest-ProjectReaderTests-2031349546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a4dbc0b-27c8-40f5-a27d-e1b0f45f5839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47d97d06-5694-4919-b404-fdb6c83143b3', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:11 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3701d184-67a4-4c54-9119-37aaf821e524 tempest-ProjectReaderTests-2031349546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3936254-5f22-489f-b306-fdac4f02bfc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:11 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-3701d184-67a4-4c54-9119-37aaf821e524 tempest-ProjectReaderTests-2031349546 None] Volume volume-47d97d06-5694-4919-b404-fdb6c83143b3 (47d97d06-5694-4919-b404-fdb6c83143b3): created successfully Sep 23 00:34:11 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3701d184-67a4-4c54-9119-37aaf821e524 tempest-ProjectReaderTests-2031349546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3936254-5f22-489f-b306-fdac4f02bfc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:11 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-3701d184-67a4-4c54-9119-37aaf821e524 tempest-ProjectReaderTests-2031349546 None] Flow 'volume_create_manager' (1d60eca1-bf76-4849-ada6-def36e0d8fe8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:11 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-3701d184-67a4-4c54-9119-37aaf821e524 tempest-ProjectReaderTests-2031349546 None] Created volume successfully. Sep 23 00:34:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-124bedf0-e446-4e11-a13e-9bca7526b044 tempest-ProjectMemberTests-2104250010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-124bedf0-e446-4e11-a13e-9bca7526b044 tempest-ProjectMemberTests-2104250010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:11 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b173be47-beb4-4ba1-a322-5f78b43aaf1e tempest-ProjectReaderTests-2031349546 None] Acquiring lock "cinder-47d97d06-5694-4919-b404-fdb6c83143b3-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:11 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-124bedf0-e446-4e11-a13e-9bca7526b044 tempest-ProjectMemberTests-2104250010 None] Creating offline snapshot 4820cc34-b9d8-4ca3-a8a6-b2b8463a8f26 of volume 9ab366b2-4a05-4810-a6e7-c20ad4e30350 {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:34:11 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b173be47-beb4-4ba1-a322-5f78b43aaf1e tempest-ProjectReaderTests-2031349546 None] Lock "cinder-47d97d06-5694-4919-b404-fdb6c83143b3-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:11 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cebcc67-c6e3-44b9-b75c-fd1eee2528e9]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-124bedf0-e446-4e11-a13e-9bca7526b044 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9ab366b2-4a05-4810-a6e7-c20ad4e30350 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:11 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b173be47-beb4-4ba1-a322-5f78b43aaf1e tempest-ProjectReaderTests-2031349546 None] Acquiring lock "cinder-quobyte-47d97d06-5694-4919-b404-fdb6c83143b3" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:12 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b173be47-beb4-4ba1-a322-5f78b43aaf1e tempest-ProjectReaderTests-2031349546 None] Lock "cinder-quobyte-47d97d06-5694-4919-b404-fdb6c83143b3" acquired by "delete_volume" :: waited 0.017s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:12 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[57053e47-e216-4b4c-846c-c2c3f2fbe701]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b173be47-beb4-4ba1-a322-5f78b43aaf1e tempest-ProjectReaderTests-2031349546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-47d97d06-5694-4919-b404-fdb6c83143b3 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:12 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9ab366b2-4a05-4810-a6e7-c20ad4e30350 Sep 23 00:34:12 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:12 devstack sudo[106649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-47d97d06-5694-4919-b404-fdb6c83143b3 Sep 23 00:34:12 devstack sudo[106649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:12 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-124bedf0-e446-4e11-a13e-9bca7526b044 tempest-ProjectMemberTests-2104250010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9ab366b2-4a05-4810-a6e7-c20ad4e30350" returned: 0 in 0.386s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-124bedf0-e446-4e11-a13e-9bca7526b044 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9ab366b2-4a05-4810-a6e7-c20ad4e30350,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9ab366b2-4a05-4810-a6e7-c20ad4e30350.4820cc34-b9d8-4ca3-a8a6-b2b8463a8f26 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:12 devstack sudo[106657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9ab366b2-4a05-4810-a6e7-c20ad4e30350,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9ab366b2-4a05-4810-a6e7-c20ad4e30350.4820cc34-b9d8-4ca3-a8a6-b2b8463a8f26 1G Sep 23 00:34:12 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:12 devstack sudo[106649]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b173be47-beb4-4ba1-a322-5f78b43aaf1e tempest-ProjectReaderTests-2031349546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-47d97d06-5694-4919-b404-fdb6c83143b3" returned: 0 in 0.387s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b173be47-beb4-4ba1-a322-5f78b43aaf1e tempest-ProjectReaderTests-2031349546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-47d97d06-5694-4919-b404-fdb6c83143b3 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:12 devstack sudo[106661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-47d97d06-5694-4919-b404-fdb6c83143b3 Sep 23 00:34:12 devstack sudo[106661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:12 devstack sudo[106661]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b173be47-beb4-4ba1-a322-5f78b43aaf1e tempest-ProjectReaderTests-2031349546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-47d97d06-5694-4919-b404-fdb6c83143b3" returned: 0 in 0.312s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:12 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b173be47-beb4-4ba1-a322-5f78b43aaf1e tempest-ProjectReaderTests-2031349546 None] Lock "cinder-quobyte-47d97d06-5694-4919-b404-fdb6c83143b3" released by "delete_volume" :: held 0.749s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:12 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-124bedf0-e446-4e11-a13e-9bca7526b044 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9ab366b2-4a05-4810-a6e7-c20ad4e30350,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9ab366b2-4a05-4810-a6e7-c20ad4e30350.4820cc34-b9d8-4ca3-a8a6-b2b8463a8f26 1G" returned: 0 in 0.474s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-124bedf0-e446-4e11-a13e-9bca7526b044 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ab366b2-4a05-4810-a6e7-c20ad4e30350 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9ab366b2-4a05-4810-a6e7-c20ad4e30350.4820cc34-b9d8-4ca3-a8a6-b2b8463a8f26 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:12 devstack sudo[106668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ab366b2-4a05-4810-a6e7-c20ad4e30350 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9ab366b2-4a05-4810-a6e7-c20ad4e30350.4820cc34-b9d8-4ca3-a8a6-b2b8463a8f26 Sep 23 00:34:12 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:12 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-b173be47-beb4-4ba1-a322-5f78b43aaf1e tempest-ProjectReaderTests-2031349546 None] Created reservations ['561bf378-329a-4f37-8512-38c01086b49f', '746765ef-f22d-4a9e-96f1-81e7bc246f9b', 'e752879a-f2c6-44fe-b700-00bb181a69ee', '2e0d226a-ab3d-4d8d-b692-a7a760877907'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:34:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b173be47-beb4-4ba1-a322-5f78b43aaf1e tempest-ProjectReaderTests-2031349546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b173be47-beb4-4ba1-a322-5f78b43aaf1e tempest-ProjectReaderTests-2031349546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:12 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b173be47-beb4-4ba1-a322-5f78b43aaf1e tempest-ProjectReaderTests-2031349546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:12 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b173be47-beb4-4ba1-a322-5f78b43aaf1e tempest-ProjectReaderTests-2031349546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b173be47-beb4-4ba1-a322-5f78b43aaf1e tempest-ProjectReaderTests-2031349546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b173be47-beb4-4ba1-a322-5f78b43aaf1e tempest-ProjectReaderTests-2031349546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:12 devstack sudo[106670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:34:12 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:13 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-124bedf0-e446-4e11-a13e-9bca7526b044 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ab366b2-4a05-4810-a6e7-c20ad4e30350 -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9ab366b2-4a05-4810-a6e7-c20ad4e30350.4820cc34-b9d8-4ca3-a8a6-b2b8463a8f26" returned: 0 in 0.363s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:13 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-124bedf0-e446-4e11-a13e-9bca7526b044 tempest-ProjectMemberTests-2104250010 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9ab366b2-4a05-4810-a6e7-c20ad4e30350.4820cc34-b9d8-4ca3-a8a6-b2b8463a8f26 is being set with open permissions: ugo+rw Sep 23 00:34:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-124bedf0-e446-4e11-a13e-9bca7526b044 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9ab366b2-4a05-4810-a6e7-c20ad4e30350.4820cc34-b9d8-4ca3-a8a6-b2b8463a8f26 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:13 devstack sudo[106676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9ab366b2-4a05-4810-a6e7-c20ad4e30350.4820cc34-b9d8-4ca3-a8a6-b2b8463a8f26 Sep 23 00:34:13 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:13 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b173be47-beb4-4ba1-a322-5f78b43aaf1e tempest-ProjectReaderTests-2031349546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.313s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:13 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-b173be47-beb4-4ba1-a322-5f78b43aaf1e tempest-ProjectReaderTests-2031349546 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:34:13 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-b173be47-beb4-4ba1-a322-5f78b43aaf1e tempest-ProjectReaderTests-2031349546 None] Deleted volume successfully. Sep 23 00:34:13 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b173be47-beb4-4ba1-a322-5f78b43aaf1e tempest-ProjectReaderTests-2031349546 None] Lock "cinder-47d97d06-5694-4919-b404-fdb6c83143b3-delete_volume" released by "delete_volume" :: held 1.378s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:13 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-124bedf0-e446-4e11-a13e-9bca7526b044 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9ab366b2-4a05-4810-a6e7-c20ad4e30350.4820cc34-b9d8-4ca3-a8a6-b2b8463a8f26" returned: 0 in 0.281s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-124bedf0-e446-4e11-a13e-9bca7526b044 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9ab366b2-4a05-4810-a6e7-c20ad4e30350.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:13 devstack sudo[106680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9ab366b2-4a05-4810-a6e7-c20ad4e30350.info Sep 23 00:34:13 devstack sudo[106680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:13 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cce1bc2-62d9-4250-8dbd-ad2bcf80f774 tempest-ProjectReaderTests-2031349546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:34:13 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7cce1bc2-62d9-4250-8dbd-ad2bcf80f774 tempest-ProjectReaderTests-2031349546 None] Flow 'volume_create_manager' (5d5f1e9b-261d-46e3-a03a-055023a27a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:13 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7cce1bc2-62d9-4250-8dbd-ad2bcf80f774 tempest-ProjectReaderTests-2031349546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (effbab95-0355-4bd4-acc2-9374ee630625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:13 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7cce1bc2-62d9-4250-8dbd-ad2bcf80f774 tempest-ProjectReaderTests-2031349546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (effbab95-0355-4bd4-acc2-9374ee630625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1863612599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a1ec074-e09f-40b9-b155-ca25fe4d56e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63267e01c1d6464ba9d96563872ff60b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:14Z,use_quota=True,user_id='0d945b80b6ab4be7acdfeeda16ca1045',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:13 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7cce1bc2-62d9-4250-8dbd-ad2bcf80f774 tempest-ProjectReaderTests-2031349546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a7aa7b7-de2d-44af-8e19-c75e32a7b3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:13 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7cce1bc2-62d9-4250-8dbd-ad2bcf80f774 tempest-ProjectReaderTests-2031349546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a7aa7b7-de2d-44af-8e19-c75e32a7b3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:13 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7cce1bc2-62d9-4250-8dbd-ad2bcf80f774 tempest-ProjectReaderTests-2031349546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaf2423b-cdc7-43c8-91da-4c9bd829bbf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:13 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7cce1bc2-62d9-4250-8dbd-ad2bcf80f774 tempest-ProjectReaderTests-2031349546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaf2423b-cdc7-43c8-91da-4c9bd829bbf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a1ec074-e09f-40b9-b155-ca25fe4d56e1', 'volume_name': 'volume-4a1ec074-e09f-40b9-b155-ca25fe4d56e1', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:13 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7cce1bc2-62d9-4250-8dbd-ad2bcf80f774 tempest-ProjectReaderTests-2031349546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9073331-a562-4aa3-a270-b8fc811fd76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:13 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7cce1bc2-62d9-4250-8dbd-ad2bcf80f774 tempest-ProjectReaderTests-2031349546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9073331-a562-4aa3-a270-b8fc811fd76e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:13 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7cce1bc2-62d9-4250-8dbd-ad2bcf80f774 tempest-ProjectReaderTests-2031349546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0565b4a2-e17c-40d6-9e3d-7c8a3b52c73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:13 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-7cce1bc2-62d9-4250-8dbd-ad2bcf80f774 tempest-ProjectReaderTests-2031349546 None] Volume 4a1ec074-e09f-40b9-b155-ca25fe4d56e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a1ec074-e09f-40b9-b155-ca25fe4d56e1', 'volume_size': 1} Sep 23 00:34:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7cce1bc2-62d9-4250-8dbd-ad2bcf80f774 tempest-ProjectReaderTests-2031349546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:13 devstack sudo[106680]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-124bedf0-e446-4e11-a13e-9bca7526b044 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9ab366b2-4a05-4810-a6e7-c20ad4e30350.info" returned: 0 in 0.275s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:13 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-124bedf0-e446-4e11-a13e-9bca7526b044 tempest-ProjectMemberTests-2104250010 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9ab366b2-4a05-4810-a6e7-c20ad4e30350.info is being set with open permissions: ugo+rw Sep 23 00:34:13 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-124bedf0-e446-4e11-a13e-9bca7526b044 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9ab366b2-4a05-4810-a6e7-c20ad4e30350.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:13 devstack sudo[106683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9ab366b2-4a05-4810-a6e7-c20ad4e30350.info Sep 23 00:34:13 devstack sudo[106683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:14 devstack sudo[106683]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-124bedf0-e446-4e11-a13e-9bca7526b044 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9ab366b2-4a05-4810-a6e7-c20ad4e30350.info" returned: 0 in 0.271s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-124bedf0-e446-4e11-a13e-9bca7526b044 tempest-ProjectMemberTests-2104250010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.172s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7cce1bc2-62d9-4250-8dbd-ad2bcf80f774 tempest-ProjectReaderTests-2031349546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.350s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:14 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7cce1bc2-62d9-4250-8dbd-ad2bcf80f774 tempest-ProjectReaderTests-2031349546 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1863612599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a1ec074-e09f-40b9-b155-ca25fe4d56e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63267e01c1d6464ba9d96563872ff60b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:14Z,use_quota=True,user_id='0d945b80b6ab4be7acdfeeda16ca1045',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:34:14 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-7cce1bc2-62d9-4250-8dbd-ad2bcf80f774 tempest-ProjectReaderTests-2031349546 None] Creating volume 4a1ec074-e09f-40b9-b155-ca25fe4d56e1 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:34:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7cce1bc2-62d9-4250-8dbd-ad2bcf80f774 tempest-ProjectReaderTests-2031349546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7cce1bc2-62d9-4250-8dbd-ad2bcf80f774 tempest-ProjectReaderTests-2031349546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:14 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7cce1bc2-62d9-4250-8dbd-ad2bcf80f774 tempest-ProjectReaderTests-2031349546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:14 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7cce1bc2-62d9-4250-8dbd-ad2bcf80f774 tempest-ProjectReaderTests-2031349546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7cce1bc2-62d9-4250-8dbd-ad2bcf80f774 tempest-ProjectReaderTests-2031349546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:14 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7cce1bc2-62d9-4250-8dbd-ad2bcf80f774 tempest-ProjectReaderTests-2031349546 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:34:14 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-7cce1bc2-62d9-4250-8dbd-ad2bcf80f774 tempest-ProjectReaderTests-2031349546 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:34:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7cce1bc2-62d9-4250-8dbd-ad2bcf80f774 tempest-ProjectReaderTests-2031349546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-4a1ec074-e09f-40b9-b155-ca25fe4d56e1 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:14 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-4a1ec074-e09f-40b9-b155-ca25fe4d56e1 1073741824 Sep 23 00:34:14 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:14 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-124bedf0-e446-4e11-a13e-9bca7526b044 tempest-ProjectMemberTests-2104250010 None] Create snapshot completed successfully Sep 23 00:34:14 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7cce1bc2-62d9-4250-8dbd-ad2bcf80f774 tempest-ProjectReaderTests-2031349546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-4a1ec074-e09f-40b9-b155-ca25fe4d56e1 1073741824" returned: 0 in 0.475s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7cce1bc2-62d9-4250-8dbd-ad2bcf80f774 tempest-ProjectReaderTests-2031349546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-4a1ec074-e09f-40b9-b155-ca25fe4d56e1 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:14 devstack sudo[106692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-4a1ec074-e09f-40b9-b155-ca25fe4d56e1 Sep 23 00:34:14 devstack sudo[106692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:14 devstack sudo[106692]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-7cce1bc2-62d9-4250-8dbd-ad2bcf80f774 tempest-ProjectReaderTests-2031349546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-4a1ec074-e09f-40b9-b155-ca25fe4d56e1" returned: 0 in 0.284s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:14 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-7cce1bc2-62d9-4250-8dbd-ad2bcf80f774 tempest-ProjectReaderTests-2031349546 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:34:14 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-7cce1bc2-62d9-4250-8dbd-ad2bcf80f774 tempest-ProjectReaderTests-2031349546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:14 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7cce1bc2-62d9-4250-8dbd-ad2bcf80f774 tempest-ProjectReaderTests-2031349546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0565b4a2-e17c-40d6-9e3d-7c8a3b52c73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a1ec074-e09f-40b9-b155-ca25fe4d56e1', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:14 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7cce1bc2-62d9-4250-8dbd-ad2bcf80f774 tempest-ProjectReaderTests-2031349546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73b98b62-3bdf-4fda-8433-a171b8a91bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:14 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-7cce1bc2-62d9-4250-8dbd-ad2bcf80f774 tempest-ProjectReaderTests-2031349546 None] Volume volume-4a1ec074-e09f-40b9-b155-ca25fe4d56e1 (4a1ec074-e09f-40b9-b155-ca25fe4d56e1): created successfully Sep 23 00:34:14 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7cce1bc2-62d9-4250-8dbd-ad2bcf80f774 tempest-ProjectReaderTests-2031349546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73b98b62-3bdf-4fda-8433-a171b8a91bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:14 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-7cce1bc2-62d9-4250-8dbd-ad2bcf80f774 tempest-ProjectReaderTests-2031349546 None] Flow 'volume_create_manager' (5d5f1e9b-261d-46e3-a03a-055023a27a25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:14 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-7cce1bc2-62d9-4250-8dbd-ad2bcf80f774 tempest-ProjectReaderTests-2031349546 None] Created volume successfully. Sep 23 00:34:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a634d1b4-4145-4b36-8820-08be4cb1b6a2 tempest-ProjectMemberTests-2104250010 None] Acquiring lock "cinder-4820cc34-b9d8-4ca3-a8a6-b2b8463a8f26-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a634d1b4-4145-4b36-8820-08be4cb1b6a2 tempest-ProjectMemberTests-2104250010 None] Lock "cinder-4820cc34-b9d8-4ca3-a8a6-b2b8463a8f26-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a634d1b4-4145-4b36-8820-08be4cb1b6a2 tempest-ProjectMemberTests-2104250010 None] Acquiring lock "cinder-quobyte-9ab366b2-4a05-4810-a6e7-c20ad4e30350" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a634d1b4-4145-4b36-8820-08be4cb1b6a2 tempest-ProjectMemberTests-2104250010 None] Lock "cinder-quobyte-9ab366b2-4a05-4810-a6e7-c20ad4e30350" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a634d1b4-4145-4b36-8820-08be4cb1b6a2 tempest-ProjectMemberTests-2104250010 None] Acquiring lock "cinder-quobyte-4820cc34-b9d8-4ca3-a8a6-b2b8463a8f26" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a634d1b4-4145-4b36-8820-08be4cb1b6a2 tempest-ProjectMemberTests-2104250010 None] Lock "cinder-quobyte-4820cc34-b9d8-4ca3-a8a6-b2b8463a8f26" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:15 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-a634d1b4-4145-4b36-8820-08be4cb1b6a2 tempest-ProjectMemberTests-2104250010 None] Deleting offline snapshot 4820cc34-b9d8-4ca3-a8a6-b2b8463a8f26 of volume 9ab366b2-4a05-4810-a6e7-c20ad4e30350 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:34:15 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-a634d1b4-4145-4b36-8820-08be4cb1b6a2 tempest-ProjectMemberTests-2104250010 None] snapshot_file for this snap is: volume-9ab366b2-4a05-4810-a6e7-c20ad4e30350.4820cc34-b9d8-4ca3-a8a6-b2b8463a8f26 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:34:15 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[50696e9c-1584-4bfb-802c-714781e86f3f]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a634d1b4-4145-4b36-8820-08be4cb1b6a2 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9ab366b2-4a05-4810-a6e7-c20ad4e30350.4820cc34-b9d8-4ca3-a8a6-b2b8463a8f26 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:15 devstack sudo[106695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9ab366b2-4a05-4810-a6e7-c20ad4e30350.4820cc34-b9d8-4ca3-a8a6-b2b8463a8f26 Sep 23 00:34:15 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:15 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a634d1b4-4145-4b36-8820-08be4cb1b6a2 tempest-ProjectMemberTests-2104250010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9ab366b2-4a05-4810-a6e7-c20ad4e30350.4820cc34-b9d8-4ca3-a8a6-b2b8463a8f26" returned: 0 in 0.391s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:15 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-a634d1b4-4145-4b36-8820-08be4cb1b6a2 tempest-ProjectMemberTests-2104250010 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ab366b2-4a05-4810-a6e7-c20ad4e30350(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:34:15 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9f7682-a17b-4d20-b3fd-9ae2be82819e]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a634d1b4-4145-4b36-8820-08be4cb1b6a2 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9ab366b2-4a05-4810-a6e7-c20ad4e30350 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:15 devstack sudo[106700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9ab366b2-4a05-4810-a6e7-c20ad4e30350 Sep 23 00:34:15 devstack sudo[106700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b9f4a089-6dcd-48e4-91db-d3f42ca041e8 tempest-ProjectReaderTests-2031349546 None] Acquiring lock "cinder-4a1ec074-e09f-40b9-b155-ca25fe4d56e1-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b9f4a089-6dcd-48e4-91db-d3f42ca041e8 tempest-ProjectReaderTests-2031349546 None] Lock "cinder-4a1ec074-e09f-40b9-b155-ca25fe4d56e1-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b9f4a089-6dcd-48e4-91db-d3f42ca041e8 tempest-ProjectReaderTests-2031349546 None] Acquiring lock "cinder-quobyte-4a1ec074-e09f-40b9-b155-ca25fe4d56e1" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:15 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b9f4a089-6dcd-48e4-91db-d3f42ca041e8 tempest-ProjectReaderTests-2031349546 None] Lock "cinder-quobyte-4a1ec074-e09f-40b9-b155-ca25fe4d56e1" acquired by "delete_volume" :: waited 0.018s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:15 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[55406026-74ad-43c2-9316-3e4147464bdc]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:15 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b9f4a089-6dcd-48e4-91db-d3f42ca041e8 tempest-ProjectReaderTests-2031349546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-4a1ec074-e09f-40b9-b155-ca25fe4d56e1 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:16 devstack sudo[106700]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a634d1b4-4145-4b36-8820-08be4cb1b6a2 tempest-ProjectMemberTests-2104250010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9ab366b2-4a05-4810-a6e7-c20ad4e30350" returned: 0 in 0.436s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:16 devstack sudo[106702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-4a1ec074-e09f-40b9-b155-ca25fe4d56e1 Sep 23 00:34:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a634d1b4-4145-4b36-8820-08be4cb1b6a2 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9ab366b2-4a05-4810-a6e7-c20ad4e30350.4820cc34-b9d8-4ca3-a8a6-b2b8463a8f26 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:16 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:16 devstack sudo[106707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9ab366b2-4a05-4810-a6e7-c20ad4e30350.4820cc34-b9d8-4ca3-a8a6-b2b8463a8f26 Sep 23 00:34:16 devstack sudo[106707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:16 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b9f4a089-6dcd-48e4-91db-d3f42ca041e8 tempest-ProjectReaderTests-2031349546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-4a1ec074-e09f-40b9-b155-ca25fe4d56e1" returned: 0 in 0.424s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b9f4a089-6dcd-48e4-91db-d3f42ca041e8 tempest-ProjectReaderTests-2031349546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-4a1ec074-e09f-40b9-b155-ca25fe4d56e1 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:16 devstack sudo[106716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-4a1ec074-e09f-40b9-b155-ca25fe4d56e1 Sep 23 00:34:16 devstack sudo[106716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:16 devstack sudo[106707]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a634d1b4-4145-4b36-8820-08be4cb1b6a2 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9ab366b2-4a05-4810-a6e7-c20ad4e30350.4820cc34-b9d8-4ca3-a8a6-b2b8463a8f26" returned: 0 in 0.401s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a634d1b4-4145-4b36-8820-08be4cb1b6a2 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9ab366b2-4a05-4810-a6e7-c20ad4e30350.4820cc34-b9d8-4ca3-a8a6-b2b8463a8f26 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:16 devstack sudo[106718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9ab366b2-4a05-4810-a6e7-c20ad4e30350.4820cc34-b9d8-4ca3-a8a6-b2b8463a8f26 Sep 23 00:34:16 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:16 devstack sudo[106716]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b9f4a089-6dcd-48e4-91db-d3f42ca041e8 tempest-ProjectReaderTests-2031349546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-4a1ec074-e09f-40b9-b155-ca25fe4d56e1" returned: 0 in 0.267s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:16 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b9f4a089-6dcd-48e4-91db-d3f42ca041e8 tempest-ProjectReaderTests-2031349546 None] Lock "cinder-quobyte-4a1ec074-e09f-40b9-b155-ca25fe4d56e1" released by "delete_volume" :: held 0.741s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:16 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:34:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:16 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-b9f4a089-6dcd-48e4-91db-d3f42ca041e8 tempest-ProjectReaderTests-2031349546 None] Created reservations ['aba9fa12-e9e8-4998-b925-0a72d0ec4fe9', 'cdd4e4c5-fa8b-464c-a53a-2fbc87029478', '28bdb044-4dcd-4971-b4a7-1aefa9ba74f4', '50d785d9-5d15-415c-8d44-134c5479fb7a'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:34:16 devstack sudo[106722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:34:16 devstack sudo[106722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:16 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-a634d1b4-4145-4b36-8820-08be4cb1b6a2 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9ab366b2-4a05-4810-a6e7-c20ad4e30350.4820cc34-b9d8-4ca3-a8a6-b2b8463a8f26" returned: 0 in 0.306s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:16 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a634d1b4-4145-4b36-8820-08be4cb1b6a2 tempest-ProjectMemberTests-2104250010 None] Lock "cinder-quobyte-4820cc34-b9d8-4ca3-a8a6-b2b8463a8f26" released by "_delete_snapshot" :: held 1.666s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:16 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a634d1b4-4145-4b36-8820-08be4cb1b6a2 tempest-ProjectMemberTests-2104250010 None] Lock "cinder-quobyte-9ab366b2-4a05-4810-a6e7-c20ad4e30350" released by "delete_snapshot" :: held 1.699s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b9f4a089-6dcd-48e4-91db-d3f42ca041e8 tempest-ProjectReaderTests-2031349546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b9f4a089-6dcd-48e4-91db-d3f42ca041e8 tempest-ProjectReaderTests-2031349546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b9f4a089-6dcd-48e4-91db-d3f42ca041e8 tempest-ProjectReaderTests-2031349546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:16 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b9f4a089-6dcd-48e4-91db-d3f42ca041e8 tempest-ProjectReaderTests-2031349546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b9f4a089-6dcd-48e4-91db-d3f42ca041e8 tempest-ProjectReaderTests-2031349546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:16 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b9f4a089-6dcd-48e4-91db-d3f42ca041e8 tempest-ProjectReaderTests-2031349546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:16 devstack sudo[106724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:34:16 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:16 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-a634d1b4-4145-4b36-8820-08be4cb1b6a2 tempest-ProjectMemberTests-2104250010 None] Created reservations ['55cbad69-8a66-49a5-85f8-cd7a2ec214c8', '219a9697-9da3-4471-a7ac-97f72f45fdb3', '5586ec5c-7317-4d3a-9e3b-842b329d3d7f', '9c44e82e-25f9-4caf-8bce-9be1958ed0e6'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:34:17 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-a634d1b4-4145-4b36-8820-08be4cb1b6a2 tempest-ProjectMemberTests-2104250010 None] Delete snapshot completed successfully. Sep 23 00:34:17 devstack sudo[106722]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.383s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:17 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:34:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-a634d1b4-4145-4b36-8820-08be4cb1b6a2 tempest-ProjectMemberTests-2104250010 None] Lock "cinder-4820cc34-b9d8-4ca3-a8a6-b2b8463a8f26-delete_snapshot" released by "delete_snapshot" :: held 2.001s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:17 devstack cinder-volume[86591]: DEBUG oslo_service.periodic_task [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] Running periodic task VolumeManager._thread_info {{(pid=86591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:34:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] thread count: 29 {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:34:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-332e9b90-5c60-49b9-883e-1f4b019ac679 None None] thread info: [<_MainThread(MainThread, started 135440660459648)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:34:17 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b9f4a089-6dcd-48e4-91db-d3f42ca041e8 tempest-ProjectReaderTests-2031349546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.339s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:17 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-b9f4a089-6dcd-48e4-91db-d3f42ca041e8 tempest-ProjectReaderTests-2031349546 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:34:17 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-b9f4a089-6dcd-48e4-91db-d3f42ca041e8 tempest-ProjectReaderTests-2031349546 None] Deleted volume successfully. Sep 23 00:34:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b9f4a089-6dcd-48e4-91db-d3f42ca041e8 tempest-ProjectReaderTests-2031349546 None] Lock "cinder-4a1ec074-e09f-40b9-b155-ca25fe4d56e1-delete_volume" released by "delete_volume" :: held 1.430s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-cc2b084a-3315-4a6a-94f4-6782436c26d0 tempest-ProjectMemberTests-2104250010 None] Acquiring lock "cinder-9ab366b2-4a05-4810-a6e7-c20ad4e30350-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-cc2b084a-3315-4a6a-94f4-6782436c26d0 tempest-ProjectMemberTests-2104250010 None] Lock "cinder-9ab366b2-4a05-4810-a6e7-c20ad4e30350-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-cc2b084a-3315-4a6a-94f4-6782436c26d0 tempest-ProjectMemberTests-2104250010 None] Acquiring lock "cinder-quobyte-9ab366b2-4a05-4810-a6e7-c20ad4e30350" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:17 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-cc2b084a-3315-4a6a-94f4-6782436c26d0 tempest-ProjectMemberTests-2104250010 None] Lock "cinder-quobyte-9ab366b2-4a05-4810-a6e7-c20ad4e30350" acquired by "delete_volume" :: waited 0.016s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:17 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[623cd34b-61a9-42ab-a7c5-05f63a5a3875]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cc2b084a-3315-4a6a-94f4-6782436c26d0 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9ab366b2-4a05-4810-a6e7-c20ad4e30350 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:17 devstack sudo[106728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9ab366b2-4a05-4810-a6e7-c20ad4e30350 Sep 23 00:34:17 devstack sudo[106728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:17 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-b80b7150-7c4f-48d6-a149-551265fc8ecd tempest-ProjectReaderTests-2031349546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:34:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b80b7150-7c4f-48d6-a149-551265fc8ecd tempest-ProjectReaderTests-2031349546 None] Flow 'volume_create_manager' (5a45ac9a-1171-4b6b-aac4-dfca618e440c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b80b7150-7c4f-48d6-a149-551265fc8ecd tempest-ProjectReaderTests-2031349546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ec18b26-fec3-4225-8157-9345f3611ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b80b7150-7c4f-48d6-a149-551265fc8ecd tempest-ProjectReaderTests-2031349546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ec18b26-fec3-4225-8157-9345f3611ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1341885352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=324ef097-ea4f-45cc-a4ad-738273715732,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63267e01c1d6464ba9d96563872ff60b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:18Z,use_quota=True,user_id='0d945b80b6ab4be7acdfeeda16ca1045',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b80b7150-7c4f-48d6-a149-551265fc8ecd tempest-ProjectReaderTests-2031349546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (278d36c6-6b13-4a38-991e-dd663853bdb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b80b7150-7c4f-48d6-a149-551265fc8ecd tempest-ProjectReaderTests-2031349546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (278d36c6-6b13-4a38-991e-dd663853bdb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b80b7150-7c4f-48d6-a149-551265fc8ecd tempest-ProjectReaderTests-2031349546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c10f63c-55f7-4cd8-aaa1-72eaf64cbd6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b80b7150-7c4f-48d6-a149-551265fc8ecd tempest-ProjectReaderTests-2031349546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c10f63c-55f7-4cd8-aaa1-72eaf64cbd6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '324ef097-ea4f-45cc-a4ad-738273715732', 'volume_name': 'volume-324ef097-ea4f-45cc-a4ad-738273715732', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b80b7150-7c4f-48d6-a149-551265fc8ecd tempest-ProjectReaderTests-2031349546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a632ebda-b62f-4ac2-81fd-11187c850ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b80b7150-7c4f-48d6-a149-551265fc8ecd tempest-ProjectReaderTests-2031349546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a632ebda-b62f-4ac2-81fd-11187c850ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:17 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b80b7150-7c4f-48d6-a149-551265fc8ecd tempest-ProjectReaderTests-2031349546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5dbf740-5a76-4fab-ae83-8220d1b2ec1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:17 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-b80b7150-7c4f-48d6-a149-551265fc8ecd tempest-ProjectReaderTests-2031349546 None] Volume 324ef097-ea4f-45cc-a4ad-738273715732: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-324ef097-ea4f-45cc-a4ad-738273715732', 'volume_size': 1} Sep 23 00:34:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b80b7150-7c4f-48d6-a149-551265fc8ecd tempest-ProjectReaderTests-2031349546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b80b7150-7c4f-48d6-a149-551265fc8ecd tempest-ProjectReaderTests-2031349546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:17 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b80b7150-7c4f-48d6-a149-551265fc8ecd tempest-ProjectReaderTests-2031349546 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1341885352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=324ef097-ea4f-45cc-a4ad-738273715732,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63267e01c1d6464ba9d96563872ff60b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:18Z,use_quota=True,user_id='0d945b80b6ab4be7acdfeeda16ca1045',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:34:17 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-b80b7150-7c4f-48d6-a149-551265fc8ecd tempest-ProjectReaderTests-2031349546 None] Creating volume 324ef097-ea4f-45cc-a4ad-738273715732 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:34:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b80b7150-7c4f-48d6-a149-551265fc8ecd tempest-ProjectReaderTests-2031349546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b80b7150-7c4f-48d6-a149-551265fc8ecd tempest-ProjectReaderTests-2031349546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:17 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b80b7150-7c4f-48d6-a149-551265fc8ecd tempest-ProjectReaderTests-2031349546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:17 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b80b7150-7c4f-48d6-a149-551265fc8ecd tempest-ProjectReaderTests-2031349546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b80b7150-7c4f-48d6-a149-551265fc8ecd tempest-ProjectReaderTests-2031349546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:17 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b80b7150-7c4f-48d6-a149-551265fc8ecd tempest-ProjectReaderTests-2031349546 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:34:17 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-b80b7150-7c4f-48d6-a149-551265fc8ecd tempest-ProjectReaderTests-2031349546 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:34:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b80b7150-7c4f-48d6-a149-551265fc8ecd tempest-ProjectReaderTests-2031349546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-324ef097-ea4f-45cc-a4ad-738273715732 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:17 devstack sudo[106731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-324ef097-ea4f-45cc-a4ad-738273715732 1073741824 Sep 23 00:34:17 devstack sudo[106731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:17 devstack sudo[106728]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cc2b084a-3315-4a6a-94f4-6782436c26d0 tempest-ProjectMemberTests-2104250010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9ab366b2-4a05-4810-a6e7-c20ad4e30350" returned: 0 in 0.429s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:17 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cc2b084a-3315-4a6a-94f4-6782436c26d0 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9ab366b2-4a05-4810-a6e7-c20ad4e30350 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:17 devstack sudo[106736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9ab366b2-4a05-4810-a6e7-c20ad4e30350 Sep 23 00:34:17 devstack sudo[106736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:18 devstack sudo[106731]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b80b7150-7c4f-48d6-a149-551265fc8ecd tempest-ProjectReaderTests-2031349546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-324ef097-ea4f-45cc-a4ad-738273715732 1073741824" returned: 0 in 0.487s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:18 devstack sudo[106736]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cc2b084a-3315-4a6a-94f4-6782436c26d0 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-9ab366b2-4a05-4810-a6e7-c20ad4e30350" returned: 0 in 0.332s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-cc2b084a-3315-4a6a-94f4-6782436c26d0 tempest-ProjectMemberTests-2104250010 None] Lock "cinder-quobyte-9ab366b2-4a05-4810-a6e7-c20ad4e30350" released by "delete_volume" :: held 0.853s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b80b7150-7c4f-48d6-a149-551265fc8ecd tempest-ProjectReaderTests-2031349546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-324ef097-ea4f-45cc-a4ad-738273715732 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:18 devstack sudo[106742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-324ef097-ea4f-45cc-a4ad-738273715732 Sep 23 00:34:18 devstack sudo[106742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:18 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-cc2b084a-3315-4a6a-94f4-6782436c26d0 tempest-ProjectMemberTests-2104250010 None] Created reservations ['b9fb8775-6c75-49f8-bc9f-d76f1831a222', '37cf62d4-e653-4362-a99d-5e25b27ac166', '40377264-3733-4f86-a9a6-8fa31483344c', 'ce6f3e8f-83cd-44e9-89f2-091657327f0f'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:34:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-cc2b084a-3315-4a6a-94f4-6782436c26d0 tempest-ProjectMemberTests-2104250010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-cc2b084a-3315-4a6a-94f4-6782436c26d0 tempest-ProjectMemberTests-2104250010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:18 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-cc2b084a-3315-4a6a-94f4-6782436c26d0 tempest-ProjectMemberTests-2104250010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:18 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-cc2b084a-3315-4a6a-94f4-6782436c26d0 tempest-ProjectMemberTests-2104250010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-cc2b084a-3315-4a6a-94f4-6782436c26d0 tempest-ProjectMemberTests-2104250010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cc2b084a-3315-4a6a-94f4-6782436c26d0 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:18 devstack sudo[106744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:34:18 devstack sudo[106744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:18 devstack sudo[106742]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b80b7150-7c4f-48d6-a149-551265fc8ecd tempest-ProjectReaderTests-2031349546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-324ef097-ea4f-45cc-a4ad-738273715732" returned: 0 in 0.323s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:18 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b80b7150-7c4f-48d6-a149-551265fc8ecd tempest-ProjectReaderTests-2031349546 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:34:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b80b7150-7c4f-48d6-a149-551265fc8ecd tempest-ProjectReaderTests-2031349546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b80b7150-7c4f-48d6-a149-551265fc8ecd tempest-ProjectReaderTests-2031349546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5dbf740-5a76-4fab-ae83-8220d1b2ec1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-324ef097-ea4f-45cc-a4ad-738273715732', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b80b7150-7c4f-48d6-a149-551265fc8ecd tempest-ProjectReaderTests-2031349546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff86b6bc-d9bf-4735-8ba8-e3db2fcae9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:18 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-b80b7150-7c4f-48d6-a149-551265fc8ecd tempest-ProjectReaderTests-2031349546 None] Volume volume-324ef097-ea4f-45cc-a4ad-738273715732 (324ef097-ea4f-45cc-a4ad-738273715732): created successfully Sep 23 00:34:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b80b7150-7c4f-48d6-a149-551265fc8ecd tempest-ProjectReaderTests-2031349546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff86b6bc-d9bf-4735-8ba8-e3db2fcae9c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:18 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-b80b7150-7c4f-48d6-a149-551265fc8ecd tempest-ProjectReaderTests-2031349546 None] Flow 'volume_create_manager' (5a45ac9a-1171-4b6b-aac4-dfca618e440c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:18 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-b80b7150-7c4f-48d6-a149-551265fc8ecd tempest-ProjectReaderTests-2031349546 None] Created volume successfully. Sep 23 00:34:18 devstack sudo[106744]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:18 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-cc2b084a-3315-4a6a-94f4-6782436c26d0 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.319s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:18 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-cc2b084a-3315-4a6a-94f4-6782436c26d0 tempest-ProjectMemberTests-2104250010 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:34:18 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-cc2b084a-3315-4a6a-94f4-6782436c26d0 tempest-ProjectMemberTests-2104250010 None] Deleted volume successfully. Sep 23 00:34:18 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-cc2b084a-3315-4a6a-94f4-6782436c26d0 tempest-ProjectMemberTests-2104250010 None] Lock "cinder-9ab366b2-4a05-4810-a6e7-c20ad4e30350-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:19 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3fac2c6-e627-49be-8370-080e47d1ccd0 tempest-ProjectMemberTests-2104250010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:34:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e3fac2c6-e627-49be-8370-080e47d1ccd0 tempest-ProjectMemberTests-2104250010 None] Flow 'volume_create_manager' (3524d678-ba05-471c-acbb-11168e514884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e3fac2c6-e627-49be-8370-080e47d1ccd0 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2f265bf-dd41-4258-8012-ea2dd0f55e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e3fac2c6-e627-49be-8370-080e47d1ccd0 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2f265bf-dd41-4258-8012-ea2dd0f55e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-123326526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7ec0bc8-00bc-493f-9425-ec175a87986c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='105e2fcb253445d18a9a36e4adbf6662',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:19Z,use_quota=True,user_id='6f62c0bf87c2488e987066aaecad1a03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e3fac2c6-e627-49be-8370-080e47d1ccd0 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ed0eb8e-15e6-45ee-a369-4d18e8450acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e3fac2c6-e627-49be-8370-080e47d1ccd0 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ed0eb8e-15e6-45ee-a369-4d18e8450acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e3fac2c6-e627-49be-8370-080e47d1ccd0 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (401bcbd8-3249-46d6-8674-31c7828b4f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e3fac2c6-e627-49be-8370-080e47d1ccd0 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (401bcbd8-3249-46d6-8674-31c7828b4f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7ec0bc8-00bc-493f-9425-ec175a87986c', 'volume_name': 'volume-a7ec0bc8-00bc-493f-9425-ec175a87986c', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e3fac2c6-e627-49be-8370-080e47d1ccd0 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d4bd85f-4b30-400c-b6d2-debc4c48ff12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e3fac2c6-e627-49be-8370-080e47d1ccd0 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d4bd85f-4b30-400c-b6d2-debc4c48ff12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e3fac2c6-e627-49be-8370-080e47d1ccd0 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea61c9b6-cb44-4d2f-ab81-b11c3d4c6a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:19 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-e3fac2c6-e627-49be-8370-080e47d1ccd0 tempest-ProjectMemberTests-2104250010 None] Volume a7ec0bc8-00bc-493f-9425-ec175a87986c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7ec0bc8-00bc-493f-9425-ec175a87986c', 'volume_size': 1} Sep 23 00:34:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e3fac2c6-e627-49be-8370-080e47d1ccd0 tempest-ProjectMemberTests-2104250010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e3fac2c6-e627-49be-8370-080e47d1ccd0 tempest-ProjectMemberTests-2104250010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:19 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e3fac2c6-e627-49be-8370-080e47d1ccd0 tempest-ProjectMemberTests-2104250010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-123326526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7ec0bc8-00bc-493f-9425-ec175a87986c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='105e2fcb253445d18a9a36e4adbf6662',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:19Z,use_quota=True,user_id='6f62c0bf87c2488e987066aaecad1a03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:34:19 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-e3fac2c6-e627-49be-8370-080e47d1ccd0 tempest-ProjectMemberTests-2104250010 None] Creating volume a7ec0bc8-00bc-493f-9425-ec175a87986c {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:34:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e3fac2c6-e627-49be-8370-080e47d1ccd0 tempest-ProjectMemberTests-2104250010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e3fac2c6-e627-49be-8370-080e47d1ccd0 tempest-ProjectMemberTests-2104250010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:19 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e3fac2c6-e627-49be-8370-080e47d1ccd0 tempest-ProjectMemberTests-2104250010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:19 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e3fac2c6-e627-49be-8370-080e47d1ccd0 tempest-ProjectMemberTests-2104250010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e3fac2c6-e627-49be-8370-080e47d1ccd0 tempest-ProjectMemberTests-2104250010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:19 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e3fac2c6-e627-49be-8370-080e47d1ccd0 tempest-ProjectMemberTests-2104250010 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:34:19 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-e3fac2c6-e627-49be-8370-080e47d1ccd0 tempest-ProjectMemberTests-2104250010 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:34:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e3fac2c6-e627-49be-8370-080e47d1ccd0 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a7ec0bc8-00bc-493f-9425-ec175a87986c 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:19 devstack sudo[106748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a7ec0bc8-00bc-493f-9425-ec175a87986c 1073741824 Sep 23 00:34:19 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:19 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e3fac2c6-e627-49be-8370-080e47d1ccd0 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a7ec0bc8-00bc-493f-9425-ec175a87986c 1073741824" returned: 0 in 0.441s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e3fac2c6-e627-49be-8370-080e47d1ccd0 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a7ec0bc8-00bc-493f-9425-ec175a87986c {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:19 devstack sudo[106753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a7ec0bc8-00bc-493f-9425-ec175a87986c Sep 23 00:34:19 devstack sudo[106753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4788b688-de39-4d3e-a202-708f5f42d728 tempest-ProjectReaderTests-2031349546 None] Acquiring lock "cinder-324ef097-ea4f-45cc-a4ad-738273715732-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4788b688-de39-4d3e-a202-708f5f42d728 tempest-ProjectReaderTests-2031349546 None] Lock "cinder-324ef097-ea4f-45cc-a4ad-738273715732-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4788b688-de39-4d3e-a202-708f5f42d728 tempest-ProjectReaderTests-2031349546 None] Acquiring lock "cinder-quobyte-324ef097-ea4f-45cc-a4ad-738273715732" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:19 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4788b688-de39-4d3e-a202-708f5f42d728 tempest-ProjectReaderTests-2031349546 None] Lock "cinder-quobyte-324ef097-ea4f-45cc-a4ad-738273715732" acquired by "delete_volume" :: waited 0.020s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:19 devstack sudo[106753]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-e3fac2c6-e627-49be-8370-080e47d1ccd0 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a7ec0bc8-00bc-493f-9425-ec175a87986c" returned: 0 in 0.335s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:19 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-e3fac2c6-e627-49be-8370-080e47d1ccd0 tempest-ProjectMemberTests-2104250010 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:34:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-e3fac2c6-e627-49be-8370-080e47d1ccd0 tempest-ProjectMemberTests-2104250010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e3fac2c6-e627-49be-8370-080e47d1ccd0 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea61c9b6-cb44-4d2f-ab81-b11c3d4c6a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7ec0bc8-00bc-493f-9425-ec175a87986c', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:19 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e3fac2c6-e627-49be-8370-080e47d1ccd0 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b52d80e-5ab9-4b5d-ad10-3b3fd10399ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:19 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9372bd5-8ad9-440b-b486-d9cce01cf417]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:19 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4788b688-de39-4d3e-a202-708f5f42d728 tempest-ProjectReaderTests-2031349546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-324ef097-ea4f-45cc-a4ad-738273715732 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:20 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-e3fac2c6-e627-49be-8370-080e47d1ccd0 tempest-ProjectMemberTests-2104250010 None] Volume volume-a7ec0bc8-00bc-493f-9425-ec175a87986c (a7ec0bc8-00bc-493f-9425-ec175a87986c): created successfully Sep 23 00:34:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e3fac2c6-e627-49be-8370-080e47d1ccd0 tempest-ProjectMemberTests-2104250010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b52d80e-5ab9-4b5d-ad10-3b3fd10399ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:20 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-e3fac2c6-e627-49be-8370-080e47d1ccd0 tempest-ProjectMemberTests-2104250010 None] Flow 'volume_create_manager' (3524d678-ba05-471c-acbb-11168e514884) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:20 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-e3fac2c6-e627-49be-8370-080e47d1ccd0 tempest-ProjectMemberTests-2104250010 None] Created volume successfully. Sep 23 00:34:20 devstack sudo[106756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-324ef097-ea4f-45cc-a4ad-738273715732 Sep 23 00:34:20 devstack sudo[106756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:20 devstack sudo[106756]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4788b688-de39-4d3e-a202-708f5f42d728 tempest-ProjectReaderTests-2031349546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-324ef097-ea4f-45cc-a4ad-738273715732" returned: 0 in 0.418s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4788b688-de39-4d3e-a202-708f5f42d728 tempest-ProjectReaderTests-2031349546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-324ef097-ea4f-45cc-a4ad-738273715732 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:20 devstack sudo[106772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-324ef097-ea4f-45cc-a4ad-738273715732 Sep 23 00:34:20 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:20 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4788b688-de39-4d3e-a202-708f5f42d728 tempest-ProjectReaderTests-2031349546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-324ef097-ea4f-45cc-a4ad-738273715732" returned: 0 in 0.310s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:20 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4788b688-de39-4d3e-a202-708f5f42d728 tempest-ProjectReaderTests-2031349546 None] Lock "cinder-quobyte-324ef097-ea4f-45cc-a4ad-738273715732" released by "delete_volume" :: held 0.807s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:20 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-4788b688-de39-4d3e-a202-708f5f42d728 tempest-ProjectReaderTests-2031349546 None] Created reservations ['2d48ce56-7b3d-427d-bafc-f8fb82dd4e39', '30585234-b35f-4fe8-9679-0626026e0d49', 'b7183ab5-7a7e-4b01-8cbf-9141e3b5cfcb', 'c95ebf7d-143e-4300-85be-af98a6e0a833'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:34:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4788b688-de39-4d3e-a202-708f5f42d728 tempest-ProjectReaderTests-2031349546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4788b688-de39-4d3e-a202-708f5f42d728 tempest-ProjectReaderTests-2031349546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:20 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4788b688-de39-4d3e-a202-708f5f42d728 tempest-ProjectReaderTests-2031349546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:20 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-4788b688-de39-4d3e-a202-708f5f42d728 tempest-ProjectReaderTests-2031349546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-4788b688-de39-4d3e-a202-708f5f42d728 tempest-ProjectReaderTests-2031349546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4788b688-de39-4d3e-a202-708f5f42d728 tempest-ProjectReaderTests-2031349546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:20 devstack sudo[106801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:34:20 devstack sudo[106801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:21 devstack sudo[106801]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-4788b688-de39-4d3e-a202-708f5f42d728 tempest-ProjectReaderTests-2031349546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.327s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:21 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-4788b688-de39-4d3e-a202-708f5f42d728 tempest-ProjectReaderTests-2031349546 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:34:21 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-4788b688-de39-4d3e-a202-708f5f42d728 tempest-ProjectReaderTests-2031349546 None] Deleted volume successfully. Sep 23 00:34:21 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-4788b688-de39-4d3e-a202-708f5f42d728 tempest-ProjectReaderTests-2031349546 None] Lock "cinder-324ef097-ea4f-45cc-a4ad-738273715732-delete_volume" released by "delete_volume" :: held 1.434s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-63dc84e3-032f-4213-84ed-57e4a929e2e2 tempest-ProjectMemberTests-2104250010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-63dc84e3-032f-4213-84ed-57e4a929e2e2 tempest-ProjectMemberTests-2104250010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:21 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-63dc84e3-032f-4213-84ed-57e4a929e2e2 tempest-ProjectMemberTests-2104250010 None] Creating offline snapshot 71698c59-a1a2-4861-9153-21042b0a8879 of volume a7ec0bc8-00bc-493f-9425-ec175a87986c {{(pid=86591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:34:21 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9e4e8c-c535-4582-816c-7ecb0bbbe5a8]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-63dc84e3-032f-4213-84ed-57e4a929e2e2 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a7ec0bc8-00bc-493f-9425-ec175a87986c {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:21 devstack sudo[106804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a7ec0bc8-00bc-493f-9425-ec175a87986c Sep 23 00:34:21 devstack sudo[106804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:21 devstack cinder-volume[86591]: DEBUG cinder.volume.flows.manager.create_volume [None req-dda5ebd9-8a0c-4f21-b4f8-8596ba63008f tempest-ProjectReaderTests-2031349546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:34:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-dda5ebd9-8a0c-4f21-b4f8-8596ba63008f tempest-ProjectReaderTests-2031349546 None] Flow 'volume_create_manager' (899ccf2a-14dc-4cbe-84f0-a5e929296f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-dda5ebd9-8a0c-4f21-b4f8-8596ba63008f tempest-ProjectReaderTests-2031349546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cbed782-0a1f-46ef-a6bb-7fff8345e2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-dda5ebd9-8a0c-4f21-b4f8-8596ba63008f tempest-ProjectReaderTests-2031349546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cbed782-0a1f-46ef-a6bb-7fff8345e2b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1677678628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3ef49d3-e9e3-4ccb-807e-bf7d14ab9239,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63267e01c1d6464ba9d96563872ff60b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:22Z,use_quota=True,user_id='0d945b80b6ab4be7acdfeeda16ca1045',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-dda5ebd9-8a0c-4f21-b4f8-8596ba63008f tempest-ProjectReaderTests-2031349546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2b75ff6-a9e8-4378-99ac-5cecf2ff8600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-dda5ebd9-8a0c-4f21-b4f8-8596ba63008f tempest-ProjectReaderTests-2031349546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2b75ff6-a9e8-4378-99ac-5cecf2ff8600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-dda5ebd9-8a0c-4f21-b4f8-8596ba63008f tempest-ProjectReaderTests-2031349546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (410a4ccb-5f96-49b9-b403-2db141e19b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-dda5ebd9-8a0c-4f21-b4f8-8596ba63008f tempest-ProjectReaderTests-2031349546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (410a4ccb-5f96-49b9-b403-2db141e19b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3ef49d3-e9e3-4ccb-807e-bf7d14ab9239', 'volume_name': 'volume-a3ef49d3-e9e3-4ccb-807e-bf7d14ab9239', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-dda5ebd9-8a0c-4f21-b4f8-8596ba63008f tempest-ProjectReaderTests-2031349546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (066f7d55-d049-4617-99ff-6e077ed9e8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-dda5ebd9-8a0c-4f21-b4f8-8596ba63008f tempest-ProjectReaderTests-2031349546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (066f7d55-d049-4617-99ff-6e077ed9e8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:21 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-dda5ebd9-8a0c-4f21-b4f8-8596ba63008f tempest-ProjectReaderTests-2031349546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faf083f0-d38e-4dfa-9e56-74db6fe102d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:21 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-dda5ebd9-8a0c-4f21-b4f8-8596ba63008f tempest-ProjectReaderTests-2031349546 None] Volume a3ef49d3-e9e3-4ccb-807e-bf7d14ab9239: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3ef49d3-e9e3-4ccb-807e-bf7d14ab9239', 'volume_size': 1} Sep 23 00:34:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-dda5ebd9-8a0c-4f21-b4f8-8596ba63008f tempest-ProjectReaderTests-2031349546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:21 devstack sudo[106804]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-63dc84e3-032f-4213-84ed-57e4a929e2e2 tempest-ProjectMemberTests-2104250010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a7ec0bc8-00bc-493f-9425-ec175a87986c" returned: 0 in 0.447s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:21 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-63dc84e3-032f-4213-84ed-57e4a929e2e2 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a7ec0bc8-00bc-493f-9425-ec175a87986c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a7ec0bc8-00bc-493f-9425-ec175a87986c.71698c59-a1a2-4861-9153-21042b0a8879 1G {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:21 devstack sudo[106809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a7ec0bc8-00bc-493f-9425-ec175a87986c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a7ec0bc8-00bc-493f-9425-ec175a87986c.71698c59-a1a2-4861-9153-21042b0a8879 1G Sep 23 00:34:21 devstack sudo[106809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:22 devstack sudo[106809]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-63dc84e3-032f-4213-84ed-57e4a929e2e2 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a7ec0bc8-00bc-493f-9425-ec175a87986c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a7ec0bc8-00bc-493f-9425-ec175a87986c.71698c59-a1a2-4861-9153-21042b0a8879 1G" returned: 0 in 0.508s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-63dc84e3-032f-4213-84ed-57e4a929e2e2 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7ec0bc8-00bc-493f-9425-ec175a87986c -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a7ec0bc8-00bc-493f-9425-ec175a87986c.71698c59-a1a2-4861-9153-21042b0a8879 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:22 devstack sudo[106816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7ec0bc8-00bc-493f-9425-ec175a87986c -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a7ec0bc8-00bc-493f-9425-ec175a87986c.71698c59-a1a2-4861-9153-21042b0a8879 Sep 23 00:34:22 devstack sudo[106816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:22 devstack sudo[106816]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-63dc84e3-032f-4213-84ed-57e4a929e2e2 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7ec0bc8-00bc-493f-9425-ec175a87986c -F qcow2 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a7ec0bc8-00bc-493f-9425-ec175a87986c.71698c59-a1a2-4861-9153-21042b0a8879" returned: 0 in 0.345s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:22 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-63dc84e3-032f-4213-84ed-57e4a929e2e2 tempest-ProjectMemberTests-2104250010 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a7ec0bc8-00bc-493f-9425-ec175a87986c.71698c59-a1a2-4861-9153-21042b0a8879 is being set with open permissions: ugo+rw Sep 23 00:34:22 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-63dc84e3-032f-4213-84ed-57e4a929e2e2 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a7ec0bc8-00bc-493f-9425-ec175a87986c.71698c59-a1a2-4861-9153-21042b0a8879 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:22 devstack sudo[106821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a7ec0bc8-00bc-493f-9425-ec175a87986c.71698c59-a1a2-4861-9153-21042b0a8879 Sep 23 00:34:22 devstack sudo[106821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:23 devstack sudo[106821]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-63dc84e3-032f-4213-84ed-57e4a929e2e2 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a7ec0bc8-00bc-493f-9425-ec175a87986c.71698c59-a1a2-4861-9153-21042b0a8879" returned: 0 in 0.267s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-63dc84e3-032f-4213-84ed-57e4a929e2e2 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a7ec0bc8-00bc-493f-9425-ec175a87986c.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:23 devstack sudo[106824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a7ec0bc8-00bc-493f-9425-ec175a87986c.info Sep 23 00:34:23 devstack sudo[106824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:23 devstack sudo[106824]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-63dc84e3-032f-4213-84ed-57e4a929e2e2 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a7ec0bc8-00bc-493f-9425-ec175a87986c.info" returned: 0 in 0.256s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:23 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.remotefs [None req-63dc84e3-032f-4213-84ed-57e4a929e2e2 tempest-ProjectMemberTests-2104250010 None] /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a7ec0bc8-00bc-493f-9425-ec175a87986c.info is being set with open permissions: ugo+rw Sep 23 00:34:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-63dc84e3-032f-4213-84ed-57e4a929e2e2 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a7ec0bc8-00bc-493f-9425-ec175a87986c.info {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:23 devstack sudo[106827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a7ec0bc8-00bc-493f-9425-ec175a87986c.info Sep 23 00:34:23 devstack sudo[106827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:23 devstack sudo[106827]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-63dc84e3-032f-4213-84ed-57e4a929e2e2 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a7ec0bc8-00bc-493f-9425-ec175a87986c.info" returned: 0 in 0.269s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-63dc84e3-032f-4213-84ed-57e4a929e2e2 tempest-ProjectMemberTests-2104250010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.202s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-dda5ebd9-8a0c-4f21-b4f8-8596ba63008f tempest-ProjectReaderTests-2031349546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.862s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:23 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-dda5ebd9-8a0c-4f21-b4f8-8596ba63008f tempest-ProjectReaderTests-2031349546 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1677678628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3ef49d3-e9e3-4ccb-807e-bf7d14ab9239,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63267e01c1d6464ba9d96563872ff60b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:22Z,use_quota=True,user_id='0d945b80b6ab4be7acdfeeda16ca1045',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bc41190-8e82-4d68-bcd7-17a9c0c8fc14),volume_type_id=2bc41190-8e82-4d68-bcd7-17a9c0c8fc14)}" {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:34:23 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-dda5ebd9-8a0c-4f21-b4f8-8596ba63008f tempest-ProjectReaderTests-2031349546 None] Creating volume a3ef49d3-e9e3-4ccb-807e-bf7d14ab9239 {{(pid=86591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:34:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-dda5ebd9-8a0c-4f21-b4f8-8596ba63008f tempest-ProjectReaderTests-2031349546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-dda5ebd9-8a0c-4f21-b4f8-8596ba63008f tempest-ProjectReaderTests-2031349546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:23 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-dda5ebd9-8a0c-4f21-b4f8-8596ba63008f tempest-ProjectReaderTests-2031349546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:23 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-dda5ebd9-8a0c-4f21-b4f8-8596ba63008f tempest-ProjectReaderTests-2031349546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-dda5ebd9-8a0c-4f21-b4f8-8596ba63008f tempest-ProjectReaderTests-2031349546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:23 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-dda5ebd9-8a0c-4f21-b4f8-8596ba63008f tempest-ProjectReaderTests-2031349546 None] Selected osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 as target Quobyte volume. {{(pid=86591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:34:23 devstack cinder-volume[86591]: INFO cinder.volume.drivers.remotefs [None req-dda5ebd9-8a0c-4f21-b4f8-8596ba63008f tempest-ProjectReaderTests-2031349546 None] casted to osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974 Sep 23 00:34:23 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dda5ebd9-8a0c-4f21-b4f8-8596ba63008f tempest-ProjectReaderTests-2031349546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a3ef49d3-e9e3-4ccb-807e-bf7d14ab9239 1073741824 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:23 devstack sudo[106830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a3ef49d3-e9e3-4ccb-807e-bf7d14ab9239 1073741824 Sep 23 00:34:23 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:23 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-63dc84e3-032f-4213-84ed-57e4a929e2e2 tempest-ProjectMemberTests-2104250010 None] Create snapshot completed successfully Sep 23 00:34:24 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dda5ebd9-8a0c-4f21-b4f8-8596ba63008f tempest-ProjectReaderTests-2031349546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a3ef49d3-e9e3-4ccb-807e-bf7d14ab9239 1073741824" returned: 0 in 0.459s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dda5ebd9-8a0c-4f21-b4f8-8596ba63008f tempest-ProjectReaderTests-2031349546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a3ef49d3-e9e3-4ccb-807e-bf7d14ab9239 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:24 devstack sudo[106835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a3ef49d3-e9e3-4ccb-807e-bf7d14ab9239 Sep 23 00:34:24 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:24 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-dda5ebd9-8a0c-4f21-b4f8-8596ba63008f tempest-ProjectReaderTests-2031349546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a3ef49d3-e9e3-4ccb-807e-bf7d14ab9239" returned: 0 in 0.243s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:24 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-dda5ebd9-8a0c-4f21-b4f8-8596ba63008f tempest-ProjectReaderTests-2031349546 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'} {{(pid=86591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:34:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-dda5ebd9-8a0c-4f21-b4f8-8596ba63008f tempest-ProjectReaderTests-2031349546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-dda5ebd9-8a0c-4f21-b4f8-8596ba63008f tempest-ProjectReaderTests-2031349546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faf083f0-d38e-4dfa-9e56-74db6fe102d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3ef49d3-e9e3-4ccb-807e-bf7d14ab9239', 'volume_size': 1}' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-dda5ebd9-8a0c-4f21-b4f8-8596ba63008f tempest-ProjectReaderTests-2031349546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e98f263-760e-46f7-963f-b74de275677f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:24 devstack cinder-volume[86591]: INFO cinder.volume.flows.manager.create_volume [None req-dda5ebd9-8a0c-4f21-b4f8-8596ba63008f tempest-ProjectReaderTests-2031349546 None] Volume volume-a3ef49d3-e9e3-4ccb-807e-bf7d14ab9239 (a3ef49d3-e9e3-4ccb-807e-bf7d14ab9239): created successfully Sep 23 00:34:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-dda5ebd9-8a0c-4f21-b4f8-8596ba63008f tempest-ProjectReaderTests-2031349546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e98f263-760e-46f7-963f-b74de275677f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:24 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-dda5ebd9-8a0c-4f21-b4f8-8596ba63008f tempest-ProjectReaderTests-2031349546 None] Flow 'volume_create_manager' (899ccf2a-14dc-4cbe-84f0-a5e929296f29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:24 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-dda5ebd9-8a0c-4f21-b4f8-8596ba63008f tempest-ProjectReaderTests-2031349546 None] Created volume successfully. Sep 23 00:34:24 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c3a15cd7-1ee1-4c9a-a6dc-ba1ad49b9fb3 tempest-ProjectMemberTests-2104250010 None] Acquiring lock "cinder-71698c59-a1a2-4861-9153-21042b0a8879-delete_snapshot" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:24 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c3a15cd7-1ee1-4c9a-a6dc-ba1ad49b9fb3 tempest-ProjectMemberTests-2104250010 None] Lock "cinder-71698c59-a1a2-4861-9153-21042b0a8879-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:24 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c3a15cd7-1ee1-4c9a-a6dc-ba1ad49b9fb3 tempest-ProjectMemberTests-2104250010 None] Acquiring lock "cinder-quobyte-a7ec0bc8-00bc-493f-9425-ec175a87986c" by "delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:24 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c3a15cd7-1ee1-4c9a-a6dc-ba1ad49b9fb3 tempest-ProjectMemberTests-2104250010 None] Lock "cinder-quobyte-a7ec0bc8-00bc-493f-9425-ec175a87986c" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:24 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c3a15cd7-1ee1-4c9a-a6dc-ba1ad49b9fb3 tempest-ProjectMemberTests-2104250010 None] Acquiring lock "cinder-quobyte-71698c59-a1a2-4861-9153-21042b0a8879" by "_delete_snapshot" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:24 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c3a15cd7-1ee1-4c9a-a6dc-ba1ad49b9fb3 tempest-ProjectMemberTests-2104250010 None] Lock "cinder-quobyte-71698c59-a1a2-4861-9153-21042b0a8879" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:24 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-c3a15cd7-1ee1-4c9a-a6dc-ba1ad49b9fb3 tempest-ProjectMemberTests-2104250010 None] Deleting offline snapshot 71698c59-a1a2-4861-9153-21042b0a8879 of volume a7ec0bc8-00bc-493f-9425-ec175a87986c {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:34:24 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-c3a15cd7-1ee1-4c9a-a6dc-ba1ad49b9fb3 tempest-ProjectMemberTests-2104250010 None] snapshot_file for this snap is: volume-a7ec0bc8-00bc-493f-9425-ec175a87986c.71698c59-a1a2-4861-9153-21042b0a8879 {{(pid=86591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:34:24 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a60e6581-49e7-4172-87bd-1a39b75ba0af]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:24 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c3a15cd7-1ee1-4c9a-a6dc-ba1ad49b9fb3 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a7ec0bc8-00bc-493f-9425-ec175a87986c.71698c59-a1a2-4861-9153-21042b0a8879 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:24 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b18956e6-d233-4797-b92f-7a7373a5de7d tempest-ProjectReaderTests-2031349546 None] Acquiring lock "cinder-a3ef49d3-e9e3-4ccb-807e-bf7d14ab9239-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:24 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b18956e6-d233-4797-b92f-7a7373a5de7d tempest-ProjectReaderTests-2031349546 None] Lock "cinder-a3ef49d3-e9e3-4ccb-807e-bf7d14ab9239-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:25 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b18956e6-d233-4797-b92f-7a7373a5de7d tempest-ProjectReaderTests-2031349546 None] Acquiring lock "cinder-quobyte-a3ef49d3-e9e3-4ccb-807e-bf7d14ab9239" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:25 devstack sudo[106838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a7ec0bc8-00bc-493f-9425-ec175a87986c.71698c59-a1a2-4861-9153-21042b0a8879 Sep 23 00:34:25 devstack sudo[106838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:25 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b18956e6-d233-4797-b92f-7a7373a5de7d tempest-ProjectReaderTests-2031349546 None] Lock "cinder-quobyte-a3ef49d3-e9e3-4ccb-807e-bf7d14ab9239" acquired by "delete_volume" :: waited 0.032s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:25 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a80db94-a4cf-4f8a-a39c-6bbd4ad22694]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b18956e6-d233-4797-b92f-7a7373a5de7d tempest-ProjectReaderTests-2031349546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a3ef49d3-e9e3-4ccb-807e-bf7d14ab9239 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:25 devstack sudo[106840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a3ef49d3-e9e3-4ccb-807e-bf7d14ab9239 Sep 23 00:34:25 devstack sudo[106840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:25 devstack sudo[106838]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c3a15cd7-1ee1-4c9a-a6dc-ba1ad49b9fb3 tempest-ProjectMemberTests-2104250010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a7ec0bc8-00bc-493f-9425-ec175a87986c.71698c59-a1a2-4861-9153-21042b0a8879" returned: 0 in 0.467s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:25 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-c3a15cd7-1ee1-4c9a-a6dc-ba1ad49b9fb3 tempest-ProjectMemberTests-2104250010 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7ec0bc8-00bc-493f-9425-ec175a87986c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:34:25 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[7885d74b-4240-4f90-97e1-a024ef04c119]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c3a15cd7-1ee1-4c9a-a6dc-ba1ad49b9fb3 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a7ec0bc8-00bc-493f-9425-ec175a87986c {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:25 devstack sudo[106840]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:25 devstack sudo[106845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a7ec0bc8-00bc-493f-9425-ec175a87986c Sep 23 00:34:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b18956e6-d233-4797-b92f-7a7373a5de7d tempest-ProjectReaderTests-2031349546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a3ef49d3-e9e3-4ccb-807e-bf7d14ab9239" returned: 0 in 0.440s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b18956e6-d233-4797-b92f-7a7373a5de7d tempest-ProjectReaderTests-2031349546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a3ef49d3-e9e3-4ccb-807e-bf7d14ab9239 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:25 devstack sudo[106845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:25 devstack sudo[106851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a3ef49d3-e9e3-4ccb-807e-bf7d14ab9239 Sep 23 00:34:25 devstack sudo[106851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:25 devstack sudo[106851]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b18956e6-d233-4797-b92f-7a7373a5de7d tempest-ProjectReaderTests-2031349546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a3ef49d3-e9e3-4ccb-807e-bf7d14ab9239" returned: 0 in 0.274s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:25 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b18956e6-d233-4797-b92f-7a7373a5de7d tempest-ProjectReaderTests-2031349546 None] Lock "cinder-quobyte-a3ef49d3-e9e3-4ccb-807e-bf7d14ab9239" released by "delete_volume" :: held 0.770s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:25 devstack sudo[106845]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c3a15cd7-1ee1-4c9a-a6dc-ba1ad49b9fb3 tempest-ProjectMemberTests-2104250010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a7ec0bc8-00bc-493f-9425-ec175a87986c" returned: 0 in 0.446s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c3a15cd7-1ee1-4c9a-a6dc-ba1ad49b9fb3 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a7ec0bc8-00bc-493f-9425-ec175a87986c.71698c59-a1a2-4861-9153-21042b0a8879 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:25 devstack sudo[106857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a7ec0bc8-00bc-493f-9425-ec175a87986c.71698c59-a1a2-4861-9153-21042b0a8879 Sep 23 00:34:25 devstack sudo[106857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:25 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-b18956e6-d233-4797-b92f-7a7373a5de7d tempest-ProjectReaderTests-2031349546 None] Created reservations ['b0cc3972-682f-4342-846a-809c0e976352', '699520fc-b7ec-48d3-9308-be0a20457ccb', 'b46f8410-9e44-48f6-abd1-bbb89fb03db4', '7825a406-2e3f-4f6c-a276-bf068fa71edb'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:34:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b18956e6-d233-4797-b92f-7a7373a5de7d tempest-ProjectReaderTests-2031349546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b18956e6-d233-4797-b92f-7a7373a5de7d tempest-ProjectReaderTests-2031349546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:25 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b18956e6-d233-4797-b92f-7a7373a5de7d tempest-ProjectReaderTests-2031349546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:25 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-b18956e6-d233-4797-b92f-7a7373a5de7d tempest-ProjectReaderTests-2031349546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-b18956e6-d233-4797-b92f-7a7373a5de7d tempest-ProjectReaderTests-2031349546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:25 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b18956e6-d233-4797-b92f-7a7373a5de7d tempest-ProjectReaderTests-2031349546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:25 devstack sudo[106859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:34:25 devstack sudo[106859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:26 devstack sudo[106857]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c3a15cd7-1ee1-4c9a-a6dc-ba1ad49b9fb3 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a7ec0bc8-00bc-493f-9425-ec175a87986c.71698c59-a1a2-4861-9153-21042b0a8879" returned: 0 in 0.442s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c3a15cd7-1ee1-4c9a-a6dc-ba1ad49b9fb3 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a7ec0bc8-00bc-493f-9425-ec175a87986c.71698c59-a1a2-4861-9153-21042b0a8879 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:26 devstack sudo[106859]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-b18956e6-d233-4797-b92f-7a7373a5de7d tempest-ProjectReaderTests-2031349546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.324s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:26 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-b18956e6-d233-4797-b92f-7a7373a5de7d tempest-ProjectReaderTests-2031349546 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:34:26 devstack sudo[106865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a7ec0bc8-00bc-493f-9425-ec175a87986c.71698c59-a1a2-4861-9153-21042b0a8879 Sep 23 00:34:26 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:26 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-b18956e6-d233-4797-b92f-7a7373a5de7d tempest-ProjectReaderTests-2031349546 None] Deleted volume successfully. Sep 23 00:34:26 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-b18956e6-d233-4797-b92f-7a7373a5de7d tempest-ProjectReaderTests-2031349546 None] Lock "cinder-a3ef49d3-e9e3-4ccb-807e-bf7d14ab9239-delete_volume" released by "delete_volume" :: held 1.374s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:26 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:26 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-c3a15cd7-1ee1-4c9a-a6dc-ba1ad49b9fb3 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a7ec0bc8-00bc-493f-9425-ec175a87986c.71698c59-a1a2-4861-9153-21042b0a8879" returned: 0 in 0.330s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:26 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c3a15cd7-1ee1-4c9a-a6dc-ba1ad49b9fb3 tempest-ProjectMemberTests-2104250010 None] Lock "cinder-quobyte-71698c59-a1a2-4861-9153-21042b0a8879" released by "_delete_snapshot" :: held 1.810s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:26 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c3a15cd7-1ee1-4c9a-a6dc-ba1ad49b9fb3 tempest-ProjectMemberTests-2104250010 None] Lock "cinder-quobyte-a7ec0bc8-00bc-493f-9425-ec175a87986c" released by "delete_snapshot" :: held 1.840s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:26 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-c3a15cd7-1ee1-4c9a-a6dc-ba1ad49b9fb3 tempest-ProjectMemberTests-2104250010 None] Created reservations ['9e4a9210-7b8b-4859-9411-4a4652a64718', '2457fd53-8210-4b6c-a270-7693a0b07a39', 'a0705049-43d9-44c0-b550-1a22ebc1805b', '23f806e4-dfc9-435f-bdc9-96bb21935ec8'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:34:26 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-c3a15cd7-1ee1-4c9a-a6dc-ba1ad49b9fb3 tempest-ProjectMemberTests-2104250010 None] Delete snapshot completed successfully. Sep 23 00:34:26 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-c3a15cd7-1ee1-4c9a-a6dc-ba1ad49b9fb3 tempest-ProjectMemberTests-2104250010 None] Lock "cinder-71698c59-a1a2-4861-9153-21042b0a8879-delete_snapshot" released by "delete_snapshot" :: held 2.034s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:26 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-02bfd2b1-4e84-4eb9-bf20-804570e0dd35 tempest-ProjectMemberTests-2104250010 None] Acquiring lock "cinder-a7ec0bc8-00bc-493f-9425-ec175a87986c-delete_volume" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:26 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-02bfd2b1-4e84-4eb9-bf20-804570e0dd35 tempest-ProjectMemberTests-2104250010 None] Lock "cinder-a7ec0bc8-00bc-493f-9425-ec175a87986c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:26 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-02bfd2b1-4e84-4eb9-bf20-804570e0dd35 tempest-ProjectMemberTests-2104250010 None] Acquiring lock "cinder-quobyte-a7ec0bc8-00bc-493f-9425-ec175a87986c" by "delete_volume" {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:27 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-02bfd2b1-4e84-4eb9-bf20-804570e0dd35 tempest-ProjectMemberTests-2104250010 None] Lock "cinder-quobyte-a7ec0bc8-00bc-493f-9425-ec175a87986c" acquired by "delete_volume" :: waited 0.018s {{(pid=86591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:27 devstack cinder-volume[86591]: DEBUG oslo.privsep.daemon [-] privsep: reply[1901a9eb-08ed-425d-8e2b-e8c11845ee41]: (4, 'qcow2') {{(pid=87822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-02bfd2b1-4e84-4eb9-bf20-804570e0dd35 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a7ec0bc8-00bc-493f-9425-ec175a87986c {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:27 devstack sudo[106868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a7ec0bc8-00bc-493f-9425-ec175a87986c Sep 23 00:34:27 devstack sudo[106868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:27 devstack sudo[106868]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-02bfd2b1-4e84-4eb9-bf20-804570e0dd35 tempest-ProjectMemberTests-2104250010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a7ec0bc8-00bc-493f-9425-ec175a87986c" returned: 0 in 0.405s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-02bfd2b1-4e84-4eb9-bf20-804570e0dd35 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a7ec0bc8-00bc-493f-9425-ec175a87986c {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:27 devstack sudo[106873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a7ec0bc8-00bc-493f-9425-ec175a87986c Sep 23 00:34:27 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:27 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-02bfd2b1-4e84-4eb9-bf20-804570e0dd35 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5/volume-a7ec0bc8-00bc-493f-9425-ec175a87986c" returned: 0 in 0.267s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:27 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-02bfd2b1-4e84-4eb9-bf20-804570e0dd35 tempest-ProjectMemberTests-2104250010 None] Lock "cinder-quobyte-a7ec0bc8-00bc-493f-9425-ec175a87986c" released by "delete_volume" :: held 0.753s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:27 devstack cinder-volume[86591]: DEBUG cinder.quota [None req-02bfd2b1-4e84-4eb9-bf20-804570e0dd35 tempest-ProjectMemberTests-2104250010 None] Created reservations ['323e146f-ff2b-498f-909e-707bfd196483', '2381a11d-7c4d-4132-a43f-6e2186cc056d', '2e6b1de9-176c-4eb9-8dc2-1eaefc79d8c6', 'c944b5c5-1616-4fc7-b3ad-d4038a24207e'] {{(pid=86591) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:34:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-02bfd2b1-4e84-4eb9-bf20-804570e0dd35 tempest-ProjectMemberTests-2104250010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-02bfd2b1-4e84-4eb9-bf20-804570e0dd35 tempest-ProjectMemberTests-2104250010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:27 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-02bfd2b1-4e84-4eb9-bf20-804570e0dd35 tempest-ProjectMemberTests-2104250010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:27 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-02bfd2b1-4e84-4eb9-bf20-804570e0dd35 tempest-ProjectMemberTests-2104250010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e75963b-0c6f-4388-b16a-82b0125c1974'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-02bfd2b1-4e84-4eb9-bf20-804570e0dd35 tempest-ProjectMemberTests-2104250010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:27 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-02bfd2b1-4e84-4eb9-bf20-804570e0dd35 tempest-ProjectMemberTests-2104250010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:27 devstack sudo[106877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5 Sep 23 00:34:27 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:28 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:28 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-02bfd2b1-4e84-4eb9-bf20-804570e0dd35 tempest-ProjectMemberTests-2104250010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d354c209fb10ebf275012d8abb547ff5" returned: 0 in 0.314s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:28 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-02bfd2b1-4e84-4eb9-bf20-804570e0dd35 tempest-ProjectMemberTests-2104250010 None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:34:28 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-02bfd2b1-4e84-4eb9-bf20-804570e0dd35 tempest-ProjectMemberTests-2104250010 None] Deleted volume successfully. Sep 23 00:34:28 devstack cinder-volume[86591]: DEBUG cinder.coordination [None req-02bfd2b1-4e84-4eb9-bf20-804570e0dd35 tempest-ProjectMemberTests-2104250010 None] Lock "cinder-a7ec0bc8-00bc-493f-9425-ec175a87986c-delete_volume" released by "delete_volume" :: held 1.384s {{(pid=86591) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:37 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=113,cinder:INSERT=48,cinder:DELETE=14,cinder:UPDATE=176 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:34:38 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=131,cinder:UPDATE=154,cinder:INSERT=41,cinder:DELETE=14 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:35:05 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=1 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:35:05 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:UPDATE=1 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}